Skip to content

Azure Synapse (Apache Spark pool)

Availability BadgeResource Discovery Support Badge

You can scrape an Azure Synapse Apache Spark pool via the SynapseApacheSparkPool resource type.

When using declared resources, the following fields need to be provided:

  • workspaceName - The name of the Azure Synapse workspace.
  • poolName - The name of the Apache Spark pool.

All supported metrics are documented in the official Azure Monitor documentation.

The following scraper-specific metric labels will be added:

  • workspace_name - The name of the Azure Synapse workspace.
  • pool_name - The name of the Apache Spark pool.

Example

Here is an example configuration:

- name: promitor_demo_synapse_apache_spark_apps_ended
  description: "Amount of apps ended running on Apache Spark pool in Azure Synapse"
  resourceType: SynapseApacheSparkPool
  azureMetricConfiguration:
    metricName: BigDataPoolApplicationsEnded
    aggregation:
      type: Total
  resources: # Optional, required when no resource discovery is configured
  - workspaceName: promitor-synapse
    poolName: sparkpool
  resourceDiscoveryGroups: # Optional, requires Promitor Resource Discovery agent (https://promitor.io/concepts/how-it-works#using-resource-discovery)
  - name: synapse-apache-spark-pools