AI Service Graph Connector for Databricks

The AI Service Graph Connector for Databricks enables you to discover and import AI assets from your Databricks environment into ServiceNow AI Control Tower.

The connector integrates with your Databricks account to catalog AI systems, agents, models, and prompts. Usage data is automatically collected and populated into the AI Control Tower value dashboard, providing comprehensive visibility and governance of your AI operations.

Download apps from the Store

Visit the ServiceNow store website to download the AI Service Graph Connector for Databricks application.

Supported ServiceNow versions

This connector is supported on the following ServiceNow releases:

User Roles

You must have one of the following roles assigned.

ServiceNow Prerequisites

Complete the following setup steps once when configuring the connector for the first time.

Note: Updating data source access and clear cache is a prerequisite that needs to be completed only once, when setting up a new instance for the first time.

Update Data Source Access

The connector requires write permissions to the Data Source table to create data sources.

To enable data source creation:

1. Select Global from the application picker.
2. Navigate to Application Access.
3. Select the Can create, Can update, and Can delete check boxes.
4. Select Update.
5. Switch to the connector application scope.

Clear cache

Clear the cached data for the Data Source and Tables.

To clear the cache:

1. Navigate to System Definition > Background Scripts

2. Paste the following script into the Run Script text box:

   GlideTableManager.invalidateTable('sys_data_source');
   GlideCacheManager.flushTable('sys_data_source');
   GlideTableManager.invalidateTable('sys_db_object');
   GlideCacheManager.flushTable('sys_db_object');
   

3. Select Run Script.

   Note: The script may take several minutes to complete.

4. After completion, switch to the connector application scope.

Databricks Prerequisites

The Al Service Graph Connector for Databricks automatically imports data from your Databricks into the ServiceNow CMDB. This playbook will guide you through configuring the connection and credentials.

Before proceeding, verify you have:

Databricks Workspace: An active workspace (Azure, AWS, or GCP) with administrative access to the resources you intend to sync.

Authentication Method: A valid OAuth credentials with sufficient scopes to read workspace metadata.

Required Permissions

These permissions are managed via the Databricks Admin console or Account console under the User Management or Service Principal sections:

Service Principal / User Access: The identity used for the connection must have the Admin or Workspace Access entitlement.

Resource-Specific Permissions

Compute/Clusters: Can View permissions for all clusters to be imported.

Unity Catalog: USE CATALOG and USE SCHEMA permissions if importing data lineage or metadata from the Unity Catalog.

SQL Warehouses: Can Use permissions if tracking SQL endpoint utilization.

For information on Databricks resources to generate credentials and configure workspace access, see Databricks- Configure OAuth for Service Principals and https://docs.databricks.com/aws/en/admin/users-groups

Data Mapping

Agents: alm_ai_system_digital_asset -> Model table (cmdb_ai_system_component_product_model)

Models: AI Model Digital Asset (alm_ai_model_digital_asset):

Tools: AI Tool (sn_ent_ai_tool)

AI Agents Usage: sn_ai_disc_ai_usage -> AI system/Model table (alm_ai_system_digital_asset)