Data mapping for Service Graph Connector for GCP
Data from the GCP data sources is mapped and transformed into the ServiceNow CMDB Configuration Item (CI) class definitions using the Robust Transform Engine (RTE). Data is inserted into the ServiceNow CMDB using the Identification and Reconciliation Engine (IRE).
Data mapping for GCP
When you complete setting up the connection, you can configure the integration to periodically pull data from the GCP application.
The following table lists the data sources, the staging tables, the target tables as the CMDB CI classes, and the resource types imported for a GCP project.
| Data source | Staging table | CMDB CI classes | Resource types |
|---|---|---|---|
| SG-GCP Organization | SG-GCP Organization \[sn\_gcp\_integ\_sg\_gcp\_organization\] | Cloud Organizations | Organization |
| SG-GCP Folder | SG-GCP Folder \[sn\_gcp\_integ\_sg\_gcp\_folder\] | Google Organization FolderSG-GCP Extension Attributes | Folder |
| SG-GCP Project | SG-GCP Project \[sn\_gcp\_integ\_sg\_gcp\_project\] | Google Organization ProjectCloud Service Account Key Value SG-GCP Extension Attributes | Project |
| SG-GCP Network | SG-GCP Network \[sn\_gcp\_integ\_sg\_gcp\_network\] | Cloud NetworkSG-GCP Extension Attributes | Network |
| SG-GCP Machine Image | SG-GCP Machine Image \[sn\_gcp\_integ\_sg\_gcp\_machine\_image\] | ImageKey Value SG-GCP Extension Attributes | MachineImage |
| SG-GCP Subnet | SG-GCP Subnet \[sn\_gcp\_integ\_sg\_gcp\_subnet\] | Cloud SubnetGoogle Datacenter Key Value SG-GCP Extension Attributes | Subnetwork |
| SG-GCP Storage Volume | SG-GCP Storage Volume \[sn\_gcp\_integ\_sg\_gcp\_storage\_volume\] | Storage VolumeGoogle Datacenter Cloud Disk Type Availability Zone Key Value SG-GCP Extension Attributes | Disk |
| SG-GCP Storage Volume Snapshot | SG-GCP Storage Volume Snapshot \[sn\_gcp\_integ\_sg\_gcp\_storage\_vol\_snapshot\] | Storage Volume SnapshotKey Value SG-GCP Extension Attributes | Snapshot |
| SG-GCP Security Group | SG-GCP Security Group \[sn\_gcp\_integ\_sg\_gcp\_security\_group\] | Compute Security GroupNetwork ACL Network ACL Rule Key Value SG-GCP Extension Attributes | Firewall |
| SG-GCP Software Inventory | SG-GCP Software Inventory \[sn\_gcp\_integ\_sg\_gcp\_software\_inventory\] | When the Software Asset Management \(SAM\) application isn't installed: Software Software Instance When the SAM application is installed: Software Installation | Instance |
| SG-GCP VM Instance | SG-GCP VM Instance \[sn\_gcp\_integ\_sg\_gcp\_vm\_instance\] | Virtual Machine InstanceGoogle Datacenter Hardware Type Availability Zone Cloud Mgmt Network Interface Server Storage Mapping Storage Volume VNIC Endpoint Block Endpoint IP Address Key Value SG-GCP Extension Attributes | Instance |
| SG-GCP Execute Patch Job | SG-GCP Execute Patch Job \[sn\_gcp\_integ\_sg\_gcp\_execute\_patch\_job\] | Not applicable | Not applicable |
| SG-GCP Hardware Type | SG-GCP Hardware Type \[sn\_gcp\_integ\_sg\_gcp\_hardware\_type\] | Hardware TypeGoogle Datacenter Availability Zone | MachineType |
| SG-GCP VM Hw Consolidation | SG-GCP VM Hw Consolidation \[sn\_gcp\_integ\_sg\_gcp\_vm\_hw\_consolidation\] | Virtual Machine InstanceServer | None |
| SG-GCP Load Balancer Pool | SG-GCP Load Balancer Pool \[sn\_gcp\_integ\_sg\_gcp\_load\_balancer\_pool\] | Load Balancer PoolGoogle Datacenter Cloud Service Account SG-GCP Extension Attributes Key Value | TargetPool |
| SG-GCP Load Balancer Pool Member | SG-GCP Load Balancer Pool Member \[sn\_gcp\_integ\_sg\_gcp\_load\_balancer\_pool\_member\] | Load Balancer Pool MemberSG-GCP Extension Attributes | TargetPool |
| SG-GCP Load Balancer Health Service | SG-GCP Load Balancer Health Service\[sn\_gcp\_integ\_sg\_gcp\_load\_balancer\_health\_service\] | Cloud Load Balancer Health ServiceSG-GCP Extension Attributes | HealthCheck |
| SG-GCP Load Balancer | SG-GCP Load Balancer \[sn\_gcp\_integ\_sg\_gcp\_load\_balancer\] | Cloud Load BalancerGoogle Datacenter Cloud Service Account SG-GCP Extension Attributes Key Value | BackendService |
| SG-GCP Load Balancer Service | SG-GCP Load Balancer Service \[sn\_gcp\_integ\_sg\_gcp\_load\_balancer\_service\] | Load Balancer ServiceSG-GCP Extension Attributes | ForwardingRule |
| SG-GCP Cloud Database | SG-GCP Cloud Database \[sn\_gcp\_integ\_sg\_gcp\_cloud\_database\] | Cloud DataBaseGoogle Datacenter SG-GCP Extension Attributes Key Value | Instance |
| SG-GCP Cloud Function | SG-GCP Cloud Function \[sn\_gcp\_integ\_sg\_gcp\_cloud\_function\] | Cloud FunctionGoogle Datacenter SG-GCP Extension Attributes Key Value | Function |
| SG-GCP Cloud Object Storage | SG-GCP Cloud Object Storage \[sn\_gcp\_integ\_sg\_gcp\_cloud\_object\_storage\] | Cloud Object StorageGoogle Datacenter Key Value SG-GCP Extension Attributes | Buckets |
| SG-GCP Kubernetes Cluster | SG-GCP Kubernetes Cluster \[sn\_gcp\_integ\_sg\_gcp\_kubernetes\_cluster\] | Kubernetes ClusterKey Value SG-GCP Extension Attributes | Cluster |
| SG-GCP Kubernetes Node | SG-GCP Kubernetes Node \[sn\_gcp\_integ\_sg\_gcp\_kubernetes\_node\] | Kubernetes NodeSG-GCP Extension Attributes | Node |
| SG-GCP Kubernetes Pod | SG-GCP Kubernetes Pod \[sn\_gcp\_integ\_sg\_gcp\_kubernetes\_pod\] | Kubernetes PodKubernetes Volume Docker Image Docker Container Key Value SG-GCP Extension Attributes | Pod |
| SG-GCP Kubernetes Service | SG-GCP Kubernetes Service \[sn\_gcp\_integ\_sg\_gcp\_kubernetes\_service\] | Kubernetes ServiceKey Value SG-GCP Extension Attributes | Service |
| SG-GCP Kubernetes Namespace | SG-GCP Kubernetes Namespace \[sn\_gcp\_integ\_sg\_gcp\_kubernetes\_namespace\] | Kubernetes NamespaceCloud Service Account Key Value SG-GCP Extension Attributes | Namespace |
| SG-GCP Kubernetes Deployment | SG-GCP Kubernetes Deployment \[sn\_gcp\_integ\_sg\_gcp\_kubernetes\_deployment\] | Kubernetes DeploymentKey Value SG-GCP Extension Attributes | Deployment |
| SG-GCP Kubernetes Replicaset | SG-GCP Kubernetes Replicaset \[sn\_gcp\_integ\_sg\_gcp\_kubernetes\_replicaset\] | Kubernetes ReplicaSetKey Value SG-GCP Extension Attributes | ReplicaSet |
| SG-GCP Kubernetes Cluster Roles | SG-GCP Kubernetes Cluster Roles \[sn\_gcp\_integ\_sg\_gcp\_kubernetes\_cluster\_role\] | Kubernetes Cluster RoleKey Value SG-GCP Extension Attributes | ClusterRole |
| SG-GCP Kubernetes Cluster Role Binding | SG-GCP Kubernetes Cluster Role Binding \[sn\_gcp\_integ\_sg\_gcp\_kubernetes\_cluster\_role\_binding\] | Kubernetes Cluster Role BindingKey Value SG-GCP Extension Attributes | ClusterRoleBinding |
| SG-GCP Kubernetes Node Pool | SG-GCP Kubernetes Node Pool \[sn\_gcp\_integ\_sg\_gcp\_kubernetes\_node\_pool\] | Kubernetes Node PoolKey Value SG-GCP Extension Attributes | NodePool |
| SG-GCP Generic Resource | SG-GCP Generic Resource [sn_gcp_integ_sg_gcp_generic_resource]Note: The SG-GCP Generic Resource data source only works with a service account that has organization-level access. | Cloud Resource | Resource |
| SG-GCP Annotation | SG-GCP Annotation \[sn\_gcp\_integ\_sg\_gcp\_annotation\] | Key Value | Annotation |
| SG-GCP Get Patch Job | SG-GCP Get Patch Job \[sn\_gcp\_integ\_sg\_gcp\_get\_patch\_job\] | Not applicable | Not applicable |
| SG-GCP Generic Resource Annotation | SG-GCP Generic Resource Annotation \[sn\_gcp\_integ\_sg\_gcp\_generic\_resource\_annotation\] | Key Value | Annotation |
For more information on where data is saved when pulling data from a GCP project, see CMDB classes targeted in Service Graph Connector for GCP.
You can use the IntegrationHub ETL app to view the data maps. See IntegrationHub ETL for more information.
Additional information about GCP data sources:
- The SG-GCP Annotation data source populates all labels and tags associated with GCP supported resources to the Key Value table.
- The SG-GCP Generic Resource Annotation data source populates the tags and labels for Generic resources to the Key Value table from Service Graph Connector for GCP version 1.10.0.
- The basic information about a GCP resource is stored in the SG-GCP Extension Attributes [sn_gcp_integ_extension_attributes] table.
- After all the data sources are executed, the Server [cmdb_ci_server] class is updated with the class entry, and then based on the Windows or Linux class, the records are created in the Windows Server [cmdb_ci_win_server] and Linux Server [cmdb_ci_linux_server] classes, respectively.
The SG-GCP Generic Resource data source imports data for resources that are categorized as
Genericin the Service Graph Resource Inclusion Whitelist [sn_cmdb_int_util_service_graph_resource_inclusion_whitelist] table.For any discovered resources that are deleted after pulling data, the Service Graph Connector for GCP automatically updates the Install Status field of the associated CMDB CI classes to indicate any retired or deleted records. For more information, see Life cycle management of records in Service Graph Connector for GCP and Record removal process in Service Graph Connector for GCP.
- When the sn_itom_pattern.use a single hardware type for cloud data centers system property is set to
true, hardware type data is added to the Cloud Hardware Type [cmdb_ci_cloud_hardware_type] table, instead of being added to the Hardware Type [cmdb_ci_compute_template] table from Service Graph Connector for GCP version 1.9.0. For more information, see the Service Graph Connector For GCP - Migrating to a new hardware type model [KB1899584] article in the Now Support Knowledge Base. - When the sn_cmdb_ci_class.use_single_cloud_os_image system property is set to
true, image type data is added to the Cloud Image [cmdb_ci_cloud_os_image] table, instead of being added to the Image [cmdb_ci_os_template] table from Service Graph Connector for GCP version 1.9.0. For more information, see the Service Graph Connector For GCP - Migrating to a new Cloud OS Image model [KB1983751] article in the Now Support Knowledge Base. - The list API calls return only the information that is required to make batch calls and not the entire resource response from Service Graph Connector for GCP version 1.9.0.
- Parallel data loading is enabled for the SG-GCP Annotation, SG-GCP Generic Resource,and SG-GCP Generic Resource Annotation data sources.
- You can configure the AppScript Folder IDs connection property to exclude AppScript folder information from imports starting from Service Graph Connector for GCP version 1.10.0. For more information, see Service Graph Connector for GCP properties.
- The SG-GCP Software Inventory scheduled import runs before the SG-GCP VM Instance scheduled import from Service Graph Connector for GCP version 1.10.0. The SG-GCP Software Inventory scheduled job populates the operating system information for the Server records, which determines the script that needs to be run for deep discovery (Shell script for Linux VMs or PowerShell script for Windows VMs).
- The SG-GCP Get Patch Job scheduled import supports deep discovery by running commands on VMs from Service Graph Connector for GCP version 1.10.0. For information about deep discovery for the Service Graph Connector for GCP, see the Enabling deep discovery for Service Graph Connector for GCP article in the Now Support Knowledge Base.