Celonis and BigQuery Integration
Celonis : Process Mining Tool, to improve the Business Process by analyzing the data.
Celonis Execution Management system
With the process mining tool, you get good visibility to your business processes, Quantify the process impact, make data driven suggestions, fact based, Prioritize the processes which needs improvement, get the value quickly.
Celonis Integrates with various ERP systems and data warehouse applications.
Today we will see how to integrate Celonis with BigQuery application.
BigQuery is a Google product, Highly scalable serverless data warehouse.
JDBC connection method is used for this integration
Backend/Extraction server configuration steps
First step is to download the latest JDBC Extractor package from Celonis cloud help download location
Download Windows and Linux Extractor package, Place it in Extractor server and extract the package.
Install google-bigquery.jar file using below command line
java -Dloader.path=google-bigquery.jar -Dspring.config.location=application-local.yml -jar connector-jdbc.jar
Get JSON file to access big query using service account, a key file for system to system connection.
Place the JSON file in the same place as the extraction server location.
Celonis Front End configuration
Create new Uplink Integrations in Team settings
Click Connect New system, provide uplink integration name, Click Connector in Type of remote system, hit save.
Collect Client ID and Client Secret to use in Extractor server.
Update client id and client secret in application.yaml file
Create new data Pool or use existing data pool
Create New data connection, select Google Bigquery,
Provide name of the connection, connection type — uplinked(radio button), Select the uplink connection which was created before.
Config type — Custom JDBC Connection string and provide the below connection string.
jdbc:bigquery://https://www.googleapis.com/bigquery/v2:443;ProjectId=<GCP PROJECT ID>;OAuthType=0;OAuthServiceAcctEmail=<SA ACCOUNT EMAIL ID>;OAuthPvtKeyPath=<SA JSON FILE LOCATION FROM EXTRACTOR SERVER>;Timeout=3600;
Replace project id, OAuthService account email, Auth private key path(JSON file) as per your configuration.
Leave the driver class as is.
Test the connection, once successful, good to go for data extraction.
References : Celonis.com
