Importing data from big query

[ScriptStoryDude]

We have a problem to build and import the data from GCP bigquery. It need to be automated. I will appreciate the approach and if possible some sample code (written in python etc) to get the data from bigquery into anaplan datahub

[JaredDolich · Accepted solution]

@ScriptStoryDude 

The absolute best article written for data integration with Python is this one from @chase.hippen. He provides the python code for both basic authentication and also for CA Certificates so you'll be covered. Size of the data is not an issue. He covers how to chunk the file too.

https://community.anaplan.com/t5/Best-Practices/Using-Python-3-with-the-Anaplan-API/ta-p/33150

If you need a specific example that's not covered in this article, reply back here, we'll get you what you need.

[jwakefield]

If you want it automated and business owned then you should be looking at Anaplan hyperconnect or onecloud.io https://support.onecloud.io/support/solutions/articles/48000985250-google-bigquery-bizapp

Otherwise you could look at accessing bigquery via jdbc using something like simba https://cloud.google.com/bigquery/providers/simba-drivers and then using Anaplan connect to automate.

Python would be adding a layer of complexity typically not needed for pure data integration.

[guillaume_arnau]

Speaking of JDBC connector, please check here if you still need:

https://community.anaplan.com/t5/Best-Practices/Easily-Integrate-Data-From-Google-BigQuery-With-Anap...