Importing data from big query

We have a problem to build and import the data from GCP bigquery. It need to be automated. I will appreciate the approach and if possible some sample code (written in python etc) to get the data from bigquery into anaplan datahub

Accepted answers

JaredDolich

@AvnishGoel

The absolute best article written for data integration with Python is this one from @chase.hippen. He provides the python code for both basic authentication and also for CA Certificates so you'll be covered. Size of the data is not an issue. He covers how to chunk the file too.

https://community.anaplan.com/t5/Best-Practices/Using-Python-3-with-the-Anaplan-API/ta-p/33150

If you need a specific example that's not covered in this article, reply back here, we'll get you what you need.

All comments

JaredDolich

@AvnishGoel

https://community.anaplan.com/t5/Best-Practices/Using-Python-3-with-the-Anaplan-API/ta-p/33150

If you need a specific example that's not covered in this article, reply back here, we'll get you what you need.

jwakefield

If you want it automated and business owned then you should be looking at Anaplan hyperconnect or onecloud.io https://support.onecloud.io/support/solutions/articles/48000985250-google-bigquery-bizapp

Otherwise you could look at accessing bigquery via jdbc using something like simba https://cloud.google.com/bigquery/providers/simba-drivers and then using Anaplan connect to automate.

Python would be adding a layer of complexity typically not needed for pure data integration.

guillaume_arnau

Speaking of JDBC connector, please check here if you still need:

https://community.anaplan.com/t5/Best-Practices/Easily-Integrate-Data-From-Google-BigQuery-With-Anaplan-Connect/ta-p/84626

Quick Links

Can you help?

Unanswered questions

403 error trying to access Support Portal
Hi - can't access support portal having already registered. Receive the following error message - is this an issue with Anaplan or our internal IT?
Hi Team , I am unable to login to the Anaplan portal using my credential.
Can someone help me i am unable to login anaplan portal using my credentials
Finding History for List Item Creation and changes
Dear Hive Mind, Do we have a way to get the history of a particular List Item, from its creation into a model up until its removal ? I am trying to chase when / how an item has been added into a model and how / when it would have been deleted and then recreated with the same code. Is there a pattern (manual or API) to get…