Importing data from big query

We have a problem to build and import the data from GCP bigquery. It need to be automated. I will appreciate the approach and if possible some sample code (written in python etc) to get the data from bigquery into anaplan datahub

Accepted answers

JaredDolich

@AvnishGoel

The absolute best article written for data integration with Python is this one from @chase.hippen. He provides the python code for both basic authentication and also for CA Certificates so you'll be covered. Size of the data is not an issue. He covers how to chunk the file too.

https://community.anaplan.com/t5/Best-Practices/Using-Python-3-with-the-Anaplan-API/ta-p/33150

If you need a specific example that's not covered in this article, reply back here, we'll get you what you need.

All comments

JaredDolich

@AvnishGoel

https://community.anaplan.com/t5/Best-Practices/Using-Python-3-with-the-Anaplan-API/ta-p/33150

If you need a specific example that's not covered in this article, reply back here, we'll get you what you need.

jwakefield

If you want it automated and business owned then you should be looking at Anaplan hyperconnect or onecloud.io https://support.onecloud.io/support/solutions/articles/48000985250-google-bigquery-bizapp

Otherwise you could look at accessing bigquery via jdbc using something like simba https://cloud.google.com/bigquery/providers/simba-drivers and then using Anaplan connect to automate.

Python would be adding a layer of complexity typically not needed for pure data integration.

guillaume_arnau

Speaking of JDBC connector, please check here if you still need:

https://community.anaplan.com/t5/Best-Practices/Easily-Integrate-Data-From-Google-BigQuery-With-Anaplan-Connect/ta-p/84626

Quick Links

Can you help?

Unanswered questions

Add list members to a selective access list
Hi, I am working on a solution where the User should only have access to write/edit the list members that they add from an Action on the frontend. This action adds another list member to a selective access list. The problem is, in order to run the action, you need access to the entire list, so you would see all list…
Dimensionality Issue
Hi ALL, In my model, I have Need stored at a 'D3' RS Group level. I need to use this Need in another module at the G5 Location level. I currently have a mapping module where each G5 Location maps to a D3 RS Group. This Module uses D2 Role as dimension. but the line item I've to find the RS Group (Find D3 RS Group = 'FIND…
Formula to return Connection details...
I couldn't find any formula to do this, but I want a way to put on the page/grid the connection details. This is so I know what connection I'm in rather than going into Connections details to see it. Is there an XL3 formula to return this value?