Importing data from big query

We have a problem to build and import the data from GCP bigquery. It need to be automated. I will appreciate the approach and if possible some sample code (written in python etc) to get the data from bigquery into anaplan datahub

Accepted answers

JaredDolich

@AvnishGoel

The absolute best article written for data integration with Python is this one from @chase.hippen. He provides the python code for both basic authentication and also for CA Certificates so you'll be covered. Size of the data is not an issue. He covers how to chunk the file too.

https://community.anaplan.com/t5/Best-Practices/Using-Python-3-with-the-Anaplan-API/ta-p/33150

If you need a specific example that's not covered in this article, reply back here, we'll get you what you need.

All comments

JaredDolich

@AvnishGoel

https://community.anaplan.com/t5/Best-Practices/Using-Python-3-with-the-Anaplan-API/ta-p/33150

If you need a specific example that's not covered in this article, reply back here, we'll get you what you need.

jwakefield

If you want it automated and business owned then you should be looking at Anaplan hyperconnect or onecloud.io https://support.onecloud.io/support/solutions/articles/48000985250-google-bigquery-bizapp

Otherwise you could look at accessing bigquery via jdbc using something like simba https://cloud.google.com/bigquery/providers/simba-drivers and then using Anaplan connect to automate.

Python would be adding a layer of complexity typically not needed for pure data integration.

guillaume_arnau

Speaking of JDBC connector, please check here if you still need:

https://community.anaplan.com/t5/Best-Practices/Easily-Integrate-Data-From-Google-BigQuery-With-Anaplan-Connect/ta-p/84626

Quick Links

Can you help?

Unanswered questions

How have you from-scratch built lot-level, geo-based Inventory Consumption?
We’re working on modeling inventory consumption at the lot level, accounting for shelf life considerations, since we need visibility into which lots may not consume—both for risk reporting and E&O analysis. Each item may have customers with different shelf life requirements. For example, item A may need 270 days for some…
How to bring Row data into Columns?
Hi, Can you help me, how can we get row data into columns using Unique ID? Per attached below first snapshot, I want to bring rountingOrder 4, RecipientName, Sent and Completed dates in 1 row as show in sanpshot 2. Do I need to create Hierarchy list and Map?
How to Design Simulation Planning in Anaplan with Multi-Level User Input and Step-by-Step Logging?
Hi Anaplan Community, I'm working on a simulation planning model where users need the flexibility to input pricing adjustments at any level of the product hierarchy, and I’d love your guidance on best practices. 📌 Scenario Overview: We have a 4-level product hierarchy: Brand Category Sub Category SKU (lowest level) The…