Cloudworks - Data too Large

Hi all - has anyone ever ran into the situation where the dataset being brought in by Cloud Works is too big? Is there an error message that shows this? I'm suspecting this is the case for me. This is specifically for BQ -> Anaplan. I ran three processes, and the third one triggered was the first one done. The others have completed but no new data has been added. I checked history and there are no logs of changes.

Accepted answers

All comments

Misbah

@kjohnson

If the file is more than 1 GB then yes it might have failed to load due to that. But if it is less than that then there may be other issues that you may want to look at.

We ran into issues where the actions were getting run but the load was not happening and we found out that it was an access issue from aws end.

Misbah
Miz Logix

kjohnson

Thanks, Misbah. This pipeline has ran before, so I doubt it's access. I think we're trying to pull more than the max allowed.

Misbah

@kjohnson

Any idea what size the load is?

kjohnson

@Misbah I'm not quite sure. I don't have access to the client's BigQuery instance. I can say with certainty that this is the issue. We chunked the data up to smaller pieces and it ran. I'd love if Anaplan could fix the messaging on this to notify users when this data is too large from BigQuery side.

Misbah

@kjohnson

That would be a great idea!

Please post that on idea exchange forum.

Misbah

MIZ LOGIX

Quick Links

Can you help?

Unanswered questions

Batch Script
Hello team, I am logging into Anaplan through SSO. I would like to create a batch script to import a file into Anaplan. For the Spoke model, I would like to run an process via a batch script to import data from the Data Hub. Can anyone provide me script for both the condition.
import monthly data with months in columns
is there a way to import data with months in columns (usual excel table view)? I have to transform the data so there are rows to cover each period in the upload data form, but I am wondering if there is a better way to just import the data as is with the months in the columns. please let me know what you think. thank you,
Cloudworks Big Query Integration Fail
Hello, I am receiving an 'Anaplan Upload Failed' Status Description when testing my integration with a Big Query dataset. The integration imports data from BQ to our Anaplan model. No other details given in the error log. I suspect that Cloudworks is not even picking up the file but am not sure what we did wrong on the set…