List Item Limit Reached

Hi everyone. Sorry to drag this topic back up to the top but I encountered a rather strange issue today.

My standard list hit 1B list item record limit even though there's only 12 million list items. So I checked all my standard lists and saw that the record limit is growing on all of them after each import. Did I completely miss this as a limitation of standard lists or is this something that has changed? Maybe part of the HyperModel changes? I was able to reset the list back to 1 but I thought that was only for numbered lists. Doesn't seem like a sustainable process. This list unfortunately changes every week (uses 30 minute increments - so 48 time intervals per day)

Should I fill out a support ticket?

@Misbah @usman.zia @nathan_rudman @LipChean_Soh @DavidSmith @rob_marshall @einas.ibrahim

Accepted answers

jasonblinn

@JaredDolich

The 999,999,999 limit exists on all lists, and to my knowledge it always has. (Numbered or standard)

You have probably already thought about this, but is your list getting cleared and re-importing each time, or is it only updating the applicable data? If it is clearing and then rebuilding it then it might be worth exploring options to only update changes as that would help with this issue and probably greatly speed up any integrations.

If it is already set up where it is only updating changes then it sounds like you are up against a limitation and as part of a monthly process you might have to the admin reset the index.

I am not 100% about the Hyper models, but I am pretty sure that the answer is that this limitation still exists.

Jason

rob_marshall

@JaredDolich

Listen to @jasonblinn , he has been taught well. That 1 billion -1 limit is on all lists, not just numbered lists. As Jason stated, the first question I would as is why are you wiping out the list and rebuilding it. Is there a way to only load delta records from the source? What does the member/code look like? Does it have time in it? Is there a way to load the data dimensionally to cut down the size of the list?

If you want to get on a call, ping me and we can set one up.

Rob

All comments

jasonblinn

@JaredDolich

The 999,999,999 limit exists on all lists, and to my knowledge it always has. (Numbered or standard)

If it is already set up where it is only updating changes then it sounds like you are up against a limitation and as part of a monthly process you might have to the admin reset the index.

I am not 100% about the Hyper models, but I am pretty sure that the answer is that this limitation still exists.

Jason

rob_marshall

@JaredDolich

If you want to get on a call, ping me and we can set one up.

Rob

JaredDolich

@jasonblinn and @rob_marshall thank you.

I always thought standard lists reset as you load new list items. Good to know.

It is true that this is being wiped and rebuilt but it's a function of the process - since we don't have a time dimension below day the UID requires a concatentation of this time interval and since it is a rolling 7 months snapped to the beginning and ending of the months, for 500 members (which are regularly changing too) it's a constant build and drop. I suppose with some creativity, I can slow it down by dropping a month and adding a month but it will inevitably reach that 1B limit again.

Thanks @rob_marshall I may take you up on that chat. I'm sure there's a better way!

Quick Links

Can you help?

Unanswered questions

Batch Script
Hello team, I am logging into Anaplan through SSO. I would like to create a batch script to import a file into Anaplan. For the Spoke model, I would like to run an process via a batch script to import data from the Data Hub. Can anyone provide me script for both the condition.
import monthly data with months in columns
is there a way to import data with months in columns (usual excel table view)? I have to transform the data so there are rows to cover each period in the upload data form, but I am wondering if there is a better way to just import the data as is with the months in the columns. please let me know what you think. thank you,
Cloudworks Big Query Integration Fail
Hello, I am receiving an 'Anaplan Upload Failed' Status Description when testing my integration with a Big Query dataset. The integration imports data from BQ to our Anaplan model. No other details given in the error log. I suspect that Cloudworks is not even picking up the file but am not sure what we did wrong on the set…