Delta load to Anaplan with informatica cloud(hyper connect)

Is there a provision to load only the change or new data instead of importing the full file to an Anaplan module in using Anaplan/Informatica Hyperconnect?

Accepted answers

All comments

JaredDolich

@Shawnm

Here's an idea you might try.

Add a line item to your transaction module that contains the last update date and time.
In your system module for the transaction keys, calculate the most recent date/time and compare it to each key's date/time
For me, I set the age to 2 minutes (120 seconds). That sets a Boolean to TRUE.
Run a Delete action on the transaction list using the Boolean from above.

Here's the blueprint of my system module. Old Transaction? is set to 120 seconds. You can parameterize this or hard code it like I did.

rob_marshall

@Shawnm @JaredDolich

Better yet, take a look at this OnDemand course.

https://community.anaplan.com/t5/On-Demand-Courses/Delta-Data-Loads/ta-p/81536

Rob

Shawnm

@rob_marshall @JaredDolich Thank you for your reply, Is there a way to do this through Informatica Cloud?

rob_marshall

@Shawnm

The easiest way to get through this is to get the correct data from the source, so fix the SQL statement in that it is only giving you the delta records. Now, I am not sure what the source system is, but many ERPs have or should have a "last modified date" field where you can use that in the WHERE clause.

As for Informatica Cloud, I am not an expert, but I would think this would be hard to accomplish as Informatica would have to know (store) the data that was last uploaded and then do a compare and I am not sure Informatica has a storage area. Again, I am not an Informatica expert, so this very well may be accomplished via Informatica.

If Informatica can't do accomplish this, follow the methods in the video.

Rob

Quick Links

Can you help?

Unanswered questions

Update columns in a source
Hi, i have a source that uses a connection to Skutrak, and i selected 3 columns when i created the source, now i want to bring in a 4th column, do i have to recreate a source from scratch and then use that in a new transformation view and do all the work i did again, or can i update the source column selection, and add the…
Is it not possible to have the same link in 2 dataspaces
We have 2 dataspaces (Training and Current), the training one had a link to a list in a Model. When i tried to add a link to the same list in the Current dataspace, the link showed as ticked and i could not select it. Does this mean you cannot link to the same source in 2 different dataspaces? It shows a tick in the LINK…
A reminder of Bulk Copy - Current year to Prior year version for YoY analysis
A quick reminder of the Bulk Copy functionality. Bulk Copy allows you copy large volumes of data from one slice of a model to another in a single, optimised operation, instead of using formulas or imports. Use case: copy a version (RF1) into a prior year version (PY RF1) using a versions list to allow for year-on-year…