Data load for duplicate rows

usha.cherukuri

Hi All,

 

I was trying to load data into a module, but my data file has duplicate rows.

when I load the file, I was expecting the duplicate rows to be ignored or flagged as duplicate record value but it getting added in the member value.

 

Example:

         Dimension   Line item(amount)

row1 ABC             10

row2 DEF              20

row3 ABC              30

row4 DEF               40

 

When I load the above file, my values for ABC becomes 40(10+30) and DEF becomes 60(20+40)

 

Is this is the way anaplan will load a data file or is there any way I can eliminate the duplicate rows.

 

Regards,

Usha

VIGNESH.M

Hi Usha,

 

Try this,

 

Load the file into the one Staging module and use first occurrence to find the first valid record and load it from the saved view to the target module.

 

Regards,

Vignesh M

kavinkumar

@usha.cherukuri,

Simple!!!

Get the data as 'Text' and then convert that to 'Number'. So in this way, only the first occurrence will be loaded and the other will be ignored. I hope this helps!

Regards,
Kavin.

nathan_rudman

that's a clever one 🙂

usha.cherukuri

Hi Kavin,

sorry but I didn't actually got this, say I have loaded the data in as a text line item and convert that to number format in second line item.

still I may require the firstoccurance filter view to ignore the duplicate line right? as suggested by @vignesh above.

Thanks ,
Usha

usha.cherukuri

Hi Vignesh,

Thanks for you quick response.

but only one Q I have here , If we have 5-6 module for data load.
then i end up in making 5-6 staging tables for each module right?


Thanks
Usha

VIGNESH.M

Hi Usha,

 

You don't need the FIRST OCCURENCE to applies kavin's solution. when we load data into the text format line item, the system will take the first unique record only and ignore the duplicate records., So You don't need the FIRST OCCURENCE.

 

To implement my solution, Yes, you need staging modules.

Let say you have 3 data loading modules, then you need 3 staging modules.

 

 

Regards,

Vignesh M

 

 

 

usha.cherukuri

Thank you Vignesh..