Hi
Need a help. We are uploading the datafile into a General List. The code is supposed to be having unique values. But due to user error, we end up having duplicate values in the code column, causing issues in downstream process.
Is there anyway, we can do a check for duplicates during data file upload? If not, can you suggest some alternative solution?
Thanks
Regards
Prabakaran
hi @praba71 ,
you can use isfirstoccurence to find unique code as then make a filtered view and then load in the related downstream models which contain the list as a dimension
thanks @Kanishq17 , as @anirudh mentioned, I used the ISFIRSTOCCURRENCE to find out the duplicates on the particular column. This column may be blank also, inthat case ISFIRSTOCCURRENCE flags them as duplicate which may not be an ideal solution, is there any way, ISFIRSTOCCURRENCE considers only when there is data in the column and do the check for duplicates?
Please see the attached screenshot. Opsdb config is the column where we are checking for the duplicates.
Thanks
Regards
Prabakaran