decimal places more than 15 do not total right:

elaine.novel
edited February 2023 in Modeling

Dear Team, 

 

I would like to seek for your enlightenment on this area. I tried to copied several times an amount (percentage in real number format) with a decimal places of 19-20. it copied correctly in anaplan and i selected the number format of significal number to 15 places. However, it does not total correctly. it would total  0.99999999999999900000 . So what I did is to export it to excel and compare. My comparison would show differences in 19th or 20th decimal places but i compared the figure, they are exactly the same. the LEN of both are the same: 20. The result of comparing the two is TRUE across. Please see screenshot for your reference. 

 

Hoping for your enlightenment on this.

 

Should you prefer to do it in anaplan, these are the breakdown of the numbers:

    0.000151169934355968000      0.000151169934355968000    0.000151169934355968000    0.000151169934355968000    0.000151169934355968000    0.000151169934355968000    0.000151169934355968000    0.000151169934355968000    0.000151169934355968000    0.000151169934355968000    0.000151169934355968000    0.000151169934355968000    0.000151169934355968000    0.000151169934355968000    0.000151169934355968000    0.000151169934355968000    0.000151169934355968000    0.001479197807673140000    0.001479197807673140000    0.001479197807673140000    0.001479197807673140000    0.001479197807673140000    0.001479197807673140000    0.001479197807673140000    0.001479197807673140000    0.001479197807673140000    0.001479197807673140000    0.001479197807673140000    0.001479197807673140000    0.001479197807673140000    0.001479197807673140000    0.001479197807673140000    0.001479197807673140000    0.001479197807673140000    0.001479197807673140000    0.001731731161170940000    0.003416144143810420000    0.003416144143810420000    0.003416144143810420000    0.003416144143810420000    0.003416144143810420000    0.003416144143810420000    0.003416144143810420000    0.003416144143810420000    0.003416144143810420000    0.003416144143810420000    0.003416144143810420000    0.003416144143810420000    0.028347710204074500000    0.028347710204074500000    0.028347710204074500000    0.028347710204074500000    0.028347710204074500000    0.036188032765282300000    0.033112371714541600000    0.031574541189171200000    0.031574541189171200000    0.031574541189171200000    0.031574541189171200000    0.031574541189171200000    0.068877233700210600000    0.041857551369453200000    0.028347710204074500000    0.028347710204074500000    0.028347710204074500000    0.028347710204074500000    0.028347710204074500000    0.028347710204074500000    0.028347710204074500000    0.028347710204074500000    0.028347710204074500000    0.028347710204074500000    0.031574541189171200000    0.031574541189171200000    0.031574541189171200000    0.031574541189171200000    0.006773364368892000000    0.004554858858413880000    0.004554858858413880000    0.004554858858413880000    0.004554858858413880000    0.004554858858413880000    0.004554858858413880000    0.004554858858413880000

 

 

Thanks again, 

Elaine

 

Answers