Topic: Division Precision

[ronjonp]

Why is this rounding the answer down instead of putting the correct decimal place?

Code: [Select]

  (setq ss1 (ssget '((0 . "LWPOLYLINE") (8 . "0280-shrub-lateral"))))
  (setq ss1 (sslength ss1))
  (alert (rtos(/ ss1 30)2 2))
For example sslength of ss1 = 88. The number returned after being divided by 30 is 2.00 rather than 2.93?

Thanks,

Ron

[T.Willey]

If you divide by an intergers, then the returned value will be an interger, so changing one of the numbers to a real will return a real.
Change

Code: [Select]

(/ ss1 30)
to

Code: [Select]

(/ ss1 30.0)
And you should get what you want.

[ronjonp]

Thanks . It's all those little things that kill me! :realmad:

[T.Willey]

Thanks . It's all those little things that kill me! :realmad:

You're welcome.  I hate learning those the hard way also.