« previous next »
Pages: [1] |   Go Down

Author Topic: Crazy precision issue  (Read 1678 times)

0 Members and 1 Guest are viewing this topic.

TimSpangler

  • Water Moccasin
  • Posts: 2010
  • CAD Naked!!
Crazy precision issue
« on: September 26, 2006, 12:59:18 PM »
If i type (/ 116 7) athe the command line I get 7

If I divide 116 by 15 on my calculator I get 7.733333

am I missing something?
Logged
ACA 2015 - Windows 7 Pro
All Comments and Content by TimSpangler, Copyright © 2016

Chuck Gabriel

  • Guest
Re: Crazy precision issue
« Reply #1 on: September 26, 2006, 01:06:37 PM »
You need to express at least one of the arguments as a decimal number if you want a decimal result.

(/ 116.0 7)
Logged

TimSpangler

  • Water Moccasin
  • Posts: 2010
  • CAD Naked!!
Re: Crazy precision issue
« Reply #2 on: September 26, 2006, 01:15:58 PM »
Thanks Chuck,

That seems weird to me, but it is what it is.

Thanks again
Logged
ACA 2015 - Windows 7 Pro
All Comments and Content by TimSpangler, Copyright © 2016

Jeff_M

  • King Gator
  • Posts: 4096
  • C3D user & customizer
Re: Crazy precision issue
« Reply #3 on: September 26, 2006, 01:17:23 PM »
Yep, the old "divide 2 integers, get an integer" rule.
Logged
Pages: [1] |   Go Up
« previous next »