On Dec 30, 2008, at 2:43 AM, Jan-Erik Soderholm wrote:

>> but the HI-TECH library is
>> only accurate to about three decimal places.
>
> For what a PIC is usualy used for, that might very well
> be enough. It's a precision vs. performance trade-off.

That sounds about right.  HI-TECH defaults to 24bit floats for both  
"float" and "double", which is only 16 bits of mantissa, which sounds  
like not much more than 3 digits.  You can get 32bit doubles with the  
"--double=32" switch, but that'll still be less precision than most  
calculators.

BillW


-- 
http://www.piclist.com PIC/SX FAQ & list archive
View/change your membership options at
http://mailman.mit.edu/mailman/listinfo/piclist