[Date Prev][Date Next][Thread Prev][Thread Next][Date index][Thread index]
Re: st: Precision
Hi Many thanks Maarten, Tom, Sergio, Nick, and Micheal for your responses.
Turns out it was all in the eyes..or as Nick pointed out
(paraphrasing)...what I saw or what I thought I saw.
Inputting the data as string, destring-ing, and specifying the correct
format %20.10f (the magic wand..thanks Tom and Micheal for pointing this
out) is what I needed.
Inputting as double (Sergio) and again formating %20.10f does the same
Nick, thanks for the tutorial on precision (what exists) vs illusion
(what I saw).
To close this thread
- if you have raw data with many decimals then input as double and
- otherwise, destring and format correctly
* For searches and help try: