[Date Prev][Date Next][Thread Prev][Thread Next][Date index][Thread index]
Re:st: Display of data in the Data Editor
Thanks Svend Juul and Allan Reese for your helpful
Date: Wed, 9 Aug 2006 12:34:05 +0100
From: "Allan Reese \(Cefas\)"
Subject: st: Display of data in the Data Editor
Ngoc Anh asked why 6945.3 is displayed like
Svend Juul explains, correctly, that computers work
and the number 6945.3 has no exact binary
The display in the data editor is controlled by the
format for the
number, which Ngoc Anh can change. However, I
recently fell foul of the
finite precision problem by creating new cases by
the new cases looked to have the same value, they
from the old ones.
The command "replace x=x[_n-1] in 11/20"
would have copied the value keeping the same random
bits at the end.
Setting the format as %20.19 showed why the values as
Do You Yahoo!?
Tired of spam? Yahoo! Mail has the best spam protection around
* For searches and help try: