2008/11/6 Colin Paul Adams <colin@xxxxxxxxxxxxxxxxxx>:
>>>>>> "Andrew" == Andrew Welch <andrew.j.welch@xxxxxxxxx> writes:
>
> >> You've lost me - we were talking about integer division, I
> >> thought.
>
> Andrew> 1000000000000000000000000000000001 is just too big for an
> Andrew> 32 bit integer... (I think that's why DC chose it)
>
> There is nothing that says you have to use a 32-bit integer.
No but I think that's the reason for the Saxon result of 10, 9, 10
(the reason DC chose that number)
> >> If you are talking about xs:double, compared with xs:decimal,
> >> then yes. But I don't see how that comes into the problem.
>
> Andrew> I think it's the problem of representing a decimal:
>
> Andrew> http://speleotrove.com/decimal/decifaq1.html#inexact
>
> That's talking about representing decimals in floating-point binary -
> but you can't do that for xs:decimal -it's not allowed.
oh ok, as a CS graduate I should know the different between double,
floating point and decimal... that lecture must have been on a Friday
afternoon.
--
Andrew Welch
http://andrewjwelch.com
Kernow: http://kernowforsaxon.sf.net/
|