Re: precision Issues?

From: Don Dietrick <dietrick@bbn.com>
Date: Fri Apr 12 2002 - 08:44:59 EDT

Hi Jeff,

I think it's a rounding error from going back and forth between
lat/lons, pixels, and back to lat/lons. Since pixels are actually a
specific size in lat/lon space, the precision is not absolute when you
go back and forth.

- Don

On Thursday, April 11, 2002, at 10:47 PM, Jeff Kirby wrote:

> Hi again :-)
>
> I give openmap a center co-ord (lat and lon ) and a scale ( got via
> ProjMath ) and the center i get back is not the same... is out a
> little...
>
> using proj.getUpperLeft() and proj.getLowerRight() methods.. this is my
> situation
>
> ask for centre -157.23015 lon 21.38713 lat
> and get centre -157.23013 lon 21.387129 lat
>
> obviously different requests gather different levels of errors... im
> wondering whats causing this. My math is all Float, and seems good to
> me ... perhaps its what OM depends on in calculating its bits? or a
> deg-rad problem?...
>
> Jeff
>
>
>
>
>
>
> --
> Jeff Kirby, jeff@consunet.com.au on 12/04/2002
>
> --
> [To unsubscribe to this list send an email to "majdart@bbn.com"
> with the following text in the BODY of the message "unsubscribe
> openmap-users"]
>
>

=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Don Dietrick, BBN Technologies, dietrick@bbn.com
10 Moulton Street, Cambridge, MA 02138
617-873-3031 [fax]-2794
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=

--
[To unsubscribe to this list send an email to "majdart@bbn.com"
with the following text in the BODY of the message "unsubscribe openmap-users"]
Received on Fri Apr 12 08:44:19 2002

This archive was generated by hypermail 2.1.8 : Thu May 12 2005 - 07:18:32 EDT