I’m a cartography fan and Wikipedia’s geographic coordinates add another level of utility to articles. Many of the latitude /longitude notations use six decimals of precision though which seemed like overkill. When I recently added a {{coord}} template to an article, I calculated how much distance each digit represents using imperial units (those familiar with metric units can look here). Briefly, each tick of the sixth place changes position by about 8.5 cm or 4-⅜ inches (for latitude; longitude changes are even smaller and vary with the cosine of latitude). Consumer GPS will only be accurate to about four decimals (or maybe five with WAAS).

The detailed calculation starts with the nautical mile to relate lat/lon coordinates to everyday distances. HowStuffWorks.com explains

“The length of a nautical mile is based on the circumference of the planet Earth. If you were to cut the Earth in half at the equator, you could pick up one of the halves and look at the equator as a circle. Then divide that circle, or arc, into 360 degrees and divide each degree into 60 minutes. A minute of arc on the planet Earth is 1 nautical mile. This unit of measurement is used by all nations for air and sea travel.”

Most of us don’t normally use nautical miles to pilot ships or airplanes and instead rely on smaller units like kilometers and miles. For the conversion examples below, I’ll use the coordinates of the entrance to the USGS’ office in Menlo Park :

37° 27′ 22.86″ N, 122° 10′ 15.6714″ W

37.456350 , -122.17102

The notation *degrees***°** *minutes***′** *seconds***″** converts to decimal notation as shown here and then we can calculate typical distances corresponding with each position in the notation:

37 + 27/60 + 22.86/3600 = 37.456350 37° 27' 22.86" | | | | | | | +- 1/100 of an arcsecond = 1.0127 feet | | +---- One arcsecond = 1 nautical mile / 60 = 101.27 feet | +------------ One arcminute = 1 nautical mile = 1.15077945 statute miles +----------------- One (arc) degree = 60 nautical miles = 69 statute miles

In the decimal notation for this latitude, each position corresponds to the following north/south travel distances:

37.456350 | |||||| | |||||+- 0.00006 naut mi. = 0.3646 feet= 4.3748 or 4-3/8 inches=11.112 cm | ||||+-- 0.0006 naut. mi. = 3.646 feet = 1.1112 m | |||+--- 0.006 nautical mi= 36.46 feet = 11.112 m | ||+---- 0.06 nautical mi.= 364.6 feet = 111.12 m | |+----- 0.6 nautical mi. = 0.69 statute miles= 1.1112 km | +------ 6 nautical miles = 6.9 statute miles = 11.112 km +------- 60 nautical miles = 69 statute miles = 111.12 km

(For reference, 1 nautical mile is defined as exactly 1.852 km and is about equal to 1.1508 statute miles.)

Traveling one arcdegree of latitude north/south (by moving along a longitude line) represents the same distance anywhere on earth.

Traveling one arcdegree of longitude east/west (by moving along a latitude line), however, represents different distances depending on the cosine of the latitude’s degrees (north or south). At higher latitudes, traveling one arcdegree east/west covers a smaller distance because circles of latitude are smaller at higher latitudes.

For example, in Caracas at *10 degrees* north latitude, traveling one arcdegree along that latitude line represents east/west travel of:

1 arcdegree = 1 naut. mi. *cos(10 deg)= 0.985 nautical miles = 1.333 statute miles

but at *37.45635 degrees* north, 1 arcdegree of east/west travel represents just:

1 arcdegree = 1 naut mi. *cos(37.45635 deg)= 0.7938 nautical miles = 0.9135 statute miles

These calculations are close to correct, however, the Earth is not quite a perfect sphere and so professional geodetic measurements use a mathematical model of those imperfections called a datum. For more conversions, and pointers to the nuances introduced by geodetic systems, see http://transition.fcc.gov/mb/audio/bickel/DDDMMSS-decimal.html .

Without access to professional surveying equipment and geodetic correction software, five decimals or 1/10 of an arc second, representing around 1m of accuracy, is about as accurate as a consumer GPS is likely to measure.

Go hiking and enjoy!

September 26, 2014 at 10:54 pm

Hi. This calculator http://fas.org/news/reference/calc/degree.html disagrees with the statment that “one arcdegree of latitude north/south (by moving along a longitude line) represents the same distance anywhere on earth.”

At 90 degrees, the calculator shows 111694 meters per decimal degree.

At 0 degress, it shows 110574 meters per decimal degree.

Is this because the earth is sphereoid, bulging in the middle a little bit?

November 1, 2016 at 2:55 am

I’ve been looking for exactly this for the longest time. Thank you! It’s so hard to find these equations online.

January 22, 2017 at 12:09 am

1/60 arcdegree = 1 nautical mile. and in your calculation the 1.333 statute miles is 1.1333

August 24, 2017 at 1:53 pm

Seems here a unit change in the sixth digit of a decimal latitude is given as about 8.5 cm, 11.1 cm, or 10 cm – the correct is 11.1

A change of 0.000001 in longitude is the same 11.1 cm at the equator, but reduces to zero at the poles; it’s 7 cm at 49 degrees latitude.

September 12, 2017 at 10:50 am

I’m working on an application where I needed to convert GPS coordinates to actual relative distances, and your blog post has helped me out a lot.

Great write-up!

February 26, 2018 at 7:45 pm

Nice article found it useful.

But image to represent latitude and longitude is wrong.

And the below line calculation needs to be checked. Should be 1.13 statute mils.

“1 arcdegree = 1 naut. mi. * cos(10 deg) = 0.985 nautical miles = 1.333 statute miles”

February 26, 2018 at 7:58 pm

But image to represent latitude and longitude is wrong.

Sorry for this comment.. you are right there