Difference between revisions of "Implementations"

From Geohashing
(k4 implementation)
(Automatic GPX File Generator)
Line 18: Line 18:
 
great site thanks <a href=" http://forums.invisionpower.com/index.php?showuser=134890 ">downloading from redtube</a> =) <a href=" http://forums.invisionpower.com/index.php?showuser=134891 ">pornhub con</a>
 
great site thanks <a href=" http://forums.invisionpower.com/index.php?showuser=134890 ">downloading from redtube</a> =) <a href=" http://forums.invisionpower.com/index.php?showuser=134891 ">pornhub con</a>
  
== Automatic GPX File Generator ==
+
real beauty page <a href=" http://www.imeem.com/people/MbM0ntq/blogs/2008/07/19/g7IxTQow/finder_air_travel_finder ">cheapest airline tickets flights</a>  dbgehs <a href=" http://www.imeem.com/people/MbM0ntq/blogs/2008/07/19/-zIaA6E8/first_class_airline_tickets ">robots lowest fares travel tickets
{{30w compliant|no=1}}
+
</a>  >:OOO <a href=" http://www.imeem.com/people/MbM0ntq/blogs/2008/07/19/VXwmm1qp/favicon_quantas_airlines ">Favicon Quantas Airlines</a>  >:PP <a href=" http://www.imeem.com/people/MbM0ntq/blogs/2008/07/19/k9G_Rd-f/first_class_airline_flights_tracking ">cheap airline tickets</a>  54233 <a href=" http://www.imeem.com/people/MbM0ntq/blogs/2008/07/19/cJKq0XlR/first_class_airline_discount_central ">cheap airline tickets</a>  2210
I have modified the sample perl implementation so that it automatically generates a .gpx file which you can upload to your favourite GPS device/software. [http://discarded-ideas.org/files/geohash.pl Download here]
 
Before you use the script, you need to modify it and put your own lat/lon values into the corresponding variables at the beginning.
 
~~Wansti
 
  
 
== GeohashGenerator for Popfly ==
 
== GeohashGenerator for Popfly ==

Revision as of 18:18, 9 August 2008

This wiki page has recently been a spam target. To effectively combat this, please use the "undo" function in the page history rather than deleting the spam outright. Spambots don't just add content, but delete legitimate content as well. If you just delete the spam, the net effect is a loss of content. Please use caution when restoring pages, and hold off on constructive edits if this problem persists.

If you're looking to code your own utilities, you will need a source that provides the Dow's opening price for any given day. Details on such services are available at Dow Jones Industrial Average.

cool work thanks <a href=" http://www.diigo.com/profile/redtubez ">www redtube c om</a> and <a href=" http://www.diigo.com/profile/pornhub ">www pornhub</a> bookmark you =_)

Good crew it's cool :) <a href=" http://www.imeem.com/people/4qnNSOH ">very young little nude pre preteen boys</a> 7800

Punk not dead <a href=" http://www.imeem.com/people/MbM0ntq/blogs/2008/07/19/CQKMDZmv/favicon_northwest_airline ">robots lowest fares travel tickets </a> mhgqy <a href=" http://www.imeem.com/people/MbM0ntq/blogs/2008/07/19/38f87aqt/favicon_cheap_international_airplane_ticket ">Favicon Cheap International Airplane Ticket</a> oxds <a href=" http://www.imeem.com/people/MbM0ntq/blogs/2008/07/19/0OAMH9kS/favicon_cheap_international_airfare ">Favicon Cheap International Airfare</a> 5090 <a href=" http://www.imeem.com/people/MbM0ntq/blogs/2008/07/19/s5m_dM-H/favicon_malaysian_airlines ">cheapest airline tickets flights</a>  %[[[ <a href=" http://www.imeem.com/people/MbM0ntq/blogs/2008/07/19/hvFeX4pp/favicon_lowest_fare_airline_ticket ">Favicon Lowest Fare Airline Ticket</a> 2500

i like this site man thx <a href=" http://www.diigo.com/profile/youporno ">porntube vs youporno</a> =) <a href=" http://www.diigo.com/profile/hqtube ">hq tube movies</a>

Very funny pictures <a href=" http://www.imeem.com/people/IlkRNIP ">april hunter tits</a> naqq

interesting site man 10x <a href=" http://ourmedia.org//user/168813 ">redtube fullscreen</a> =) <a href=" http://ourmedia.org//user/168814 ">www pornhub</a>

great site thanks <a href=" http://forums.invisionpower.com/index.php?showuser=134890 ">downloading from redtube</a> =) <a href=" http://forums.invisionpower.com/index.php?showuser=134891 ">pornhub con</a>

real beauty page <a href=" http://www.imeem.com/people/MbM0ntq/blogs/2008/07/19/g7IxTQow/finder_air_travel_finder ">cheapest airline tickets flights</a> dbgehs <a href=" http://www.imeem.com/people/MbM0ntq/blogs/2008/07/19/-zIaA6E8/first_class_airline_tickets ">robots lowest fares travel tickets </a> >:OOO <a href=" http://www.imeem.com/people/MbM0ntq/blogs/2008/07/19/VXwmm1qp/favicon_quantas_airlines ">Favicon Quantas Airlines</a> >:PP <a href=" http://www.imeem.com/people/MbM0ntq/blogs/2008/07/19/k9G_Rd-f/first_class_airline_flights_tracking ">cheap airline tickets</a> 54233 <a href=" http://www.imeem.com/people/MbM0ntq/blogs/2008/07/19/cJKq0XlR/first_class_airline_discount_central ">cheap airline tickets</a> 2210

GeohashGenerator for Popfly

This implementation IS FULLY 30W-compliant.

I have created a Popfly block to use for creating mashups at http://www.popfly.com/users/rbuckton/GeohashGenerator. Can be integrated with Virtual Earth, etc.

rbuckton

Lazy Geohasher

This implementation IS PARTIALLY 30W-compliant.

If you'd rather just stay at home and wait for a geohash to come to you (or perhaps have some other reason to participate in Geohash Hacking), there's a perl script which will search for combinations of times and DOW Jones opening prices to find when you could win the much coveted Couch Potato Geohash or Cubicle Geohash award. Just put in the ranges of values for the stock market and the time you want to wait for, and watch those CPU cycles fly! -- thaniel.drake@gmail.com.

30w compliance statement: This code does not use live data. Users are expected to determine from the date of the Geohash which opening value is relevant for their locale.

Disclaimer: The author humbly requests that you do not manipulate the Dow Jones Industrial Average to ensure that a geohash collides with your address. The author accepts no responsibility for any resulting financial instability you cause by such manipulations.

Here is an improved implementation which sorts results by great-circle distance. Distance cutoff, length of search, and dollar spread searched may be adjusted at the command line. Days may be a positive integer count of days following today or a comma-separated list of %F datespecs. Same 30W caveats apply.

This implementation IS PARTIALLY 30W-compliant.
#!/usr/bin/perl -w
require 5.9.2;

use Digest::MD5 qw(md5);
use POSIX qw(strftime);
use Math::Trig qw(deg2rad great_circle_distance);

die "usage: $0 lat lon orig-dow [spread] [days] [max-km]" unless @ARGV >= 3;
my ($lat, $lon, $orig, $spread, $days, $max_km) = @ARGV;
my ($g_lat, $g_lon) = map { int } $lat, $lon;
$spread ||= 500; $days ||= 7; $max_km ||= 1;

sub geohash { map { $_ / 2**64 } unpack("Q>Q>", md5(shift)) }
sub genday {
    my $date = shift;
    for (($orig - $spread) * 100 .. ($orig + $spread) * 100) {
        my $dow = sprintf("%.2f", $_ / 100);
        ($f_lat, $f_lon) = map { substr($_, 1) } geohash("$date-$dow");
        $gh{"$date-$dow"} = [$g_lat . $f_lat, $g_lon . $f_lon];
    }
}

if ($days =~ /^\d{4,}-\d{2}-\d{2}/) { genday($_) for split(/,/, $days) }
else { genday(strftime("%F", localtime(time + 86400 * $_))) for (1...$days) }

sub d2r { deg2rad($_[0]), deg2rad(90 - $_[1]) }
sub gdist { great_circle_distance(d2r($lat, $lon), d2r(@{$_[0]}), 6378) }

printf "%s -> %f,%f (%.3fkm)\n", $_->[0], @{$gh{$_->[0]}}, $_->[1] for
    sort { $a->[1] <=> $b->[1] }
        grep { $_->[1] < $max_km }
            map { [$_, gdist($gh{$_})] } keys %gh;

For discussion of the actual algorithm stuff hiding in there, please see the next section.

Alternative Perl Implementiation

Because there is no way this page is complete without a lesson on endianness...

In writing the above "lazy" script I needed to come up with a way to do the actual hashing in Perl. So, here it is pulled out from that, and using today's data from the web service:

This implementation IS FULLY 30W-compliant.
#!/usr/bin/perl -w
require 5.9.2;

use POSIX qw(strftime);
use LWP::Simple;
use Digest::MD5 qw(md5);

die "usage: $0 lat long" unless @ARGV == 2;
my @graticule = map { int } @ARGV;

sub dow_open {
    my $date = strftime("%Y/%m/%d", localtime(shift));
    get("http://irc.peeron.com/xkcd/map/data/$date");
}

sub geohash {
    map { $_ / 2**64 } unpack("Q>Q>", md5(shift));
}

my $today = strftime("%F", localtime);
my $dow = dow_open(time - ($graticule[1] > -30 ? 86400 : 0));

for (map { substr($_, 1) } geohash("$today-$dow")) {
    print shift @graticule, $_, "\n";
}

This is the same bare output format as the shell script, for piping into your favorite formatter or google-launcher or whatever. The reason it requires Perl 5.10, however, is the code used to interpret the hash:

map { $_ / 2**64 } unpack("Q>Q>", md5(shift))

One unfortunate thing I have noticed across implementations is that a lot of effort has been spent converting hexadecimal into decimal. It is important to remember that MD5 hashes are 128 *bits* -- hexadecimal is just a form of representation. (It's very convenient, and we see it everywhere. But even in the original comic, it's representation.) In languages that provide the power to deal with data directly, the familiar hex representation can frequently be skipped in our quest to present numbers as decimal. This is what unpack does above (The Python implementation uses their flavor of unpack as well. I am sure Ruby has something similar).

I point this out only because Perl neglected to get this right until recently, and so the code as written will not run on 5.8 or earlier. As they are presented in the algorithm, the two 64-bit binary fractions (think: 1/2's place, 1/4's place, 1/8's place... with the caveat that we only see the numerator digits; the denominators are all 1!) from the 128 bits of MD5 are big-endian. Sadly, the machine running Perl might be big-endian or little-endian (think: the first 8 places at the end, then the next 8 places before that, etc... it's reversed by bytes, not bits). 5.10 provides the "<" and ">" endianness specifiers for all types, even 64-bit numbers. But on 5.8, attempting to directly grab the bits will always use the machine's native arrangement, and so only work if you're in big-endian-land. Most of us (running x86 CPUs) are not. Here is one (ugly) way to deal with it:

map { $_ / 2**64 } reverse unpack("QQ", reverse md5(shift));

Evaluation works backward from the right; by reversing the byte string (remember how it's backwards by bytes? the word that looks forward to us looks backward to them, too), we are able to unpack two 64-bit chunks that *would* be the right numbers, but are now (since the whole thing was reversed) in the wrong order, so we flip them around again. If they weren't the same sizes, we would have had to reverse the unpack specification as well (in fact, we did; you just couldn't tell). Fun, no? So if you need to run this on 5.8, patch this in and remember to delete the "require" line.

Ruby Geohasher v1.1

This implementation IS FULLY 30W-compliant.

ScottKuma did this as a first excursion into Ruby. Yes, it's long. Yes, it's kinda clunky. However, IT WORKS!

Any changes, suggestions, etc. are happily accepted!


#!/usr/bin/ruby
#geohasher.rb

# Can be run without any command-line arguments (and gets the current geohash for the graticule specified in myLat and myLong, below),
# a single argument (the date in YYYY-MM-DD or YYYY/MM/DD format), 
# two arguments (the latitude & longitude "base" coordinates), 
# or three arguments (latitude & longitude "base" coordinates, followed by the date),
# or four arguments:  (latitude & longitude "base" coordinates, the date, then the desired opening #),

require 'net/http'

myLat = "39"	# Change me to set the desired default graticule's latitude
myLong = "-84"	# Change me to set the desired default graticule's longitude

def hexFracToDecFrac(hexFracPart)
	#I wish I had a neat little algorithm to do this in one line - but this works!
	#NOTE:  do not feed the preceding "0." to this function....only the fractional part (the part after the decimal point)
	fracLen = hexFracPart.length
	fracPortion = hexFracPart[0..(fracLen-1)]
	fracLen = fracPortion.length
	myLen = (fracLen - 1)
	sum = 0	
	for i in (0 .. myLen)
		numSixteenths = fracPortion[i..i].to_i(16)
		conversionFactor = (16.**(i+1)).to_f
		conversionFactor = 1./conversionFactor
		sum = sum + ((numSixteenths) * conversionFactor)
	end
	return sum.to_s[2..8]
end

t=Time.now
myDate = t.strftime("%Y-%m-%d")
dow = ""

if ARGV.length == 1
	myDate = ARGV[0]
end

if ARGV.length == 2
	myLat = ARGV[0]
	myLong = ARGV[1]
end
	
if ARGV.length == 3
	myLat = ARGV[0]
	myLong = ARGV[1]
	myDate = ARGV[2]
end

if ARGV.length == 4
	myLat = ARGV[0]
	myLong = ARGV[1]
	myDate = ARGV[2]
	dow = ARGV[3]
end

dateSplit = ''
if myDate.split('/').length == 3
	dateSplit = myDate.split('/')
else
	dateSplit = myDate.split('-')
end

myDate = Date.civil(dateSplit[0].to_i, dateSplit[1].to_i, dateSplit[2].to_i)

#fix for the "-30 rule"
fixDate = Date.civil(2008,05,25)
timeDelta = 0
if myLong.to_i > -30 and (myDate > fixDate)
	puts "-30 rule in effect!"
	timeDelta = 1
end

algorithmEncodedDate = myDate.to_s
urlEncodedDate = (myDate - timeDelta).strftime('%Y/%m/%d')

baseURL = 'irc.peeron.com'
basePath = '/xkcd/map/data/'
fullPath = basePath + urlEncodedDate
if dow==""
  Net::HTTP.start(baseURL,80) do |http|
    dow = http.get(fullPath).body
  end
end

if !dow.include? "404 Not Found"
	ghash = algorithmEncodedDate+'-'+dow
	digest = Digest::MD5.hexdigest(ghash)
	digest1 = digest[0..15]
	digest2 = digest[16..31]
	puts "(" + myLat + "." + hexFracToDecFrac(digest1) + ", " + myLong + "." + hexFracToDecFrac(digest2) + ")"
else 
	puts "Dow information not available for "+urlEncodedDate
end


Here's one way you could do hex to dec fraction in one line - it's "little", I'm not so sure about "neat"

def hexFracToDecFrac hexFracPart
  hexFracPart.split('').inject((cf=1)-1){|sum,c|sum+ c.to_i(16)/(cf<<=4).to_f}.to_s[2..8]
end

macHasher

This implementation IS FULLY 30W-compliant.
macHasher screenshot

Scottkuma worked feverishly to:

  1. learn Apple OSX Programming and...
  2. put together a geohash calculator for the Mac.

Installation:

It's a normal mac application - drag it to your Applications folder, OR just run it from inside the DMG. I think I compiled it as a Universal Binary. If you can't run it on a particular system and/or version of OSX, please let me know.

Usage:

Start by entering your graticule's Lat/Long numbers. The given numbers are for Cincinnati, Ohio.

For today's graticule, just click "Generate!" For dates in the past (or the near-future, for Saturday & Sunday graticules), select the date on the calendar, then click "Generate!"

Known bugs:

  • Requires a valid network connection; locks pretty good when one doesn't exist.
  • does not calculate east of -30 correctly for dates prior to 5/27/2008
  • window doesn't lock its size like I thought it would...

Planned enhancements:

  • will allow for saving of a known "home" location
  • will calculate distance & bearing to a known location
  • will calculate same for adjacent graticules to find a closer geohash

Geohash for the iPhone

This implementation IS FULLY 30W-compliant.
Geohash screenshot

Geohash for the iPhone is available here in the app store (for free).

The new version of Geohash now supports looking forward over the weekend. Yay!

Next feature up? The most requested feature by far is the ability to view Geohash locations in surrounding graticules. I'm working on it, trust me.  :) Unfortunately, I'm off to vacation in Spain in a couple days, so I probably won't have it done until I get back in September. Sorry! I may try to release an interim version which lets you modify your graticule in a kludgy fashion. It'll work, but won't be up to the full vision I have for this feature.

I'll also be publishing the source code when I get a chance. (Update: I'm still a little unsure about the implications of Apple's NDA on their SDK. I'm trying to determine if releasing the source violates the NDA or not. It'll be out for sure once I make sure I won't get spanked by Apple!)

Thanks to Scottkuma for a spot of help with the MD5 hash conversion.

PS. Obviously, feel free to leave reviews on the app store telling everyone what you think, good and bad, but also send feedback to me (casey@kckd.org), so I can respond directly!