Difference between revisions of "Talk:Implementations"

Revision as of 13:57, 3 June 2008

Topics on this page which have clearly been handled or resolved can be found in the archives.
When archiving a section of this Talk page, please say so in the edit summary here.

Atom feed 30W-compliance

I just added the atom feed and it seems to be 30W-compliant

After some thought, I suppose it would be somewhat compliant. However, in some cases it's too compliant, or compliant in the wrong ways. After 00:00 local time, it automatically switches to the next day, but keeps the old Dow value and rehashes. East of 30W that behavior is desired, since you want to use the previous day's Dow anyway. West of 30W, however, it means we get an "intermediate" hash that's invalid for us. This much has always been a problem with the implementation. Then, sometime after 09:30 ET (I don't know precisely when), it detects the new Dow value and updates the hash... but it does it both west of 30W where it is needed, and east of 30W where it is undesired. In that case, you would get some other "intermediate" using the current Dow with the current day, which isn't what you want. That's a new problem the 30W Rule created.

In summary, it seems to produce invalid hashes between 00:00 (local) and ~09:30 EDT (UTC-4) west of 30W, and between ~09:30 EDT (UTC-4) and 24:00 (local) east of 30W. That is, it's invalid from 00:00-~06:30 in US Pacific Daylight Time (UTC-7), from ~14:30-24:00 British Summer Time (UTC+1) or from ~21:30-24:00 Australia Western Standard Time (UTC+8). I'm not even sure I know what would happen with the feed in New Zealand, where 09:30 USEDT = 01:30 NZST the next day. It'll be even worse come late October/early November, when Australia/NZ switch into DSTand the US switch out... the gap will become 2 hours wider over a couple weeks' time. And of course, these problems are mitigated over weekends, when you have several identical Dow values in a row. Someone should check this out before the weekend, as I'll be busy until Friday 19:00 UTC. If anyone does, and has thoughts, hit me up on my talk page.

Sincerely, your friendly ~~local~~ (global?) 30W-compliance "expert"... --Tim P 15:34, 29 May 2008 (UTC)

I have just updated the feed so it should be 30W compliant. Let me know if it's still a problem. --Xxv 18:03, 30 May 2008 (UTC)

Shell script implementation

While it runs on sh, ksh, and bash now, it still doesn't work on OpenBSD. If GNU date (which has the -d option) is not detected, I assume FreeBSD's -v is available; OpenBSD doesn't appear to have a comparable feature. Could someone test on OS X? No idea what's there (pretty sure they ship with wget, though).

Super brownie points if you can make it fallback to wget *or* fetch in one line so I can delete that stupid usage warning and have it run on FreeBSD out of the box. --Decklin

Could the user at 63.201.144.114 explain what broke? No math is being done in the shell in any case, and nothing added requires the script to be run under GNU bash instead of any POSIX sh. Extra features are nice, if they can only be implemented in the script itself, but that's an entirely separate issue.

iPhone Implementation

Last night I finished a rough implementation of this to the iPhone 2.0 Beta SDK. Right now it uses your current location and date and then does the math, then gives you a map with the destination address along with directions to there from where you are at. This will be even more useful if the next 3G iPhone come with GPS, until then it uses it's less accurate cellular and wifi location tools to locate you. I plan on adding a way to select your date and your desired graticule as well. Eventually I'll also investigate filtering of the results in watery areas. I can't distribute it currently, but as soon as I can I'll make it available. -- Shakedown

Wrong market data for June 2008 in locations east of -30°

The official reference implementation is attempting to fetch the wrong market data for dates in June 2008 for locations east of -30°.

For 2008-06-01, it attempts to fetch market data for 2008-06-30.
For 2008-06-02, it attempts to fetch market data for 2008-07-01.
For 2008-06-29, it attempts to fetch market data for 2008-07-28.
For 2008-06-30, it attempts to fetch market data for 2008-07-29.
For 2008-07-01, it attempts to fetch market data for 2008-06-30 (correct).

Locations west of -30°: tested 2008-06-01, which fetches correct data. Not sure of the extent of the issue, more testing needed. - r0d3n7z 18:07, 30 May 2008 (UTC)

Further testing reveals that the problem is not confined to June 2008, but affects all months with less than 31 days for dates after the 30W rule was applied. Hope this helps pinpoint the problem. -- r0d3n7z 18:32, 30 May 2008 (UTC)

It works perfectly fine here, and has been all along since the previous problem was fixed.--80.216.129.239 19:49, 30 May 2008 (UTC)

I'm not seeing this problem? What browser/OS are you using? What does the debugging info show when it gets the wrong data? Zigdon 20:05, 30 May 2008 (UTC)

I am experiencing this across several browsers. Screencaps: FF1.5 FF2 IE6 IE7 Debugging info shows an attempt to fetch market data for an incorrect date. -- r0d3n7z 20:41, 30 May 2008 (UTC)

Tested with the exact same coordinates,dates and browser, and it generates the coordinates perfectly. So must be somethign wrong local. I'll remove the notes from the front page, as clearly several persons have no problems. --80.216.129.239 22:03, 30 May 2008 (UTC)

I've experienced the problem when testing with my 1. own computer on a) my home connection (202.156.183.xxx) and b) via a vpn connection to (155.69.xxx.xxx); 2. a second computer on my home connection; and 3. a remote machine at (155.69.xxx.xxx). Different browsers were used. Browser cache was cleared beforehand. No javascript errors were logged. The problem doesn't seem isolated to any one browser/computer/connection in particular. Any ideas for pinpointing the cause of the problem? -- r0d3n7z 02:24, 31 May 2008 (UTC)

I'm getting it in both Firefox and Opera, both with vpn (130.126.xxx.xxx) and without (83.49.xxx.xxx). Loggie 05:33, 31 May 2008 (UTC)

Originally posted at Talk:Main_Page#Issue_with_the_map...

When I type the date 2008-06-01 into the map, I get the error "Market data is not available for 2008-06-30" However, I can type in 2008-05-32 and also 2008-05-33 and get coordinates. The 34th gives me "Market data is not available for 2008-06-02" (I'm looking at places east of -30°, by the way). Loggie 22:37, 30 May 2008 (UTC)

I get the same problem. BTW the coordinates returned for 2008-05-32 are *not* the correct coordinates for 2008-06-01, since it uses wrong date (2008-05-32) in the hash. Not sure if you realize this or are just pointing out more data -- at first I thought you had found a tricky workaround :)

Another observation, the page is also looking for DJI data on 2008-07-01, when I type in 2008-06-02, this is rather odd. --124.168.225.106 02:42, 31 May 2008 (UTC)

Originally posted at Template_talk:Expeditions/2008-05-31#end_of_the_month...

When looking for hash locations through Sunday and Monday, I found the reference implementation is looking for DJI data on 2008-06-30, suggesting that months are not being handled correctly. Can someone confirm?

This is clearly not a localized problem. Re-posting the notes on the front page. -- r0d3n7z 03:11, 31 May 2008 (UTC)

UPDATE - I put a workaround in place aroudn this weird problem, but I still don't actually understand it. Zigdon 07:33, 31 May 2008 (UTC)

Now suddenly I'm experiencing the exact same problem, after it working fine before. Don't know if the workaround caused this problem for me or if it's just suddenly decided to show up. --80.216.129.239 10:55, 31 May 2008 (UTC)

The workaround fixed the problem for me. Debugging info will print something like "YOU ARE INSANE. 6!=5!!! TRYING TO PLAY ALONG." when the workaround kicks in (in my case, that's any date in Feb/Apr/Jun/Sep/Nov after May 2008). Please check the debugging info to confirm if the workaround is active or inactive when you experience the problem. Either way, this is a really strange bug! -- r0d3n7z 12:48, 31 May 2008 (UTC)

It's working for me now too. Loggie 12:55, 31 May 2008 (UTC)

@Zigdon: I have a bit of a hunch, as I was seeing some similar problems in templates on the wiki today (UTC)... I'll see if I can't take a stab at it... --Tim P 16:39, 31 May 2008 (UTC)

Just take a look at http://irc.peeron.com/xkcd/map/xkcd.js, search for 'YOU ARE INSANE'. Zigdon 16:44, 31 May 2008 (UTC)

I discovered that link accidentally just minutes after posting that. No luck yet. It really is insane. --Tim P 17:21, 31 May 2008 (UTC)

I had the same very strange problem. At the moment, the workaround kicks in when I use the tool. This is what it looks like. Using FF 2.0.0.14 as can be seen in the screenshot. I'm online using Eduroam (http://www.eduroam.org) at K.U.Leuven (http://eduroam.kuleuven.be) with my laptop, running WinXPpro. If you need any other info, just ask. Let us know when the cause of this wacky bug has been found! --Rex 18:55, 31 May 2008 (UTC)

SOLUTION numbers need to be cast as int's before you do math on them: parseInt(datecomp[0])-1, etc. --CWolves 01:34, 1 June 2008 (UTC)

I had the feeling it had to do with numbers being read in octal or math not being applied correctly to the months. --Tim P 01:50, 1 June 2008 (UTC)

This makes sense (and that's for coming to my rescue :). That said, I don't think it fixed the problem? Zigdon 02:30, 1 June 2008 (UTC)

FIXED Ah ha - I think I got it now. JS didn't like me setting the month and day in two calls. I can only assume that it's because the date which is being set (intermittently) is invalid. Which is why the problem started happening when the *current* date was the 31st. Calling setMonth(month, day) seems to fix it. If anyone is still getting the 'YOU ARE INSANE' message in the debugging (when feeding it a valid date), please let me know. Zigdon 02:38, 1 June 2008 (UTC)

Zero-padding of date east of 30W

Fix one problem, creates another. East of 30W, dates going into the MD5 hash are not properly zero-padded. E.g.,

xkcd.js version $Id: xkcd.js 202 2008-06-01 02:27:19Z dan $
After 30W adjustment, date is 2008-05-31
Market open on 2008-05-31 = 12647.36
MD5(2008-6-1-12647.36): 980b032a1ab1be848faf740c9882c545
Split: 980b032a1ab1be84, 8faf740c9882c545
...
etc.

The MD5 function should be hashing 2008-06-01-12647.36 instead. I think this is just a simple side-effect of the last fix, but it's wrong for all dates from 27 May 2008 in all locales east of 30W, so this is a major issue. At least we're not "insane" anymore. --Tim P 03:07, 1 June 2008 (UTC) FIXED - This has been fixed. --Tim P 04:29, 1 June 2008 (UTC)

The last 2 problems being fixed, I tested every date from 29/05 up to and including 02/06: no more "insane" and the coordinates correctly match those on the wiki. --Rex 11:44, 1 June 2008 (UTC)

Good. I'm glad. --Tim P 14:54, 1 June 2008 (UTC)

Flickr?

So, there're likely a bunch of media-sharing sites out there that allow users to tag content; and some subset of those will have geohashing users. I've added a link to Flickr's RSS feed for "photos tagged geohashing" to this page, but I'm not entirely convinced it belongs here. Please feel free to move (or simply remove, I supose) it. --Tapin 03:07, 2 June 2008 (UTC)

@@ Line 7: / Line 7: @@
 : Sincerely, your friendly <s>local</s> (global?) 30W-compliance "expert"... --[[User:Tjtrumpet2323|Tim P]] 15:34, 29 May 2008 (UTC)
 :: I have just updated the feed so it should be 30W compliant. Let me know if it's still a problem. --[[User:Xxv|Xxv]] 18:03, 30 May 2008 (UTC)
-== Python-CGI-JSON-o-Rama implementation ==
-Hey so i've made a python version of the reference implementation that returns a JSON parseable object containing the lat/long when given a date, xloc and yloc. It uses the XKCD cache of dow values. I'll put it online in the next 5 mins :D
-[http://users.ecs.soton.ac.uk/ss06r/GeoHashing/cgi-bin/geohashing.py Here] it is, fairly simple actually, hope someone finds it useful :)
-'''Update:''' I've tried to make it classify the region recommended for a particular day using the euclidian distance of the colour of the image provided by Google Maps
-The code is on the link above, tell me what you think :)
-[[User:Sinjax|SinJax]]
-: Cool!  I was thinking of making it act as a web service, but for reference implementation it's more important to be simple than useful :) [[User:Zigdon|Zigdon]] 14:53, 21 May 2008 (UTC)
-I mostly canabolised yours anyways! :) But yeh here you go. The webservice version returning AJAX from python can be found:
-- [http://geohashing.electronicwar.net/cgi-bin/geohashing.py?date=2008-05-20&xloc=-1.395606&yloc=50.899837 AJAX geohashing]
-- [http://geohashing.electronicwar.net/ Example using the web service]
-The implementation also has the ability to tell you whether the particular area is water, park/forest or other. It does this by checking the colour on google maps and doing a thresholded euclidian distance check against the expected colours for those things. Also If its water it tells you its probably not accessible I wanna try to add more features like this, things like rating locations based on food and letting you say how far your willing to travel
-Thanks to [[User:Sigmund Fraud]] from the IRC channel for the space on his server with python installed - [[User:Sinjax|SinJax]]
-I've added my own python implementation to the main page (only 5 lines) -- lilac
-: _very_ nice, im in awe! Though it must be said my concentration was usability as a web service and the implementation of that imaging stuff. Still. Very nice stuff. I love python :) - [[User:Sinjax | SinJax]]
-Added a shell script implementation to the main page (slightly shorter than the Python version; let the flames begin) -- [[User:gnomon | gnomon]]
-: deeply awesome; no flames from me -- [[User:lilac|lilac]]
-: ${var:x:y} slicing isn't portable, so you should really call it a "bash script" and change the #!/bin/sh. I came up with nearly the same thing:
-:: (echo 16i; echo -n "$(date +%F)-$(GET xrl.us/djiopen | col)" | md5 | sed 's/.\{16\}/0.&p/g' | tr a-f A-F) | dc
-: On Linux, it's md5sum, which prints a "-" for stdin, but dc happily eats that. Your web interface for getting the Dow data is much better/more flexible than that ganky little shortcut url to Y! Finance (they have historical data in .csv too, but at a different interface so I didn't include it), but consider using sed instead. You only have to fire up one dc at the end of the pipeline which is much cleaner IMO.
-: To make it print out my full co-ordinates, I created a graticule file:
-:: echo -e '42\n-71' > graticule
-: and appended
-:: | paste -d'\0' graticule -
-: to the pipeline. If you wanted it put it in a script file as you have and pass them as args, you could (untested):
-:: | while read f; do echo $1$f; shift; done
-: I'll stop here before I get any farther offtopic :) --Decklin
-== Error on page? ==
-Just zooming in and out today gives me random meet up locations, any one else having this issue?
-:Yes, I am experiencing this as well.
-::It seems to change everytime the applet is reloaded (refreshed, updated, zoomed, or moved)  Is there any one who can fix this?
-:::I'm not seeing this?  What browsers are you using? [[User:Zigdon|Zigdon]] 17:48, 23 May 2008 (UTC)
-::::I'm experiencing this problem on IE6. [[User:MOE37x3|MOE37x3]] 18:10, 23 May 2008 (UTC)
-:::::I get the error in IE7 but not Firefox.--[[User:Ahecht|Ahecht]] 18:57, 23 May 2008 (UTC)
-::::::Same here, except I us IE6, not 7. Firefox fixed my woes, though. - [[User:MythGuy|MythGuy]]
-:I, too, am experiencing this. I used the the alternative locater though. http://geohashing.electronicwar.net/
-:I hope we can we can get this fixed soon. - [[User:MythGuy|MythGuy]]
-:With the debugger on, I noticed that "00" is appended to the DOW opening every time I click "Update." This changes the hash each time, creating random locations. Zigdon, we need your help. 16:33, 23 May 2008 (UTC)(James)
-::Ah. Well this is creating problems for me. I used the alternate locator, got location A, went to my local page to see if others might be planning on coming, saw a different GPS (thus giving me location B), I went to the real map and found that the first location that it pops up with is always the same, so I have three locations now... What do I do? - [[User:MythGuy|MythGuy]]
-:::Gah.  Ok, I can reproduce this in IE6.  I'll see if I can find some simple hack, but doing browser specific code is evil. [[User:Zigdon|Zigdon]] 21:36, 23 May 2008 (UTC)
-:::Ok, it should be fixed in the (beta) version: http://irc.peeron.com/xkcd/map/map2.html.  This will become live once the 30W decision is final. [[User:Zigdon|Zigdon]] 21:47, 23 May 2008 (UTC)
-== Atom Feed ==
-I noticed yesterday that before the stock exchange data becomes available, the atom feed creates a kind of 'intemediary' geohash using todays date and yesterday's data. This might be intentional, but personally I find that undesirable on weekdays. Could it be modified to show yesterday's date and geohash until data is available? [[User:Nicktaylor|Nicktaylor]] 14:04, 23 May 2008 (UTC)
-: I'm currently working on getting an alternative Atom Feed implementation ready for public use (although I think I'm going to wait until the [[#Proposed Time Zone Solution|Time Zone issue]] is resolved).  Mine will '''only''' update at 09:40 Eastern daily (accounting for DST changes), and uses the ''irc.peeron.com'' source for the [[DJIA]], which is updated at 09:35.
-: I will '''certainly''' post it here when it's done, so stay tuned.  --[[User:Tjtrumpet2323|Tim P]] 20:10, 23 May 2008 (UTC)
-:: The time zone issue has been resolved with the [[30W Time Zone Rule]].  I'll continue to work on getting my implementation ready.  --[[User:Tjtrumpet2323|Tim P]] 04:34, 24 May 2008 (UTC)
-: I don't know if I'll bother with my Atom implementation.  I copied your original request at [[Implementations]]; I'll keep an eye on it there.  --[[User:Tjtrumpet2323|Tim P]] 05:17, 26 May 2008 (UTC)
-== Is it just me, or is the shell script borked? ==
-Shell script bombs out for me in two places :(
-This:
-<pre>[[ "$DOW" != +([0-9.]) ]] </pre>
-Was always returning true, so exiting the script with a "DOW not available yet.". I replaced that with
-<pre>[[ -z "$DOW" ]]</pre>
-to get past it.
-then it falls over elsewhere with:
-<pre>./geo.sh:1: unrecognized modifier `0'
-./geo.sh:1: unrecognized modifier `1'
-,</pre>
-For reference, the script reads:
-<pre>#!/bin/zsh
-DOW=$(wget -qO- http://irc.peeron.com/xkcd/map/data/$(date +%Y/%m/%d))
-[[ "$DOW" != +([0-9.]) ]] && echo "DOW not available yet." && exit 1
-MD5=$(echo -n "$(date -dW30 +%Y-%m-%d)-$DOW"|md5sum|cut -d' ' -f 1|tr a-f A-F)
-echo "$1$(echo 10k16i0.${MD5:0:16}p|dc), $2$(echo 10k16i0.${MD5:16}p|dc)"</pre>
-does it work for other people?
-And by the way, is the date modifying in the right place? Shouldn't it retrieve yesterday's dow and caculate with today's date in 30W cases - rather than retrieving today's dow and using yesterday's date for the hash?
-I've so far worked out that it's failing on the line:
-<pre>echo "$1$(echo 10k16i0.${MD5:0:16}p|dc), $2$(echo 10k16i0.${MD5:16}p|dc)"</pre>
-Better yet, I've further narrowed it further. The parts my system doesn't like are:
-<pre>echo "$1$(echo 10k16i0.${MD5:0:16}p|dc), $2$(echo 10k16i0.${MD5:16}p|dc)"
-                             ^ ^^   ^^                          ^^   ^^  </pre>
-It doesn't understand the numbers and it reports "command not found" for "dc"
---[[User:Polysylabic Pseudonym|Psud]] 08:49, 26 May 2008 (UTC)
-:: I've rewritten the script to incorporate some earlier suggestions I made (they were left on the main page's talk page when the implementations were moved) about portability (you seem to have been bitten by the slicing issue I was worried about). However, you will need to have dc installed no matter what. --Decklin
 == Shell script implementation ==