Being a huge dork, I decided to figure it out.

Basically, it’s actually not a very difficult thing to figure out. The steps are:

1. Get the latitude and longitude coordinates for a number of points along each of the interstates.
2. Determine which interstates intersect and eliminate those pairs.
3. Put the coordinates for the interstates into a kD-Tree which will perform the search that determines the distance between non-intersecting highways in a fast way.

It turns out that the first step proved to be the hardest. I decided to use the data from the Open Street Map (OSM) project. This is a Google Maps-like website that is editable by anyone in the world, similar to Wikipedia. It will not give you directions like other mapping services, but it contains the geographical location of a wide variety of items, including and importantly (as the name suggests) roads. I looked into using the OSM APIs, but as far as I could tell either the APIs didn’t do what I needed in an efficient way, or the servers were down. So I simply downloaded the 82 GB XML (5 GB compressed for download) dataset for the United States.

Begin rant – feel free to skip to the next paragraph. I loathe XML. Any time that you have a 82 GB text file (apparently it’s 200+ GB for the whole world) as your main distribution method, you’re doing something wrong. Doing this project I learned as little about XML as I could to get just what I needed out of the file. Apparently the authoritative data is kept in a real database, but it appears that you can not download the data as a database. They do have a binary format description, but I can’t find a link to download the data in that format. Furthermore, the world doesn’t need yet another binary format. For example, they do not discuss endianness for their binary format on that wiki page, which is a big issue with binary formats. There are many other quality formats they could use (SQLite or HDF5). The binary format has a distinct Not Invented Here feel to it, which is nearly always a bad thing. Anyway, back to the main point of my rant. I don’t care that the 82 GB XML file compresses down to 5 GB. Reading a 82 GB text file when you’re searching for just a fraction of that data takes a long, long time, and is completely unnecessary. Every time I encounter XML it wastes my time in myriad ways. This time was no different. End rant.

I’ll spare you the full details and samples my low-quality Python code, but I munged the interstate data into a SQLite file, which distilled the data from 82 GB to 19 MB. Yes, that’s nearly four orders of magnitude smaller. Then I used the much more convenient (and fast) SQLite file to build lists of interstate coordinates, which were fed into the kD-Tree for the nearest neighbor searches. The results are shown below. Note that there is no I-50 or I-60, and I eliminated I-45 from consideration because it’s entirely within Texas, and therefore is not “major” in my opinion. I eliminated Hawaii’s H-1 for the same reason. I have included links to maps showing the great circle between the nearest points of the highways. For highways that intersect, the link goes to one of the (more or less random) points of intersection.

Finally, we can see the answer I was looking for. Interstates 70 and 95 come within 5 kilometers in Baltimore at the terminus of 70, but do not intersect. So my suspicion was correct that it was somewhere in the East, so I have that to feel good about.

p.s. If you really, really want to see the code I used for this, I can share it, but I’ll have to pull out the hamsters that have taken residence in it. They’re attracted to dusty littered places, you know.

My email address is indeed valid, and I have now sent and received hundreds of emails using it. Furthermore, the specifications for email addresses are very simple, and my email address follows them (obviously). Yahoo! clearly needs to hire someone who can read a Wikipedia page and write a simple regular expression validating email addresses. Actually, a quick Google search (natch) proves that this has already been done dozens of times.

Just yet another reason why I’m glad I finally switched away from Yahoo! Mail. Good riddance.

Looking at the oldest email I can find, I have been using my Yahoo email address for nearly 9 years. Back then, there was no Gmail as an option. The only other webmail that was comparable was Hotmail. And there was no way I was going to use Hotmail because it was, and still is, owned by Microsoft. For much of that time I have even paid a yearly fee to Yahoo to remove advertisements and add other features.

In the last year I have become increasingly unhappy about Yahoo mail. They have refused to enable IMAP for anything but smart phones. GMail has enabled IMAP for everything for a long time. Yahoo’s servers are slow and flaky. Sometimes I cannot access my mail for half an hour (or more) until someone (presumably) does something somewhere to clear it up. I could overlook all of these things, mainly because I knew that switching email providers would be a chore.

However, the last straw was when they added a new feature that allows you to chat with your facebook friends in Yahoo mail. I suppose that this might be useful to some people, but it smacks of “me too” by Yahoo. The faceplace is the new hotness, something Yahoo hasn’t been in a decade, and since Yahoo can’t innovate their way back into relevance, they’ve just given up. This is the kind of stuff that insults my sensibilities.

Initially unrelated to all of this, my brother recently purchased a new domain: skory.us. He purchased it primarily so he could make a 10 digit email address: ?@skory.us (? = some letter of the alphabet). I thought that was pretty cool, and I wanted in on that action.

What pushed me to make a decision is that in a couple weeks my Yahoo mail membership comes due, and I didn’t want to give them any more money.

Therefore, last weekend I decided to sign up for a free Google Apps account using the skory.us domain. I swapped the MX DNS records over to Google’s servers, and started pulling all my old email from my Yahoo account. The pull of 50,000+ emails took over a week and wasn’t straightforward. I had to baby sit it daily on each end. THIS is why I was so hesitant to switch email providers because I knew it would be a hassle, and it was a hassle.

The move wasn’t perfect – although I pulled all my sent mail (i.e. email I wrote), I can’t get it into the Google sent mail folder. And there’s still more work to do. I have my Yahoo address in many, many places on the internet that I am going to have to slowly change. In the meantime, the Yahoo email will forward to Google.

Finally, here’s my new email address in a human parse-able but obfuscated format. Update your address books!

Sunset was at 4:36pm (and the sun fell behind the mountains even before that), but as you can see above, it actually got warmer as the sun set. The wind also picked up at the same time, and the air pressure fell, indicating that the heat was due to the wind warming up as it blew down the mountains. Boulder weather is weird!

We’re flying to Oakland next week for a whole slew of events with family. I haven’t decided if I’m going to opt-out of the advanced imaging scanners (AIS) or not. The TSA and FDA claim the X-ray backscatter imaging machines are safe, however they reference studies looking at a different energy-band of X-rays than are used in the machines. The millimeter-wave machines are likely safer. My decision may depend on which type of machine they’re using (if Denver has them yet, they didn’t the last time I was there) and how much time we have before the flight.

I am a firm believer that most of what the TSA does is “security theater,” wherein they do things that appear to make us safer by responding to specific threats, but it does not (and can not ever) address all the different attack vectors terrorists might use. In particular, the AIS machines and the “enhanced” pat-downs (more like “feel-ups”), which have been introduced ostensibly in response to the “underwear bomber” from a year ago, fail to address “internally” stored explosives, so to speak. Not that I’m hoping for it to happen, but as soon as this fairly obvious attack vector is tried, what will the TSA do then?

I have some ideas.

• Have passengers to disrobe into hospital-style gowns with open backs. Then they must perform ten deep squats in view of a TSA agent. They have the option of visiting the bathroom beforehand to prevent “accidents” (or get rid of the evidence). This will have the side-benefit of preventing obese and disabled passengers from flying, allowing the airlines to reduce seat and aisle width and legroom even further.
• Tell passengers to show up to the airport six hours early and give everyone a strong laxative. This may be combined with the above, in order to “facilitate” the discovery or disposal of explosives.
• Sedate passengers prior and during to each flight period, giving them a 24 hour window over which the flight may occur. This prevents the terrorists from being conscious to set a bomb off, or set a timer beforehand. To prevent the use of air pressure-sensitive triggers, the sedated passengers would spend time in a high-altitude chamber.
• Good ol’ fashioned cavity searches. Anything for security, right?

Sure, the things above sound ridiculous, but so does wasteful security that responds to specific threats, which is what we have now.

I’m back in San Diego for the next week and a half in order to graduate. I defend in one week on the 27th. The photo above is of a tarantula that lives in the office that I used to sit in, and that I am sitting in again while I’m here. That is its full significance to this post.

If the tarantula isn’t big enough above, you can make it bigger by clicking on the image!

I’m sad to leave San Diego, it has been a very good place to live for seven years. I’m leaving behinds lots of friends and a place I’m used to living with weather I like. Boulder is an exciting new place with new friends to make. It has four seasons, which will be a new thing for both of us. I don’t know if we’ll ever live in San Diego again, but I do want to come back and see my old friends and go for a bike ride with them.

Goodbye!

I like this ‘snub cube’ fountain:

The SciPy crowd:

A fountain in front of the building the conference is in:

What do you see just above and to the right of the wagon wheel? You can click on the image for the full view, or look at a zoom-in below:

It’s Che Guevara, of course! You can clearly see an eye, his beard, two nostrils and hat. He even appears to be sticking his tongue out. I am forced to wonder how his image ended up on a horse-drawn cart in New Orleans eighteen years before he was born. But clearly it’s a sign of something profound and mystical. Any ideas?

(Further reading.)

While I waited hours for the brief seconds of each pack of cyclists to pass, I decided to amuse myself by taking pictures of all the ‘brodozers’ that drove by. A brodozer is a pick-up truck that has been jacked up on shocks with huge noisy tires. They are a particularly nasty form of transportation. They are a big middle finger to the environment and are driven by young males in a very aggressive manner. One of my scariest moments on a bicycle was due to a brodozer in East County San Diego. This county is infested with brodozers, and Escondido is particularly bad.

Below are 16 of the 17 brodozers I was able to capture. There were many that passed before I had inspiration, and others I missed. It’s interesting that white is the dominant color, and none appear to have been off-road recently. The seventeenth was the only vehicle I saw escorted off the course by the police. That brodozer needed to be told more than once by the police to get off the course. This tells you all you need to know about brodozer drivers.

Let’s see how the the hopes and dreams of Obama turn out. I’m excited!

By far my favorite place to ride my mountain bike (that is reachable without driving) are the single track ‘tunnels’ that are typically reached through Peñasquitos Park (although they aren’t actually inside the park, they are on non-park city land). They are called ‘the tunnels’ because for most of their length they are covered by low bushes and trees just over head height. There are four of them that total a few miles in length and vary in technical difficulty. Until about a month ago, they were somewhat illicit and not patrolled, now they are very expressly illegal. During the rainy season I think it’s perfectly reasonable to close them. Muddy and wet ground is especially susceptible to erosion, and nature doesn’t need human help to erode the ground during the rainy season. The ditch my bike is pictured in above was fairly level ground the last time I was there, less than a month ago (*).

Unfortunately, there is strong evidence that the City of San Diego is planning on closing them permanently, or at least severely curtailing how many can be used. Since the tunnels are fairly far from any road, it’s only cyclists that use them with regularity, but the city feels it needs to consider all the other potential users. Cyclists are the lowest on the public land user totem pole, so you can see how this can do nothing but hurt our interests. I suspect that if they’re kept open, they’ll have to be upgraded so hikers and equestrians can use them, which will remove much of what is attractive about them (which is the lack of those two groups for a large part). If they’re closed for environmental reasons, only cyclists will miss them. It’s kind of a lose-lose situation for us.

The City of San Diego isn’t full of complete idiots, there is a series of legal drag race events that take place in the Qualcomm parking lot. This alleviates the pressure of what many people want to do and would resort to doing illegally without other options. There is a similar pressure from cyclists who want quality single track trails. If trails are available, legal and fun, cyclists won’t have to resort to cutting trails and breaking laws. We’ll see if the city has enough foresight to recognize this.

(*) For those my friends to are familiar with Peñasquitos, if you’re heading east, this is just past the big deep sandy patch where you used to have to ride on the extreme right, and just before the really rocky climb. I think it’s in the center of here. The second photo above is the top of the third tunnel, the farthest north of the three linked tunnels. The riding I did do today (I didn’t go into the tunnels) showed that many of the lines we rode in the summer are now completely different.

A few days ago while I was still in the Bay Area, I visited the new Academy of Sciences museum with my family. They just re-opened a few months ago after replacing their old earthquake-damaged buildings with a new, very unique building. You can follow those links to learn all about the ‘living roof’ and the various exhibits.

I have some mixed feelings about the new museum. The old museum (you can see some pictures of it at their time line page) was a funky amalgamation of several buildings built over many decades. You could see the history of modern American natural museums in one place. The old section had dioramas of stuffed animals in pseudo-natural scenes. Exhibits like lions hunting antelopes with Serengeti sounds playing on speakers. The newer sections had live animals and fish and a greater focus on education. The whole place was labyrinthine and dusty, and a well-used kind of ancient. It was never too full of people. I liked the old museum and I’m sad that a piece of my childhood is gone.

The new place is very shiny, flashy and popular. We waited for one hour and forty minutes to get inside. It might be bigger in cubic meters due to the higher ceilings, but I don’t think it’s bigger in square meters of floorspace. The main exhibition areas are limited to the two ends of the building, past the planetarium and tropical sphere, and the aquarium has been moved to the basement. The aquarium is quite a bit nicer than it was, with a few tanks that rival the Monterey Bay Aquarium in quality and cool curving Plexiglas, but not in size. Like the Monterey Bay Aquarium, the museum pushes education on choices the individual can make to positively change their effect on the ecosphere. They have a ‘carbon balance’, but it mostly ends up being played with by children who generally don’t decide whether to buy a SUV or a hybrid car.

I found a couple things I really liked; click on the thumbnails above. Read the tag on the human skull, and take a look at a whole wall of very carefully pinned ladybugs. I took three pictures a various zooms. That may have been a PhD thesis, right there.

There are more pictures here.

Yesterday, Melissa and I visited the Monterey Bay Aquarium. We were met there by my brother Adam and his lady friend Shinji, who not coincidentally decided to also see the aquarium on the same day. The aquarium has expanded since my last visit. There is now a northern wing that has fresh water otters, an “outer bay” tank and a seahorse exhibit (that was under construction, sadly). More than the last time I was there (or maybe I was too young to pay attention to things not cute), the aquarium really pushes conservation and ethical seafood consumption. They have a set of cards you can carry to help guide seafood and sushi purchases in stores and restaurants.

But what about the cute animals? (These links go to movies.) Fresh water otters gamboling! Feeding the penguins! A huge wolf eel in the kelp forest tank!

There are lots more photos here.

Melissa and I are taking the slow route up to the Bay Area for the holidays. Tonight we’re staying in Santa Barbara, and we’ll visit the Hearst Castle tomorrow. For dinner we ate at a decent Mexican restaurant on State Street. Afterwards we walked down State Street looking at all the shops and restaurants. It’s clear that the economy has started to hit Main, err… State Street America. Despite the Christmas decorations, and the huge tree in a left-turn lane, there are quite a few empty stores and others going out of business. I guess now is the time to start a new business cheaply in Santa Barbara – as long as you can weather the current economic storm.

More tomorrow!

Just like when the race goes through the Bay Area, I am familiar with much of this route. The race starts in Rancho Bernardo, and heads east on Highland Valley Road. That road has several nicely steep sections that kick my non-professional racer butt. I’m sure that the pros won’t charge up those hills so early in the race, but their pace would drop me, no doubt.

They go up the hard side of Palomar which is a world-class climb. It is every bit as hard as the Tour de France cols I’ve climbed. In February the top of Palomar can be quite cold (sometimes it even snows) so the temperature changes along the route could have an effect on the race.

I wish the race organizers would have given us the grand spectacle of a mountain-top finish. I am grateful, however, that they’ve finally dipped below the Los Angeles divide.

Oh, and I can’t forget to note: parts of the race go through Indian reservations, so the racers can get their gamblin’ on, if they feel like it.

I am considering selling my Volvo. I drive it perhaps two or three times a week because I ride my bike to school. Melissa has a fine automobile that she would let me use. My car is a 1997 model (it was actually sold in 1996) 850 T5 Vovlo wagon with every premium package except for the ‘winter’ and multidisc CD changer packages. Kelly Blue Book says I can sell it for between $4000 and $5000. I encourage you to tell me what do to in the comments. Here’s what I’ve got so far:

Amazing.

I can’t wait for January 20, 2009.

Play Quicktime version

She’s cuter than my work buddies at school, of course.

As I walked to lunch I saw the unveiling ceremony ending while the UCSD band (we have a band?) played the UCSD fight song (we have a fight song?). Below the statue there is a few streams of bubbly water and a a plaque which explains that the Triton doesn’t get to use his awesome trident, he just blows really hard on his conch which scares all the other gods and baddies away.

I, for one, am now waiting for the UC Santa Cruz banana slug statue.

Above is a graph showing my net worth since January 2007. I have removed the actual dollar values for the bars because I’m ashamed of how poor I am. Or wealthy I am. I’m not telling. But remember that I’m a grad student, not a former CEO of a failed investment bank… you get the idea.

I’ve put two numbers in orange on the graph. If in my richest half month I had one dollar, now I have 68 cents. Put another way, I’m now about two-thirds of my former self, and this took five months. The graph above includes my cash accounts, which haven’t gone down, so my investments have declined even more than a third. Luckily, I don’t need that money any time soon (I have to graduate before that), but it’s a bit depressing.

It’s also an opportunity to buy some really cheap bank stocks and hold them until they recover. Which would more or less cancel out the inevitable tax increases my generation will have to pay to bail out our selfish parents.

At least I can say that I’m ahead of the curve on the grad school thing.

Original here.