VOICES Traffic Data - Page 4

[iG] · 05-12-2004, 10:57 AM

66.com seems to have a nice gps package for canada.. However no online TMC like US and other countries. Argh!

stevieg · 05-12-2004, 10:58 AM

Quote: Originally Posted by ccsnet

Vauxhall - simple / free / and here ( http://vauxhall.co.uk/trafficnet/index.jhtml )

T

Just checking it out now

veetid · 05-12-2004, 12:31 PM

I should be done with a source for California today or tommorrow. What I have laid out is two tables in a DB. One table basically has all the zipcodes in CA associated with regions. These regions are the regions that are the closest match for traffic data for each zipcode. So when in Mappoint you would get current zipcode and query this table for the region. Then I have a second table with has region, lat, long, streetname. You retrieve all the streetnames for a region and there lat/long. Then based on the streetname I have a C# function that gets all the current speeds from www.sigalert.com. It is then very easy to add pushpins to Mappoint. Its only one state, but its a big one. When I finish I will give all I have to at least add California to this national traffic DB that is trying to be created.

stevieg · 05-12-2004, 04:33 PM

Quote: Originally Posted by veetid

I should be done with a source for California today or tommorrow. What I have laid out is two tables in a DB. One table basically has all the zipcodes in CA associated with regions. These regions are the regions that are the closest match for traffic data for each zipcode. So when in Mappoint you would get current zipcode and query this table for the region. Then I have a second table with has region, lat, long, streetname. You retrieve all the streetnames for a region and there lat/long. Then based on the streetname I have a C# function that gets all the current speeds from www.sigalert.com. It is then very easy to add pushpins to Mappoint. Its only one state, but its a big one. When I finish I will give all I have to at least add California to this national traffic DB that is trying to be created.

Cool, what's the plan? Will it run as a service and upload to a DB, if so I should be able to find a box to run the processing and upload every 5 mins to the web server no probs.

stevieg · 05-12-2004, 04:43 PM

Been looking at trafficmaster.net earlier (I've got a subscription to it) and looking at the http requests the actual flash/shockwave page makes once it's loaded to get the data.
Will also be having a look at the Vauxhall version, and see if that gives off more information.
The basic plan so far from what data I have got back from it is that I might be able to use a server process running mappoint similar to veetid to plot the position based on the description, get the lat/lon and upload it to the web application. Of course this depends on whether the positions are accurate - though a motorway tailback usually slows down for at least a mile and more around so it might not make any difference.

ccsnet · 05-12-2004, 04:50 PM

Quote: Originally Posted by stevieg

Been looking at trafficmaster.net earlier (I've got a subscription to it) and looking at the http requests the actual flash/shockwave page makes once it's loaded to get the data.

I'd be intrested in having an offline converstaion about this.... been wondering how to do that for some time

Terran ( PMed you my MSN ID )

stevieg · 05-12-2004, 06:08 PM

Right...

Example of the trafficmaster data I can 'aquire': Needs some
work

Code:

a=Wed+12+May+2004+22%3A40++%B7++M271+northbound+very+slow+moving+traffic+for+2+mile%28s%29+from+J0+to+J1%2C+fifteen+minute+delay++%B7++A501+westbound+very+slow+moving+traffic+for+2+mile%28s%29+from+St+Pancras+to+Marylebone%2C+ten+minute+delay++%B7++A102+southbound+very+slow+moving+traffic+for+1+mile%28s%29+AT+Blackwall+Tunnel+Southern+Approach%2C+ten+minute+delay++%B7++A23+southbound+slow+moving+traffic+for+2+mile%28s%29+from+A205+to+Streatham%2C+short+delay%2E%0D%0A

stevieg · 05-12-2004, 06:11 PM

keep27 has PMed me a few for the US which I'll look into:

http://www.travelinfo.org/GCM.html

http://www.dot.state.mn.us/tmc/traff...ata/index.html

Second one looks most promising

veetid · 05-12-2004, 07:17 PM

Basically what I had to do was get a list of all the intersections that were available on www.sigalert.com and ran them through a seperate process and got their lat/long. I then just store these lat/long values and associate them with the intersections on the site. Therefore the lat/long values are static and all I do is update the speeds based on the intersections. This is not dynamic in the sense that if they add a new intersection to their traffic database I will have to figure out its lat/long and add it to the DB, but how often do they add exits. This was the best method I found so far.

robr · 05-12-2004, 08:34 PM

how do you guys plan on pulling this down as realtime data? you need a full on internet connection or is a WAP phone with bluetooth possible?

veetid · 05-12-2004, 09:09 PM

I get on the internet in my car with my GSM cellphone via GPRS. Also there are tons of places I can get on the internet around town. In the city, in the US, all you have to find the nearest StarBucks and you can get on the Internet with wireless B or G and download the most recent content. There is actually a StartBucks right by my house at the light I have to sit at to get on the Interstate. I get high speed internet access for multiple minutes every morning and that would be a perfect time to download weather and traffic data.

keep27 · 05-13-2004, 02:17 PM

I sent out an email to the US dept of transportation basically asking them where to find real-time data, since the process of doing google searches over and over again was getting to be a real pain. The links they pointed me to seem promising, although sometimes it can take a little digging to find what you are looking for:

The National Traffic and Road Closure Information web site available on the Federal
Highway Administration (FHWA) web site has an interactive map of the United States
which will direct you to travel and traffic information by state:
http://www.fhwa.dot.gov/trafficinfo/index.htm#NATL

The FHWA home page is:
http://www.fhwa.dot.gov

veetid · 05-13-2004, 02:57 PM

I finally got my traffic program up and working. Basically I created an XML structure that I use to gather info from. Here is an example.

<CA>
<SAN>
<ROAD RDURL="http://www.sigalert.com/speeds.asp?Region=San+Diego&Road=5%20North">
<INTERSECTION>
<STREETNAME>Hawthorn St</STREETNAME>
<LAT>32.72712</LAT>
<LONG>-117.16722</LONG>
</INTERSECTION>
<INTERSECTION>
<STREETNAME>India St</STREETNAME>
<LAT>32.73199</LAT>
<LONG>-117.17146</LONG>
</INTERSECTION>
</ROAD>
</SAN>
</CA>

I then use the url in the road section to download the content and loop through the streetnames and scrape the current speed. I then add all the pushpins based on the lat/long in the xml and it looks awesome in mappoint. Basically I just did one Highway in Souther California right now. Getting the lat/longs is the only hard part. Mappoint is not accurate enough, because you have to be able to show the North and the South of one Interstate/Freeway. I marked all those exits with pushpins and then extracted the correct lat/longs just to make sure I could get it too work. I just installed MapMarker and I am going to attempt to build an application that will take intersections... streetname/highway and hopefully it will give me good lat/longs. Then with that program I can build all the XML files for all the regions and roads. Then you just have to have custom functions that do the parsing for each URL/Region. I have the parser written that will do all of CA. I also included some pictures of my Weather app. It gets the weather based on the current zipcode it gets from reverse geocoding lat/long from your GPS receiver.

Anyone used MapMarker for intersection geocoding?

keep27 · 05-13-2004, 03:26 PM

Veetid I really like what you have set up, it looks really good. I do have some comments though. You might be treading on thin ice with The Weather Channel by using their maps. I am friends with someone who worked there for about 10 yrs and from what I hear there are some people there that....well...you dont want to deal with. Besides there are plenty of other sources of weather data that you can do whatever you want with. Heck you can even copy and paste anything and everything from a national weather service site, turn around and sell it for $200/view, and it is completely legal. I can recommend a bunch of other sites, which if memory serves me, should be fairly easy to extract imagery from as well a whole bunch of other info like weather watches and warnings. Let me know what ya think.

veetid · 05-13-2004, 04:33 PM

The only thing I get from the Weather Channel is the radar image. All the other data comes from a different source that is setup for people to scrape. I don't plan on selling this to anyone ever.... Basically I modeled the weather scrape totally based on MythWeather. MythWeather is a linux application that retrieves weather information inside of Myth (a linux PVR system). MythWeather has been out on the internet since 2003 and has a large audience. They have had no issues, due to the fact that it is open source and no revenue is generated from the image... (Legally, if I am not selling, they can't do anything except try to make it harder for me to scrape, which they attempt to do, unsuccesfully.... Do you know how many sites on the internet grab and use that image.... thousands and thousands.... I would love to see weather.com try to do something to all those sites....)

Anyway.... If you give me a good url that allows me to pass in a postalcode (that includes non-us) and displays a good looking radar image, then I got no problems checking it out..

User Name		Remember Me?
Password