Sponsored links

Go Back   MP3Car.com > Mp3Car Technical > Crowdsourced Data Collection, Open Source Mapping And Routing


Reply
 
Share Thread Tools Display Modes
Old 07-09-2009, 11:38 AM   #31
Variable Bitrate
 
thekl0wn's Avatar
 
Join Date: Apr 2005
Location: PoCo, Indiana
Posts: 247
thekl0wn is on a distinguished road
So, what's the entire project's acronym? We can't go any further without a catchy acronym to reference the project.
__________________
Planning [----X-----] 40%
Programming [-X-------] 20%
Parts [-----X----] 50%
Install [X--------] 5%

See Me In A Pink Skirt
thekl0wn is offline   Reply With Quote
Sponsored links
Advertisement
 
Advertisement
Old 08-18-2009, 05:48 PM   #32
Variable Bitrate
 
lambosprit's Avatar
 
Join Date: Sep 2006
Location: UK
Posts: 447
lambosprit is on a distinguished road
Just wondered if I can be of help.

I already have a tracking software developed that could be changed to collect the data your after. It already works by internet or wifi and works on an sqllite database.

I found out alot about nmea strings on this site. Hugely helpful.

http://www.codeproject.com/KB/mobile...ications1.aspx

One of the key things I found out about was accuracy. Each nmea string has its own variable of how accurate it is so its easy to set a level of accuracy to consider worth collecting or not.

anyway if you need me I'm here and interested.
lambosprit is offline   Reply With Quote
Old 08-19-2009, 09:53 AM   #33
darth sidious lite
 
Fiberoptic's Avatar
 
Join Date: Jul 1978
Location: Baltimore, MD
Posts: 1,181
Blog Entries: 128
Fiberoptic will become famous soon enoughFiberoptic will become famous soon enough
Quote: Originally Posted by lambosprit View Post
Just wondered if I can be of help.

I already have a tracking software developed that could be changed to collect the data your after. It already works by internet or wifi and works on an sqllite database.


That is great! Do you have any more details on this?
__________________
Check out our video blog. 100 videos and counting
Fiberoptic is offline   Reply With Quote
Old 08-19-2009, 12:36 PM   #34
Variable Bitrate
 
thekl0wn's Avatar
 
Join Date: Apr 2005
Location: PoCo, Indiana
Posts: 247
thekl0wn is on a distinguished road
There's some good info in that article! Thanks for posting!
__________________
Planning [----X-----] 40%
Programming [-X-------] 20%
Parts [-----X----] 50%
Install [X--------] 5%

See Me In A Pink Skirt
thekl0wn is offline   Reply With Quote
Old 08-19-2009, 04:57 PM   #35
Variable Bitrate
 
lambosprit's Avatar
 
Join Date: Sep 2006
Location: UK
Posts: 447
lambosprit is on a distinguished road
Quote: Originally Posted by Fiberoptic View Post
That is great! Do you have any more details on this?

what details do you want?

You can check it out here

http://www.mp3car.com/vbulletin/gps/...me-server.html
lambosprit is offline   Reply With Quote
Old 08-20-2009, 11:31 AM   #36
Variable Bitrate
 
lambosprit's Avatar
 
Join Date: Sep 2006
Location: UK
Posts: 447
lambosprit is on a distinguished road
I've been thinking more about this. I concentrated on the issue of privacy because I think to get the large number of people required to get this to work its going to have to be private.

Its possible for me to modify my software so that each user gets an automatically generated user id. Nobody would have any idea who the user was as no personnel details are collected and you don’t have to log onto a site first. This could be like a GUID key. I know its technically possible to trace these but isn’t everything.

I could then get the client (or server) to update the ftp site through a proxy site. That way there’s no tracing of ip’s.

Speed could be sent to the server as a range so >30mph rather than an actual value. These could be the major speed limits so for the uk it would be >30,>60, and 70 of course.

Lastly I could implement a random removal of points that could identify location. I think this last point could be removed over time as more of the map is fleshed out.

I think you’d also need to get the big skin people on board as well. If the likes of DigitalFX , Lsx Void and CF (I know its not a skin) where involved then the distribution would go up hugely (my software has been download <100 times that’s not gong to make for a great map!)

Getting thunderstick interested with his sign recognition software would be a major step on the way as well as nobodies going to be interested in imputing data as they drive.
lambosprit is offline   Reply With Quote
Old 08-20-2009, 04:04 PM   #37
FLAC
 
soundman98's Avatar
 
Join Date: Jan 2008
Location: on the border of northern IL/IN
Posts: 926
soundman98 is a jewel in the roughsoundman98 is a jewel in the roughsoundman98 is a jewel in the roughsoundman98 is a jewel in the rough
one of my concerns would be the random data cuttoff-- i think that this would still need to be used even after there were alot of people using it--ie. i would never want people to see my driveway as part of the map, and possibly get routed down it.

the other issue, while not that big of a deal for me, is that some members would like a link to be added to their signature to show how many tracks they have uploaded. like i said, this is not a big deal for me(i am fine with just a 'mp3car map data contributer' title in my sig). maybe there could be some sort of link that would update with the user upload account that the member could specify.

i would be happy to contribute as long as the a random data cutoff is used, and there is no personal data connecting me to any specific upload, so i don't have to worry about getting tickets based on my uploaded data.

Last edited by soundman98; 08-20-2009 at 04:07 PM. Reason: add stuff
soundman98 is offline   Reply With Quote
Old 08-20-2009, 05:00 PM   #38
Admin. Don't bug or I'll byte.
 
Bugbyte's Avatar
 
Join Date: Sep 2004
Location: Corning, NY
Posts: 6,143
Bugbyte is a splendid one to beholdBugbyte is a splendid one to beholdBugbyte is a splendid one to beholdBugbyte is a splendid one to beholdBugbyte is a splendid one to beholdBugbyte is a splendid one to beholdBugbyte is a splendid one to behold
Quote: Originally Posted by lambosprit View Post
I've been thinking more about this. I concentrated on the issue of privacy because I think to get the large number of people required to get this to work its going to have to be private.

Its possible for me to modify my software so that each user gets an automatically generated user id. Nobody would have any idea who the user was as no personnel details are collected and you don’t have to log onto a site first. This could be like a GUID key. I know its technically possible to trace these but isn’t everything.

I could then get the client (or server) to update the ftp site through a proxy site. That way there’s no tracing of ip’s.

These are good ideas! I think they represent a good balance of usability and privacy. If possible, it would be good to allow people to obfuscate their tracks parametrically. Heh-heh. I said parametrically. What I mean is there should be options to share more or less data that can be set by the user. So, one checkbox might be 'only share data after 3 minutes of travel' and the user can set that to whatever he/she wants. Another might be 'don't share data within x miles of this location'.

I wouldn't have too may of these restrictions and maybe just something like a "share a lot of data" or "share less data" setting for users to help them out.
__________________
Want to:
-Find out about the iBug?
-Stop being a newbie? Take a look at the FAQ Emporium?
-Find out about carPC's in just 5 minutes? View the Car PC 101 video
-Help me kill my car PC
-Watch live video streams from my mobile PC? Check it out here.
-Where is the iBug?
Bugbyte is offline   Reply With Quote
Sponsored links
Advertisement
 
Advertisement
Old 08-20-2009, 06:09 PM   #39
Variable Bitrate
 
lambosprit's Avatar
 
Join Date: Sep 2006
Location: UK
Posts: 447
lambosprit is on a distinguished road
Quote: Originally Posted by soundman98 View Post
the other issue, while not that big of a deal for me, is that some members would like a link to be added to their signature to show how many tracks they have uploaded. like i said, this is not a big deal for me(i am fine with just a 'mp3car map data contributer' title in my sig). maybe there could be some sort of link that would update with the user upload account that the member could specify.

well we could allow that. It just needs the member to supply their guid to the site. Then the site could show the uploaded miles etc. Kind of an opt in.

Quote: Originally Posted by soundman98 View Post
i would be happy to contribute as long as the a random data cutoff is used, and there is no personal data connecting me to any specific upload, so i don't have to worry about getting tickets based on my uploaded data.

No probs with that. As I said I think this is the major issue. If people feel safe they'll sign up and give loads of data. If they dont they wont touch it.
lambosprit is offline   Reply With Quote
Old 08-20-2009, 06:13 PM   #40
Variable Bitrate
 
lambosprit's Avatar
 
Join Date: Sep 2006
Location: UK
Posts: 447
lambosprit is on a distinguished road
Quote: Originally Posted by Bugbyte View Post
These are good ideas! I think they represent a good balance of usability and privacy. If possible, it would be good to allow people to obfuscate their tracks parametrically. Heh-heh. I said parametrically. What I mean is there should be options to share more or less data that can be set by the user. So, one checkbox might be 'only share data after 3 minutes of travel' and the user can set that to whatever he/she wants. Another might be 'don't share data within x miles of this location'.

I wouldn't have too may of these restrictions and maybe just something like a "share a lot of data" or "share less data" setting for users to help them out.

Parametrising is not a problem. It could be kept as simple as "I like my privacy" or "I'm not bothered".

The other thought I've had is more people don't have internet in the car than do. I suspect most have wifi though. Do you think we could rely on this or would it be better to have an off line mode , say file and another little app that uploads the data from a desktop. Trying to keep things simple and easy to use here.
lambosprit is offline   Reply With Quote
Old 08-20-2009, 09:20 PM   #41
Admin. Don't bug or I'll byte.
 
Bugbyte's Avatar
 
Join Date: Sep 2004
Location: Corning, NY
Posts: 6,143
Bugbyte is a splendid one to beholdBugbyte is a splendid one to beholdBugbyte is a splendid one to beholdBugbyte is a splendid one to beholdBugbyte is a splendid one to beholdBugbyte is a splendid one to beholdBugbyte is a splendid one to behold
Definitely an offline mode. There will be times when you lose the data connection even if you have internet in the car. It should be robust and able to recover from signal loss.

As for having or not having connectivity, can it be written so that it uses the available net connection? My iPhone is able to switch from WiFi to Edge pretty seamlessly without intervention.
__________________
Want to:
-Find out about the iBug?
-Stop being a newbie? Take a look at the FAQ Emporium?
-Find out about carPC's in just 5 minutes? View the Car PC 101 video
-Help me kill my car PC
-Watch live video streams from my mobile PC? Check it out here.
-Where is the iBug?
Bugbyte is offline   Reply With Quote
Old 08-21-2009, 06:00 AM   #42
Variable Bitrate
 
lambosprit's Avatar
 
Join Date: Sep 2006
Location: UK
Posts: 447
lambosprit is on a distinguished road
Quote: Originally Posted by Bugbyte View Post
Definitely an offline mode. There will be times when you lose the data connection even if you have internet in the car. It should be robust and able to recover from signal loss.

As for having or not having connectivity, can it be written so that it uses the available net connection? My iPhone is able to switch from WiFi to Edge pretty seamlessly without intervention.

I dont think I was clear. My current app keeps the server updated when ever there is an internet connection (either wifi or other). It has all the robustness etc you talk about as well, however I dont see the point of live updates. What I see is it creating a log that gets sent to the ftp site.

Now my question was whether we can rely on sending the log via the car (I guess this is ok because most people have atleast wifi) or we need a standalone app where the logged data can be removed from the car and sent to the ftp site from any desktop.

for you personnally it would just use your cars net connection but what if you didn't have any way of connecting from the car. Do you think you would be bothered to take data from the car and send it manually? I can do both so the point's mute but I was interested how easy it should be made.

Last question. My app stores everything in an sqlite database (its free). If this was sent to the ftp site would you be able to use it or does it have to be in another format (I used xml for the first versions of my app but it had issues)
lambosprit is offline   Reply With Quote
Old 09-02-2009, 12:01 PM   #43
darth sidious lite
 
Fiberoptic's Avatar
 
Join Date: Jul 1978
Location: Baltimore, MD
Posts: 1,181
Blog Entries: 128
Fiberoptic will become famous soon enoughFiberoptic will become famous soon enough
Quote: Originally Posted by lambosprit View Post
however I dont see the point of live updates.

Live updates will allow you to watch traffic trends which is going to be an important part of getting a critical mass of users (see waze post in the same forum). It is also interesting to look at Waze's privacy policy.
__________________
Check out our video blog. 100 videos and counting

Last edited by Fiberoptic; 09-02-2009 at 12:04 PM.
Fiberoptic is offline   Reply With Quote
Old 09-02-2009, 12:44 PM   #44
FLAC
 
soundman98's Avatar
 
Join Date: Jan 2008
Location: on the border of northern IL/IN
Posts: 926
soundman98 is a jewel in the roughsoundman98 is a jewel in the roughsoundman98 is a jewel in the roughsoundman98 is a jewel in the rough
i think that the waze idea has some great points, and live updating could become a great asset later on, but, like you said in the other thread, there is just too much 'big brother' mentality in that project...and it looks like it requires a constant connection.

lambosprit: after re-reading your last post i would say that i would prefer to control when the program sends the data-- i have configured my wifi card to automaticaly connect a couple of access points along my way into work, but becasue i am still driving, internet goes in and out very quickly, and for a app like this, i think that while it would not pose a immediate threat, it could cause issues later on with data corruption from partially sent info.

also, how easy would it be to reconfigure the program to use the features of the server program(random data cutoff, logging, etc.) on the car side, and keep the server side 'dumb'-- where it only looks for a certain access code/login, and then allows the upload?
soundman98 is offline   Reply With Quote
Old 09-04-2009, 12:29 PM   #45
Variable Bitrate
 
lambosprit's Avatar
 
Join Date: Sep 2006
Location: UK
Posts: 447
lambosprit is on a distinguished road
Quote: Originally Posted by soundman98 View Post
lambosprit: after re-reading your last post i would say that i would prefer to control when the program sends the data-- i have configured my wifi card to automaticaly connect a couple of access points along my way into work, but becasue i am still driving, internet goes in and out very quickly, and for a app like this, i think that while it would not pose a immediate threat, it could cause issues later on with data corruption from partially sent info.

also, how easy would it be to reconfigure the program to use the features of the server program(random data cutoff, logging, etc.) on the car side, and keep the server side 'dumb'-- where it only looks for a certain access code/login, and then allows the upload?

I'm spending a couple of weeks abroad soon so intend to make some progress on this.

My list of tasks is

1) Convert my client to give each user an automatically generated user id.
2) Provide data to mp3's ftp server through a proxy site.
3) Allow user to specify if updates to ftp are automatic (whenever a network connection exists) , a user defined time (each day) or manually. Data corruption shouldn't be a problem as I check for that, may be a different story using ftp though, have to see.
4) Data collected would be user guid, lat, lng, alt, sequence (replaces date). Possibly some other stuff , see below. It will also be collected every minute regardless of user settings. (I may make this speed related to cut down data load) so we have a referance to time. Data accuracy setting will also be hard coded so we have control over what data is collected. I will leave the user setting for them to change what data they wish to use but for this project we need to set the limits.
5) I'll allow a user to decide if he is privacy mad or not and allow a random point removal setting.

I know we want real updates on traffic flow etc in the future but for now I think getting the maps up and running is the most important so I won't collect current speed and an accurate date/time.

What I'm then going to do is work on sign recognition. I dont think speed limits are the important thing for now although if things go well I'll try and do this. What I think we need is understanding road signs that tell you where you are like road names and numbers. I've researched it and it looks doable and it'll be fun to try. What I hope to get is road names, number of roads off junction/roundabout (I'm UK based but will make it any country configurable I hope), type of junction etc.

Now this last bit may be beyond my capabilities but I'm up for trying.

As for privacy statements I think we should make this a free for ever thing. I used to use pocketgps but was pretty miffed when they privatised all that freely collected data for their own benifit.
lambosprit is offline   Reply With Quote
Sponsored links
Advertisement
 
Advertisement
Reply

Bookmarks

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
iBusRR v2.0.5: 06/01/2008 BMW Doors/Windows/Lights control NEW RELEASE!! WaRFiElD RR Released Plugins 384 10-14-2009 11:44 AM
Interview Mathieu Monney, creator of XGPS iPhone navigation application Fiberoptic Mp3Car Blog Talk 7 04-06-2009 05:14 PM
Can you guys please help me??? OBD Renault Clio help needed! madtoonbull Engine Management, OBD-II, Engine Diagnostics, etc. 7 02-19-2009 11:36 AM
Pinout Color Codes / Tables gummybear General Hardware Discussion 4 05-12-2005 04:05 AM
VOICES Traffic Data stevieg V.O.I.C.E.S 85 05-31-2004 09:24 PM



All times are GMT -5. The time now is 07:18 AM.


Powered by vBulletin® Version 3.8.4
Copyright ©2000 - 2009, Jelsoft Enterprises Ltd.
Content Relevant URLs by vBSEO 3.3.2
Copyright © 1999 - 2008 Mp3Car.com Inc.Ad Management by RedTyger
Message Board Statistics