Page 1 of 2 12 LastLast
Results 1 to 10 of 14

Thread: rsync and CF

  1. #1
    Low Bitrate
    Join Date
    Mar 2004
    Posts
    62

    rsync and CF

    I've been experimenting with synching my music library from my Mac OS X Tiger laptop and my CarPC. It works GREAT using rsync.

    rsync is a command line tool (open source) that is amazingly efficient and fast at synching remote directories.

    I've got rsync running as a daemon on my laptop, and I execute a .bat file that I've made on the carPC it will wirelessly connect to my laptop and synch only changed files automagically. It's brilliant. No more painful copying.

    This is why I've also asked David to impliment iTunes library support (on the Flux forums), because if this is done users that use iTunes to manage their home library will NEVER have to update tag information as the itunes library file will get updated with each rsync. It would be great if CF had this feature as rescanning the directory each time I add music is a timely procedure...

    If anyone would like more information on how to set up rsync let me know.

    BTW. the iTunes library file is XML and super easy to read.

    Mark
    --
    1997 Acura 1.6 EL
    Ampie Case, Epia SP13000, 1G ram, 80g 2.5" HDD, Tripnav GPS, Lilliput 7" Touchscreen, M1-ATX

  2. #2
    Low Bitrate TechToy's Avatar
    Join Date
    Apr 2004
    Posts
    75
    i would agree, a command line interface to update the database would be nice.
    as an added bonus a switch that you could pass to it to shut down the system after it updates the database.
    TechToy
    2005 Explorer
    Proudly using Centrafuse

    DWW-700M + Sony XM-SD46S &
    pre-amp, XM100D
    and Icom PC1000
    Yaesu 7100M
    Kenwood TM-641

  3. #3
    Newbie
    Join Date
    May 2005
    Location
    Glasgow, Scotland
    Posts
    28

    Rsync for XP

    Hi babazoid,

    I would like to try Rsync, but I can't find a version for XP, only for Linux/Unix.

    Can you post a link where I can get it?

    Thanks,
    Micke

  4. #4
    Low Bitrate Bokky's Avatar
    Join Date
    Jan 2005
    Location
    Ham, Belgium
    Posts
    76
    You have to install Cygwin on your windows pc, only the rsync exe is possible also but I believe you then have to fiddle first with DLL's etc... so it can run the code.
    But having cygwin installed on you carpc is a luxory is you are used to work with linux, so you can do a lot of nice tricks with it.

    A few month ago I planned to write sometinhg that generates the music database file on a server or so and then rsync everything to my carpc everytime I have a internet connection (wifi, gprs..) It is not yet ready cause I do not have much time anymore and I have to generate the music db on a linux machine but now with CF1.3x out I will try to get it out of the dust again.

    For those who do not know rsync: It only copies the difference between files (even binary) so very low bandwith needed!! So a 10GB archive need to be synced and only for xmpl a filename is changed then is is synced in 1-2 sec's.

    For those who do not know what Cygwin is: Cywin is a Linux enviroment which can be ran on a windows machine. Mainly command line tools are available but also a grafical desktop is possible. It just brings me to the idea to try to embad cygwin desktop into CF13
    EPIA M10K, 512MB RAM, 60GB
    [##########] 100% (since 1 March 2005)

    snowboarding.be - bokky.com

  5. #5
    Low Bitrate
    Join Date
    Mar 2004
    Posts
    62
    Quote Originally Posted by Micke
    Hi babazoid,

    I would like to try Rsync, but I can't find a version for XP, only for Linux/Unix.

    Can you post a link where I can get it?

    Thanks,
    Micke
    This is a package of what you need, docs are on the site...

    http://www.itefix.no/phpws/index.php...position=23:23

    Let me know if you need help configuring it.

    Mark
    --
    1997 Acura 1.6 EL
    Ampie Case, Epia SP13000, 1G ram, 80g 2.5" HDD, Tripnav GPS, Lilliput 7" Touchscreen, M1-ATX

  6. #6
    Maximum Bitrate zPilott's Avatar
    Join Date
    Jul 2004
    Location
    Austin
    Posts
    509
    rsync is great, but it is mainly designed for making copies of a master filesystem. As soon as I move into my house (and have WiFi in the garage) I am going to be looking at Unison, it uses the rsync technology, but is designed for keeping two different locations in sync, so you can make changes at either end.

    btw, approximately how quickly does it run if there are no changes, and how many files/GB are you syncing? What speed is your WiFi?

    Thanks!

    |V1 Virtual Display|

    Hard work often pays off over time, laziness always pays off right now.

  7. #7
    Low Bitrate
    Join Date
    Mar 2004
    Posts
    62
    Quote Originally Posted by zPilott
    rsync is great, but it is mainly designed for making copies of a master filesystem. As soon as I move into my house (and have WiFi in the garage) I am going to be looking at Unison, it uses the rsync technology, but is designed for keeping two different locations in sync, so you can make changes at either end.

    btw, approximately how quickly does it run if there are no changes, and how many files/GB are you syncing? What speed is your WiFi?

    Thanks!
    And tar was designed to put files together to be stored on tape Obviously some tools transcend their original design. I would have to disagree that rsync isn't suited to keeping two directories in sync, it's works perfectly!

    Wirelessly I get speeds of about 1 MB/s, I just tested it and it took 1m 36s to transfer a 106,557,568 byte file (1050570 bytes/sec to be precise) Wired, using a crossover cable I get speeds of about 8MB/s.

    If there is nothing to update it takes about half a second to complete the sync process.

    Mark
    --
    1997 Acura 1.6 EL
    Ampie Case, Epia SP13000, 1G ram, 80g 2.5" HDD, Tripnav GPS, Lilliput 7" Touchscreen, M1-ATX

  8. #8
    Maximum Bitrate zPilott's Avatar
    Join Date
    Jul 2004
    Location
    Austin
    Posts
    509
    Quote Originally Posted by babazoid
    And tar was designed to put files together to be stored on tape Obviously some tools transcend their original design. I would have to disagree that rsync isn't suited to keeping two directories in sync, it's works perfectly!

    Wirelessly I get speeds of about 1 MB/s, I just tested it and it took 1m 36s to transfer a 106,557,568 byte file (1050570 bytes/sec to be precise) Wired, using a crossover cable I get speeds of about 8MB/s.

    If there is nothing to update it takes about half a second to complete the sync process.

    Mark
    I'm not saying that it can't work, what I am saying is that rsync compares A and B and fixes up B to look like A.

    I am personally interested in unison, because I have used rsync, and it is great, but I want to be able to make changes on both ends, and have the changes propagated to both ends.


    from the unison website:
    What are the differences between Unison and rsync?
    Rsync is a mirroring tool; Unison is a synchronizer. That is, rsync needs to be told ``this replica contains the true versions of all the files; please make the other replica look exactly the same.'' Unison is capable of recognizing updates in both replicas and deciding which way they should be propagated.
    Both Unison and rsync use the so-called ``rsync algorithm,'' by Andrew Tridgell and Paul Mackerras, for performing updates. This algorithm streamlines updates in small parts of large files by transferring only the parts that have changed.
    Anyway, I agree with the idea, "if it ain't broke, don't fix it" but that doesn't mean that there may be a better way out there, and that is why many of us are here on the forums for; to find out options and see if any of them might be better for us.

    |V1 Virtual Display|

    Hard work often pays off over time, laziness always pays off right now.

  9. #9
    Maximum Bitrate zPilott's Avatar
    Join Date
    Jul 2004
    Location
    Austin
    Posts
    509
    how many files/MB are you syncing? my main concern is for a fast sycn when there are NO changes (i.e. most of the time)

    |V1 Virtual Display|

    Hard work often pays off over time, laziness always pays off right now.

  10. #10
    Low Bitrate
    Join Date
    Mar 2004
    Posts
    62
    Quote Originally Posted by zPilott
    I'm not saying that it can't work, what I am saying is that rsync compares A and B and fixes up B to look like A.

    I am personally interested in unison, because I have used rsync, and it is great, but I want to be able to make changes on both ends, and have the changes propagated to both ends.


    from the unison website:

    Anyway, I agree with the idea, "if it ain't broke, don't fix it" but that doesn't mean that there may be a better way out there, and that is why many of us are here on the forums for; to find out options and see if any of them might be better for us.
    it's entirely possible to make changes on both ends and have rsync sync them up.

    you just need to "pull" down the data from the server, once that is complete you'll have all the data the server had. then you run your client in push mode -- it will push up all the changes on the client. viola, sync.

    rsync only deletes files that aren't on the server if you use the --delete option.

    mark
    --
    1997 Acura 1.6 EL
    Ampie Case, Epia SP13000, 1G ram, 80g 2.5" HDD, Tripnav GPS, Lilliput 7" Touchscreen, M1-ATX

Page 1 of 2 12 LastLast

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •