Page 1 of 6 123456 LastLast
Results 1 to 10 of 53

Thread: FrontEnd Benchmarks (Load times and Indexing speed)

  1. #1
    Raw Wave
    Auto Apps:loading...
    justchat_1's Avatar
    Join Date
    Jul 2008
    Location
    Boston, Ma or NY,NY
    Posts
    1,783

    FrontEnd Benchmarks (Load times and Indexing speed)

    Load Times:
    Ok as discussed in another thread there seemed to be some disagreement about various front end load times and one of the biggest problems was that different hardware was used. So to help out I have benchmarked load times of the various windows front ends on exactly the same setup.

    The test rig:
    Windows 7
    Dell Inspiron 1520
    500GB 7200rpm hard drive
    t7500 2.2Ghz Core2Duo
    2.0GB Ram

    The Test:
    Each front end was installed cleanly with no extra plugins...was configured and then started and run 3 times to ensure all the initial config was complete. All other processes on the system were stopped and the program was started by a custom test app. When the UI was visible and complete (Ride runner took an extra second to load button captions) I pressed F10 and the timer would stop. Each of the three runs was listed along with their average.

    The Results: (All times in seconds)


    Now obviously with different hardware the results will vary but I would imagine the spread would be the same on most setups.

    Media Index Speeds:
    The next item that was highly debated was media index speeds. This was a test to see how long it would take to index your media collection.

    The test rig:
    -Same as above-

    The Test:
    Each Software was cleanly installed ensuring it started with a brand new database. It was then directed to index a collection of 500 mp3s and the amount of time from start to finish was recorded. For two of the applications, the speeds were pretty quick so the applications were traced while running to ensure measured times were accurate. Each application was then directed to empty its database and the test was repeated another two times. As a final test each front end was told to index 10 corrupt files in an attempt to crash them. All the front ends successfully skipped the corrupted files without a problem.

    The Results:

    Analysis:
    For two of the front ends the first run was significantly longer then the second two. This is believed to be due to overhead from database creation and expansion. File indexing and pre-fetching may have also helped decrease times for the second and third runs.

    The software behind the indexing:
    FE Tag Reader Database
    StreetDeck Windows Media Player Windows Media Player Database
    Centrafuse Bass.Net Jet DB
    RoadRunnerMM MediaInfo SQLite (external exe)
    RevFE MediaInfo SQLite (dll)
    OpenMobile Optimized TagLib-Sharp SQLite (managed code)

  2. #2
    Variable Bitrate csfile's Avatar
    Join Date
    Feb 2009
    Posts
    274
    thanks for this...i hope CF3 is quicker than CF2

  3. #3
    North of the land of Hey Huns
    Auto Apps:loading...

    Join Date
    Jun 2004
    Location
    Westminster, MD
    Posts
    2,127
    While you're at it... you should benchmark the overall speed of the frontends. Screen changes, media loading, id3 scanning etc.
    "stop with the REINSTALLS, what do you think we got some lame-o installer!!!" - mitchjs
    RevFE
    My Shop

  4. #4
    Raw Wave
    Auto Apps:loading...
    justchat_1's Avatar
    Join Date
    Jul 2008
    Location
    Boston, Ma or NY,NY
    Posts
    1,783
    I can try hooking the windows messages and checking for UI idle but any of the front ends that do screen changes in the background would show times of 0 so that would be a tough one.

    Media loading is possible...im guessing you mean amount of time between when you click a song and hear sound out of the speakers? or something else?

    ID3 tagging is a good one too...what size collection do you think I should use? I have about 500,000 songs and don't really want to wait for that to be indexed 3 times per front end lol.

    50 songs? 500? 2000?

  5. #5
    FLAC Machinehead's Avatar
    Join Date
    Jun 2007
    Location
    hijacks small portable city
    Posts
    1,381
    Interesting coincidence that Open Mobile the front end the thread starter developed is the fastest loading of the 4 tested, or am I just a conspiracy theorist....

  6. #6
    North of the land of Hey Huns
    Auto Apps:loading...

    Join Date
    Jun 2004
    Location
    Westminster, MD
    Posts
    2,127
    Quote Originally Posted by Machinehead View Post
    Interesting coincidence that Open Mobile the front end the thread starter developed is the fastest loading of the 4 tested, or am I just a conspiracy theorist....
    It also has nowhere near the features or functionality of the other ones yet. RevFE loads in under 100ms without any functionality (plugins) too
    "stop with the REINSTALLS, what do you think we got some lame-o installer!!!" - mitchjs
    RevFE
    My Shop

  7. #7
    Raw Wave
    Auto Apps:loading...
    justchat_1's Avatar
    Join Date
    Jul 2008
    Location
    Boston, Ma or NY,NY
    Posts
    1,783
    Quote Originally Posted by Machinehead View Post
    Interesting coincidence that Open Mobile the front end the thread starter developed is the fastest loading of the 4 tested, or am I just a conspiracy theorist....
    I was expecting that to be the first post to be honest lol.....but hey anyone who wants to check the data feel free - I think we would all benefit from data from multiple setups.

    That said the reason it loads so fast (and wont get any slower as more plugins are added) is due to the architecture. Most of the front ends load and initialize every plugin before the first screen is shown. This means they get slower and slower as you add functionality.

    Open Mobile (and i though nGhost either does or was planning to) does it differently...only the first screen is initialized on the main thread....everything else initializes in the background. I really don't understand why commercial applications (aka streetdeck and centrafuse) have no idea how to use threads properly. RevFE I know loads each plugin on a separate thread and im sure if it did prioritized loading it could be in the same range or even better (given its c++ roots).

  8. #8
    North of the land of Hey Huns
    Auto Apps:loading...

    Join Date
    Jun 2004
    Location
    Westminster, MD
    Posts
    2,127
    Quote Originally Posted by justchat_1 View Post
    RevFE I know loads each plugin on a separate thread and im sure if it did prioritized loading it could be in the same range or even better (given its c++ roots).
    Interestingly enough, the threading of the plugins is advantageous to them while they run, not while they start. I load them synchronously, this is intentional. That's why I wanted you to test the other things I listed, because that's where RevFE excels. I'll bet it also uses more ram than any of the other FE's. That reminds me... do a ram and hard disc comparison too!
    "stop with the REINSTALLS, what do you think we got some lame-o installer!!!" - mitchjs
    RevFE
    My Shop

  9. #9
    Raw Wave
    Auto Apps:loading...
    justchat_1's Avatar
    Join Date
    Jul 2008
    Location
    Boston, Ma or NY,NY
    Posts
    1,783
    Quote Originally Posted by malcom2073 View Post
    Interestingly enough, the threading of the plugins is advantageous to them while they run, not while they start.
    Very true but my point was that it could be advantageous to both. If they are loaded synchronously theres no reason the main ui cant be rendered at the same time instead of waiting for them to load.

    Get back to me on my second post so I know how many songs to use and such for the other benchmarks... and yea i'll do a memory use comparison but drive space would be tough since it really depends on what skin is used and such. I'll always have you beat on that though :P

  10. #10
    North of the land of Hey Huns
    Auto Apps:loading...

    Join Date
    Jun 2004
    Location
    Westminster, MD
    Posts
    2,127
    Quote Originally Posted by justchat_1 View Post
    Very true but my point was that it could be advantageous to both. If they are loaded synchronously theres no reason the main ui cant be rendered at the same time instead of waiting for them to load.

    Get back to me on my second post so I know how many songs to use and such for the other benchmarks... and yea i'll do a memory use comparison but drive space would be tough since it really depends on what skin is used and such. I'll always have you beat on that though :P
    Of course you will, .net binaries are always super tiny

    I'd say 500 songs is a good test to get an average speed.

    For media loading, I mean both the time inbetween clicking a new file and hearing sound, as well as the time to load a playlist (of a set size, say 20-50 songs).
    "stop with the REINSTALLS, what do you think we got some lame-o installer!!!" - mitchjs
    RevFE
    My Shop

Page 1 of 6 123456 LastLast

Similar Threads

  1. FS: M10000, Morex 3688, 40GB 2.5", SLOT Load dvd/cdrw, 512mb ram
    By JuMpMaN6235 in forum Classified Archive
    Replies: 29
    Last Post: 07-13-2006, 10:53 AM
  2. wtb: slot load dvd rom full size
    By EsKALad in forum Classified Archive
    Replies: 0
    Last Post: 08-29-2005, 11:08 PM
  3. CF BETA 2 [1.3] Requests
    By camsgs3 in forum Centrafuse
    Replies: 169
    Last Post: 07-30-2005, 09:43 PM
  4. Auto Load Freedrive ???
    By tolisn in forum FreeDrive
    Replies: 5
    Last Post: 07-08-2005, 04:50 PM
  5. OPUS point of load
    By lostreception in forum Power Supplies
    Replies: 2
    Last Post: 06-15-2005, 10:46 AM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •