Coffeehouse Thread

7 posts

Forum Read Only

This forum has been made read only by the site admins. No new threads or comments can be added.

Huge speed improvements in Windows 8 unindexed folder/file-name  search

Back to Forum: Coffeehouse
  • User profile image
    androidi

    Just kidding, don't get your hopes up! Instead, while I was aware of closed source NTFS MFT search tools existing, I just became aware of completely open source MFT search tool - and while I haven't gone through every line I did some testing and cursory look at the source and I can atleast verify that it does what I expect.

    Two issues I found:

    1) It won't open physical volumes without assigned drive letters without some changes

    2) Since it's not meant to run at background or as service, updates require re-read of the MFT. Which can last few seconds. Beats the minutes wait for explorer search. Of course you might ask why my indexing isn't enabled. 1) It can run on the background even when I'm doing latency sensitive stuff as it's not too wise on what's user input and what's not on some external bus 2) Haven't tested lately but it used to get stale with quickly updating files.

    FACTS:

    - 1 TB hdd with million files can be searched in couple seconds (under 10) without background indexing using this tool

    - It takes explorer several MINUTES to do that without background indexing.

    http://sourceforge.net/projects/ntfs-search/

    (compiles fine with 2008 after changing the .ico name and removing the intermed. manifest)

     

  • User profile image
    androidi

    I also discovered this project which aims to do the obvious, that is to combine the fast MFT read with the USN journal. http://mftscanner.codeplex.com/

    So when everything works as planned, you should only need to do the 5-10 second MFT scan once after booting, and further use will access the cached name records and the change journal.

    By my understanding this approach allows practically instant file search completely without indexing and background stuff running. The only question is, why none of this is provided to explorer users!

  • User profile image
    W3bbo

    This does look interesting; thanks for the link. I may use it when I get round to building my new media management tool (because I get tired of waiting for WMP and Winamp to scan my directories, and of iTunes mashing my files up).

  • User profile image
    Harlequin

    ,W3bbo wrote

    This does look interesting; thanks for the link. I may use it when I get round to building my new media management tool (because I get tired of waiting for WMP and Winamp to scan my directories, and of iTunes mashing my files up).

    I just had a Spectate Swamp mushroom flashback =)

  • User profile image
    Dr Herbie

    @Harlequin: Shhh!  If you say his name three times, he appears!

    Herbie

  • User profile image
    stun

    ,Dr Herbie wrote

    @Harlequin: Shhh!  If you say his name three times, he appears!

    Herbie

    Ludacris?  "How low can you go?"  Tongue Out

  • User profile image
    W3bbo

    ,androidi wrote

    http://sourceforge.net/projects/ntfs-search/

    (compiles fine with 2008 after changing the .ico name and removing the intermed. manifest)

    I just built and ran it (after a few build tweaks like as you described) and all I can say is "wow". This is a really good piece of work and, yes, makes me weep for Microsoft again.

    Can you explain the USN stuff in simple terms for me, what does the C# scanner do that this C++ program doesn't?

Conversation locked

This conversation has been locked by the site admins. No new comments can be made.