Coffeehouse Thread

7 posts

Huge speed improvements in Windows 8 unindexed folder/file-name  search

Back to Forum: Coffeehouse
  • User profile image
    androidi

    Just kidding, don't get your hopes up! Instead, while I was aware of closed source NTFS MFT search tools existing, I just became aware of completely open source MFT search tool - and while I haven't gone through every line I did some testing and cursory look at the source and I can atleast verify that it does what I expect.

    Two issues I found:

    1) It won't open physical volumes without assigned drive letters without some changes

    2) Since it's not meant to run at background or as service, updates require re-read of the MFT. Which can last few seconds. Beats the minutes wait for explorer search. Of course you might ask why my indexing isn't enabled. 1) It can run on the background even when I'm doing latency sensitive stuff as it's not too wise on what's user input and what's not on some external bus 2) Haven't tested lately but it used to get stale with quickly updating files.

    FACTS:

    - 1 TB hdd with million files can be searched in couple seconds (under 10) without background indexing using this tool

    - It takes explorer several MINUTES to do that without background indexing.

    http://sourceforge.net/projects/ntfs-search/

    (compiles fine with 2008 after changing the .ico name and removing the intermed. manifest)

     

  • User profile image
    androidi

    I also discovered this project which aims to do the obvious, that is to combine the fast MFT read with the USN journal. http://mftscanner.codeplex.com/

    So when everything works as planned, you should only need to do the 5-10 second MFT scan once after booting, and further use will access the cached name records and the change journal.

    By my understanding this approach allows practically instant file search completely without indexing and background stuff running. The only question is, why none of this is provided to explorer users!

  • User profile image
    W3bbo

    This does look interesting; thanks for the link. I may use it when I get round to building my new media management tool (because I get tired of waiting for WMP and Winamp to scan my directories, and of iTunes mashing my files up).

  • User profile image
    Harlequin

    ,W3bbo wrote

    This does look interesting; thanks for the link. I may use it when I get round to building my new media management tool (because I get tired of waiting for WMP and Winamp to scan my directories, and of iTunes mashing my files up).

    I just had a Spectate Swamp mushroom flashback =)

  • User profile image
    Dr Herbie

    @Harlequin: Shhh!  If you say his name three times, he appears!

    Herbie

  • User profile image
    stun

    ,Dr Herbie wrote

    @Harlequin: Shhh!  If you say his name three times, he appears!

    Herbie

    Ludacris?  "How low can you go?"  Tongue Out

  • User profile image
    W3bbo

    ,androidi wrote

    http://sourceforge.net/projects/ntfs-search/

    (compiles fine with 2008 after changing the .ico name and removing the intermed. manifest)

    I just built and ran it (after a few build tweaks like as you described) and all I can say is "wow". This is a really good piece of work and, yes, makes me weep for Microsoft again.

    Can you explain the USN stuff in simple terms for me, what does the C# scanner do that this C++ program doesn't?

Comments closed

Comments have been closed since this content was published more than 30 days ago, but if you'd like to continue the conversation, please create a new thread in our Forums, or Contact Us and let us know.