Channel 9 Forums - Coffeehouse - Huge speed improvements in Windows 8 unindexed folder/file-name search http://mschnlnine.vo.llnwd.net/d1/Dev/App_Themes/C9/images/feedimage.png Channel 9 Forums - Coffeehouse - Huge speed improvements in Windows 8 unindexed folder/file-name search http://channel9.msdn.com/Forums Channel 9 keeps you up to date with the latest news and behind the scenes info from Microsoft that developers love to keep up with. From LINQ to SilverLight – Watch videos and hear about all the cool technologies coming and the people behind them. http://channel9.msdn.com/Forums en Fri, 24 May 2013 22:38:50 GMT Fri, 24 May 2013 22:38:50 GMT Rev9 7 -7 -1 Coffeehouse - Huge speed improvements in Windows 8 unindexed folder/file-name search Just kidding, don't get your hopes up! Instead, while I was aware of closed source NTFS MFT search tools existing, I just became aware of completely open source MFT search tool - and while I haven't gone through every line I did some testing and cursory look at the source and I can atleast verify that it does what I expect.

Two issues I found:

1) It won't open physical volumes without assigned drive letters without some changes

2) Since it's not meant to run at background or as service, updates require re-read of the MFT. Which can last few seconds. Beats the minutes wait for explorer search. Of course you might ask why my indexing isn't enabled. 1) It can run on the background even when I'm doing latency sensitive stuff as it's not too wise on what's user input and what's not on some external bus 2) Haven't tested lately but it used to get stale with quickly updating files.

FACTS:

- 1 TB hdd with million files can be searched in couple seconds (under 10) without background indexing using this tool

- It takes explorer several MINUTES to do that without background indexing.

http://sourceforge.net/projects/ntfs-search/

(compiles fine with 2008 after changing the .ico name and removing the intermed. manifest)

 

]]> http://channel9.msdn.com/Forums/Coffeehouse/Huge-speed-improvements-in-Windows-8-unindexed-folderfile-name-search/c5ed531638c844f4a5639f38000db5c9#c5ed531638c844f4a5639f38000db5c9 Sun, 07 Aug 2011 00:49:55 GMT http://channel9.msdn.com/Forums/Coffeehouse/Huge-speed-improvements-in-Windows-8-unindexed-folderfile-name-search/c5ed531638c844f4a5639f38000db5c9#c5ed531638c844f4a5639f38000db5c9 androidi 7 http://channel9.msdn.com/Niners/androidi/Discussions/RSS Coffeehouse - Huge speed improvements in Windows 8 unindexed folder/file-name search I also discovered this project which aims to do the obvious, that is to combine the fast MFT read with the USN journal. http://mftscanner.codeplex.com/

So when everything works as planned, you should only need to do the 5-10 second MFT scan once after booting, and further use will access the cached name records and the change journal.

By my understanding this approach allows practically instant file search completely without indexing and background stuff running. The only question is, why none of this is provided to explorer users!

]]> http://channel9.msdn.com/Forums/Coffeehouse/Huge-speed-improvements-in-Windows-8-unindexed-folderfile-name-search/a89b236fc68f4b4f939d9f38001704e2#a89b236fc68f4b4f939d9f38001704e2 Sun, 07 Aug 2011 01:23:48 GMT http://channel9.msdn.com/Forums/Coffeehouse/Huge-speed-improvements-in-Windows-8-unindexed-folderfile-name-search/a89b236fc68f4b4f939d9f38001704e2#a89b236fc68f4b4f939d9f38001704e2 androidi 7 http://channel9.msdn.com/Niners/androidi/Discussions/RSS Coffeehouse - Huge speed improvements in Windows 8 unindexed folder/file-name search This does look interesting; thanks for the link. I may use it when I get round to building my new media management tool (because I get tired of waiting for WMP and Winamp to scan my directories, and of iTunes mashing my files up).

]]> http://channel9.msdn.com/Forums/Coffeehouse/Huge-speed-improvements-in-Windows-8-unindexed-folderfile-name-search/71d27ec9ef6e4392ac0b9f380125b75c#71d27ec9ef6e4392ac0b9f380125b75c Sun, 07 Aug 2011 17:49:23 GMT http://channel9.msdn.com/Forums/Coffeehouse/Huge-speed-improvements-in-Windows-8-unindexed-folderfile-name-search/71d27ec9ef6e4392ac0b9f380125b75c#71d27ec9ef6e4392ac0b9f380125b75c W3bbo 7 http://channel9.msdn.com/Niners/W3bbo/Discussions/RSS Coffeehouse - Huge speed improvements in Windows 8 unindexed folder/file-name search

,W3bbo wrote

This does look interesting; thanks for the link. I may use it when I get round to building my new media management tool (because I get tired of waiting for WMP and Winamp to scan my directories, and of iTunes mashing my files up).

I just had a Spectate Swamp mushroom flashback =)

]]> http://channel9.msdn.com/Forums/Coffeehouse/Huge-speed-improvements-in-Windows-8-unindexed-folderfile-name-search/3f3dce32aaa54f35b9759f3900f54482#3f3dce32aaa54f35b9759f3900f54482 Mon, 08 Aug 2011 14:52:59 GMT http://channel9.msdn.com/Forums/Coffeehouse/Huge-speed-improvements-in-Windows-8-unindexed-folderfile-name-search/3f3dce32aaa54f35b9759f3900f54482#3f3dce32aaa54f35b9759f3900f54482 Harlequin 7 http://channel9.msdn.com/Niners/Harlequin/Discussions/RSS Coffeehouse - Huge speed improvements in Windows 8 unindexed folder/file-name search @Harlequin: Shhh!  If you say his name three times, he appears!

Herbie

]]> http://channel9.msdn.com/Forums/Coffeehouse/Huge-speed-improvements-in-Windows-8-unindexed-folderfile-name-search/b751b910e1d9401b88cd9f3900f73f1f#b751b910e1d9401b88cd9f3900f73f1f Mon, 08 Aug 2011 15:00:11 GMT http://channel9.msdn.com/Forums/Coffeehouse/Huge-speed-improvements-in-Windows-8-unindexed-folderfile-name-search/b751b910e1d9401b88cd9f3900f73f1f#b751b910e1d9401b88cd9f3900f73f1f Herbie Smith 7 http://channel9.msdn.com/Niners/Dr Herbie/Discussions/RSS Coffeehouse - Huge speed improvements in Windows 8 unindexed folder/file-name search

,Dr Herbie wrote

@Harlequin: Shhh!  If you say his name three times, he appears!

Herbie

Ludacris?  "How low can you go?"  Tongue Out

]]> http://channel9.msdn.com/Forums/Coffeehouse/Huge-speed-improvements-in-Windows-8-unindexed-folderfile-name-search/19413d36eaf04c66b6769f3900fa035e#19413d36eaf04c66b6769f3900fa035e Mon, 08 Aug 2011 15:10:16 GMT http://channel9.msdn.com/Forums/Coffeehouse/Huge-speed-improvements-in-Windows-8-unindexed-folderfile-name-search/19413d36eaf04c66b6769f3900fa035e#19413d36eaf04c66b6769f3900fa035e Soe Tun 7 http://channel9.msdn.com/Niners/stun/Discussions/RSS Coffeehouse - Huge speed improvements in Windows 8 unindexed folder/file-name search

,androidi wrote

http://sourceforge.net/projects/ntfs-search/

(compiles fine with 2008 after changing the .ico name and removing the intermed. manifest)

I just built and ran it (after a few build tweaks like as you described) and all I can say is "wow". This is a really good piece of work and, yes, makes me weep for Microsoft again.

Can you explain the USN stuff in simple terms for me, what does the C# scanner do that this C++ program doesn't?

]]> http://channel9.msdn.com/Forums/Coffeehouse/Huge-speed-improvements-in-Windows-8-unindexed-folderfile-name-search/d30080ff6e584d2485cc9f42013d841f#d30080ff6e584d2485cc9f42013d841f Wed, 17 Aug 2011 19:16:02 GMT http://channel9.msdn.com/Forums/Coffeehouse/Huge-speed-improvements-in-Windows-8-unindexed-folderfile-name-search/d30080ff6e584d2485cc9f42013d841f#d30080ff6e584d2485cc9f42013d841f W3bbo 7 http://channel9.msdn.com/Niners/W3bbo/Discussions/RSS