exoteric said:W3bbo said:*snip*
One could persist the file system index on a system partition on a separate solid state disk to mitigate the issue. I imagine one could perhaps also use the cache of a hybrid disk to maintain the index.
The problem with organizing files and with tree-structured file systems is that often files do not naturally fall into a single category, so what is needed is a graph-structured layout. On the other hand, few people want to maintain a graph-structured layout manually. It's just too much work.
The new Semantic Engine that Microsoft presented at the last PDC looks like an attempt to solve this issue by having an engine that applies machine learning techniques to automatically index files - both textual and binary, such as images and audio. It'll be interesting to see how easily extensible it is. It could be one hell of a replacement for ifilters. There's so many interesting types of files that are not indexed currently.
I thought that WinFS was the attempt to manage this... essentially a relational view of the underlaying NTFS attributes.