SICK SICK SICK

Ok guys, I blogged about this and I will link to it here
instead of C&P in the forum.  Is there anyway to tell a website not to index by certain key words?

Ok, so what made you name this thread "SICK SICK SICK"?

I classify this as the gross thread because according to you it's SICK.
Steve.

Steve411 wrote:

Ok, so what made you name this thread "SICK SICK SICK"? I classify this as the gross thread because according to you it's SICK. Steve.

I know with a robots.txt file you can keep a search robot from indexing your site, is there anyway possible to write a robots.txt file to keep a robot from indexing to certain keywords?  Like if I want my page excluded from a "(I need to watch my language)" search is there anyway to do that?

Steve411 wrote:

Ok, so what made you name this thread "SICK SICK SICK"?

I classify this as the gross thread because according to you it's SICK.
Steve.

Because dude, to me its SICK, disgusting and ewwwwwwwwwwww

You found something disgusting and decided to share? I'm not quite following the logic here...

rjdohnert wrote:

Like if I want my page excluded from a "(I need to watch my language)" search is there anyway to do that?

I don't know about you, but I'd laud at the opportunity for extra search engine results. Means for advert revenue

As for the whole bestiality thing... its more common than you think. Some guy on the SomethingAwful Forums did a search for the "worlds largest forum" and found some Bestiality forum had some 60,000 members.

I like hiding ridiculous keywords into the site, by means of metatags and all. It always leads to hilarious log entries.

Now that you've blogged the words "dog (I need to watch my language)", you'll get even more hits from people looking for that...

I can't think of anything to directly tell the crawlers not to index certain words, however, there are ways to prevent them from finding the words (it takes more work though). If your website is dynamic, you can do something similar to the profanity filter that Channel9 uses.  This filter could either hide the words you don't want indexed when the User Agent is a crawler or you could replace those words with some javascript or something similar that will make the words human readable, but not crawler readable.  For example, < span > do< /span >g.  This would look fine to a human, but the indexers would only see "do" and "g".

kriskdf wrote:

For example, < span > do< /span >g.  This would look fine to a human, but the indexers would only see "do" and "g".

Not really. Most spiders detect inline elements and remove them. So he<span>llo</span> would be picked up by Google as "hello".

This doesn't apply to block-level or replaced elements, however.

btw, I checked out that screenshot you have on your blog, what theme do u use?

blowdart wrote:

Is no-one else tempted to fire up fiddler and send some fake referrers?

I can't be the only one

I thought Fiddler was just a packet interceptor?

So you're saying you can use it to create HTTP Requests too?

W3bbo wrote:

blowdart wrote: Is no-one else tempted to fire up fiddler and send some fake referrers? I can't be the only one

I thought Fiddler was just a packet interceptor?

So you're saying you can use it to create HTTP Requests too?

Can you use it to flood the heck out of annoying Poker/Viagra/Mortgage trackback links?

You can't make up referrer insanity. It just comes from alone.

refspoof