CoverYourASP --> Snippets

Free membership

Join in the fun! Sign in
Member Services

Site navigation
Download the entire site!
Search my articles
Free Magazines
Browse the directory

Send me feedback
Buy my boxer shorts

Recommend this page
Printer-friendly page

Resources I recommend
Link to my site
Advertising slashed!
About your privacy
Legal stuff
Site statistics
50 active users
2372 visitors today
2048 pages today
(only part of today)
Tools I use

CoverYourASP
Copyright © 1999-2016 James Shaw.
All rights reserved.

ASP.NET Blog
RSS submissions
E-commerce

Now open source with SourceForge!

"Snippets" are mini-articles - they allow me to very quickly add answers to your frequently asked questions, and add brief explanations for topics that you've searched for without success. So, everytime you send an email or perform a search, chances are a new snippet will be the result!

18 Sep: Validating your ROBOTS.txt file

Conan:

"You might want to check the syntax of your ROBOTS.TXT file at http://www.searchengineworld.com/cgi-bin/robotcheck.cgi

;-)

I've just discovered how to make one myself (after being bombarded with emails by my new 404.asp page, damn spiders), and I found this syntax checker -- Maybe it's out of date for current agents, but its good to be backward compatible, no?"

Me:

Excellent resource Conan, thanks. I found 2 or 3 "errors" and even if they didn't cause any real problems it's always handy to know the rules!

Featured sponsor
My favorite resources


See my source code
wherever you see this icon...

You can also download the entire site source code for FREE!

CoverYourASP Mugs, T-shirts, caps - even Boxer shorts...
I don't make a penny from these, but they're a lot of fun! Don't you need a new mouse mat?