Controlling access unintentionally
Depending on how your pages are generated, you may be excluding indexers. Problems will arise with indexing of:
- Framed sites (see http://www.searchengines.com/frames.html)
- Graphics (including Flash and Shockwave) - use alt text
- Pages requiring passwords, registration or cookies (local search engines can be given passwords)
- XML
- Java applets
- Acrobat files (except Google)
- Dynamic pages with queries in the URL (except except Google, Altavista, FAST)
- Multimedia files (but see later)
