Solutions - For Info Providers
REP implemented by system administrator
Possible (but not easy?) to create master robot.txt file by merging departmental ones
HTML 4.0 <META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW"> element enables individual files to contain robot directives
- New and not yet widely supported
Since robots tend not to follow CGI programs, could hide information behind a button
<FORM ACTION="part.html">
<INPUT TYPE="submit" VALUE="...">