WebWatching UK Web Communities - Contents

• 1 Introduction
• 2 Outline of the WebWatch Project
  • Aims and Objectives
  • Timeliness
  • Benefits
  • Methodology
• 3 Background to Robot Technologies
  • Introduction
  • Agents and the Web
  • The Role of Robots in the Web
    • Maintaining the Web
    • Understanding the Web
  • Benefits
  • Robot Ethics
  • Disadvantages of Web Robots
    • Network Performance
    • Server-side Concerns
    • Unethical Robots
• 4 The WebWatch Robot
  • Robot Software
  • Processing Software
  • Availability of the WebWatch Software
• 5 WebWatch Trawls
• 6 Observations
  • For Information Providers
  • For Webmasters
  • For Robot Developers
  • For Protocol Developers
• 7 WebWatch Web Services
  • The robots.txt Checker
  • The HTTP-info Service
  • The Doc-info Service
  • Using WebWatch Services From A Browser Toobar
• 8 Future Developments
  • The Business Case
  • Technologies
    • Database Access to WebWatch Data
    • Evaluation of Web Site Accessibility
    • Monitoring SSL Deployment
    • Use of Harvest/NG
    • Development of a Cachability Checking Service
    • Configurable User-Agent Field
  • Communities
• 9 References
• Appendix 1 Trawl of UK Public Libraries
  • Methodology and Analysis
• Appendix 2 First Trawl of UK University Entry Points
• Appendix 3 Analysis of /robots.txt Files
• Appendix 4 Trawl Of UK University Entry Points - July 1998
  • The Trawl
  • The Findings
  • Discussion of Findings
    • Metadata
• Appendix 5 Trawl of eLib Projects
• Appendix 6 Trawl of UK Academic Libraries
• Appendix 7 Third Trawl of UK Academic Entry Points
• Appendix 8 Library Technology News Articles
• Appendix 9 Virtually Inaccessible?
  • Making the Library Virtually Accessible
  • Accessibility and the Web
  • So How are UK Public Libraries Currently Doing?
    • Images
    • Image Maps
    • Tables
    • Frames
    • HTML Validation
    • Summary
  • Ways Forward
  • References
• Appendix 10 WebWatch Dissemination
  • Presentations
    • An Introduction to the WebWatch Project
    • Web Developments For The JANET Community
    • Web Developments For The JANET Community
    • WebWatching the UK: Robot Software for Monitoring UK Web Resources
    • WebWatching the UK HE Community
    • WebWatch: Robot Crawls of UK HEIs
  • Publications
    • How Is My Web Community Doing? Monitoring Trends in Web Service Provision
    • Showing Robots the Door
    • Robot Seeks Public Library Websites
    • WebWatching UK Universities and Colleges
    • Library Technology News Articles
  • Articles
    • Report of WebWatch Crawl of eLib Web Sites
    • Analysis of Links from UK Universities and Colleges Institutional Home Pages
    • A Survey of UK Academic Library Web Sites
    • Third Crawl of UK Academic Entry Points
  • Poster Displays