Appendix VI: Selection criteria found via the literature review

The literature review identified sources that included quality selection criteria for Internet services and/or traditional library services. Selection criteria were drawn from the following sources:

On-line resources

Caywood, C., 1995, Library selection criteria for WWW resources.
<URL:http://duckdock.acic.com/carolyn/criteria.htm> [Accessed:. 24 Apr. 1996]

Ciolek, T.M., (ed.), 1995, Criteria used to select links for resources' catalogues.
<URL:http://coombs.anu.edu.au/SpecialProj/QLTY/QltyLinks.html> [Accessed: 11 Aug. 1996].

Ciolek, T.M., 1996, The six quests for the electronic grail: current approaches to information quality in WWW resources. Revue Informatique et Statistique dans les Sciences Humaines (RISSH) (Centre Informatique de Philosophie et Lettres, Université de Liège), No. 1-4, 1996.
<URL:http://coombs.anu.edu.au/SpecialProj/QLTY/TMC/QuestMain.html> [Accessed: 26 June 1996]

Cornell University Library, 1996, How to critically analyze information sources.
<URL:http://urislib.library.cornell.edu/skill26.html> [Accessed: 31 May 1996]

Cox, M.D, 1996, LogLink Logistics: web page review criteria.
<URL:http://www.commerce2000.com/logistics/criteria.html-ssi> [Accessed: 30 Apr. 1996]

Fisher, T., 1995, Evaluation of an Internet information resource.
<URL:http://www.vuw.ac.nz/~thelma14/eval.html> [Accessed: 30 Apr. 1996]

Grassian, E., 1996, Thinking critically about World Wide Web resources.
<URL:http://www.ucla.edu/campus/computing/bruinonline/trainers/critical.html> [Accessed: 22 Apr. 1996]

Information Market Observatory (IMO), 1995, The quality of electronic information products and services. IMO Working Paper 95/4. Luxembourg: IMO, September.
<URL:http://www2.echo.lu/impact/imo/9504.html> [Accessed: 30 Mar. 1996]

Janicke Hinchliffe, L., 1996, Resource selection and information evaluation.
<URL:http://alexia.lis.uiuc.edu/~janicke/Evaluate.html> [Accessed: 29 Apr. 1996]

McLachlan, K., 1996, WWW CyberGuide ratings for content evaluation.
<URL:http://www.cyberbee.com/guide1.html>. [Accessed: Sep. 1996]

Rettig, J., 1995, Putting the squeeze on the information firehose: the need for 'Neteditors and 'Netreviewers.
<URL:http://www.swem.wm.edu/firehose.html> [Accessed: 29 Nov. 1996]

Smith, A., 1996a, Criteria for evaluation of Internet information resources.
<URL:http://www.vuw.ac.nz/~agsmith/evaln/> [Accessed: 11 Apr. 1996]

SOFWeb, Research and the Internet.
<URL:http://www.dse.vic.gov.au/netiget2.htm> [Accessed: 30 Apr. 1996]

Stepno, R. and Henshaw, R., 1995, Quality of information … and disinformation online.
<URL:http://blake.oit.unc.edu/~rbstepno/disinfo.html> [Accessed: 31 May 1996]

Sun Microsystems, 1995, Guide to Web style: quality.
<URL:http://www.sun.com/styleguide/tables/Quality.html> [Accessed: 3 Sep.1996]

Tillman, H.N., 1996, Evaluating quality on the Net.
<URL:http://www.tiac.net/users/hope/findqual.html> [Accessed: 24 Apr. 1996].

Victoria University of Wellington, Department of Library and Information Studies, 1995b, Criteria for evaluation of Internet information resources.
<URL:http://www.vuw.ac.nz/dlis/courses/847/m2resevl.html> [Accessed: 29 Nov. 1996]

Print resources

Collins, B.R., 1996, Beyond cruising: reviewing. Library Journal, Vol. 121, no. 3, February 15, pp. 122-124.

Cooke, A., et al., undated, Developing a technique for assessing the quality of networked information. Preliminary results taken from an unpublished progress report. Aberystwyth: University of Wales Aberystwyth, Department of Information and Library Studies.

Farber, M., 1994, The quality of information on Internet. Computer Networks and ISDN Systems, Vol. 26, Suppl. 2, pp. S75-S78.

Pratt, G.F., Flannery, P. and Perkins, C.L.D., 1996, Guidelines for Internet resource selection. College and Research Libraries News, Vol. 57, no. 3, March, pp. 134-135.

Stoker, D. and Cooke, A., 1993, Evaluation of networked information sources. In: Helal, A.H. and Weiss, J.H. (eds.), Opportunity 2000: understanding and serving users in an electronic library: 15th International Essen Symposium … Festschrift in honour of Herbert S. White. Publications of Essen University Library, 15. Essen: Universitätsbibliothek Essen, pp. 287-312.

Selection criteria from the literature review

A list of the selection criteria found via the literature review is given below. Each and every criteria was noted and is given below as raw data, i.e. as it was before any categorisation took place.

What is the coverage in the collection?

Is there any factual information?

Is there any original information?

Must be WWW site

Is it well organised?

Is it well presented?

Information must be attributable to an author or editor?

Link must be reasonably fast

Link must be reasonably stable

Frequently improved and enlarged and updated?

Maintainer has given permission for site to be included?

Must visit the site before linking to it

Where did you learn of the site - from a respected source?

Are the external links to further information relevant?

Have you heard of the organisation/author/editor previously?

Is the site non commercial?

Advertising present?

Is the page what it appears to be - by who it says it is by?

Does the URL support the claim of authorship?

Is the URL a university server?

Contains more than just contact details

Contains more than just list of links

Is the site still useful with an ASCII browser like LYNX?

Is it written in standard HTML?

Have proprietary extensions to the HTML been added that some browsers will not recognise?

Does it use standard multimedia formats?

Do parts of it take to long to load?

Is it usually possible to reach the site or is it overloaded?

Has the URL changed?

Are you being redirected to a new URL? (stability)

Is it open to anyone on the Net or do parts of it require fees?

Are any rules for use stated up front?

Are the individual Web pages concise or do you have to scroll forever?

Do essential instructions appear before links and interactive portions?

Do all the parts work?

Is using the site intuitive, or are parts likely to be misunderstood?

Can you locate a particular page from any other page?

Does it look and feel friendly?

Does it do more than can be done with print?

Can the user interact with it?

Are interactions secured if they involve private information?

Is the scope clearly stated?

Are headings clear and descriptive?

Is the title informative?

Are the limits stated?

Does it include jargon?

Is it organized by the needs of the user?

Does the content fit the scope?

Are the content and links clearly described and suitable to the expected audience?

Is the content amplified over time or is one visit all it's worth?

Is the origin of the content documented?

Is the content of the document verifiable?

Is the amount of bandwidth commensurate with the usefulness of the content, or are the graphics or multimedia included simply to show off?

Is the site sponsored?

Is the publisher a recognised authority?

Does the page provide other sources which could be contacted for confirmation?

Does the page provide other sources which could be contacted for further information?

Is there an Email address for the author?

is there an Email address for the publisher?

Is there a common link to the page from a recognised authority?

Does the page cite a bibliography or provide references to confirm the accuracy of the information'

Has the site been reviewed by a 'content' reviewing agency?

Consistency

Error-rate accuracy

Customer support and training

Timeliness

How current is the material included in each update?

Are time-sensitive sources available in near real-time?

What data sources are used?

Is there a prevalence of typographical errors?

Is some of the information incomplete?

What quality control procedures does the producer employ?

Does the system require special software?

Can the user sign up on-line or must written contracts be negotiated first?

Does the system have a search facility?

Can pages or portions of a document be printed separately?

Is on-line documentation timely, accurate and readable?

Is print documentation available?

Is the documentation searchable?

Does the information overlap with items already in the collection - does it duplicate?

Do you know the educational background of the author?

Do you know the occupational background of the author?

Is the author listed on say, the campus directory/organisational directory?

Is there an index?

Is the resource indexed electronically? (Is the index kept up to date?)

Demonstrated importance through availability: linked by multiple Internet sites

Demonstrated importance through availability: available in multiple formats (print/CD-ROM etc.)

Are the downtimes infrequent and announced?

Dan you review the peak usage time for the resource? (to assess reliability)

Is the site mirrored?

Is specific hardware needed?

Does the source avoid 'blink' features?

Are all the pages dated with the last revision date?

Are all the links clearly labelled?

Do all the links serve an easily identified purpose?

Are graphics/sounds/videos/ clearly labelled and identified?

Do the graphics/sounds/videos serve a clear purpose appropriate for the intended audience?

Is the content of linked sites appropriate for the intended audience?

Is the content free of bias - or is the bias made clear to the audience?

Are large graphics hindering a fast download time?

Is there a sufficient number of links to guide you through the document, and to allow you to retrace your steps?

Is the scope stated or implied?

Breadth - are all aspects of the subject covered?

Depth - to what detail does the subject go?

Time- is the information in the resource limited to certain time periods?

Are sources of the information stated?

Is the resource pitched at the right level for the intended audience?

Does the resources fulfil the stated purpose?

Does your user group have the connectivity to access this resource?

If it is a static resource (not updated) will the information be of lasting use to the audience?

Do the stated dates respond to the information in the resource?

Does the organisation or person hosting the resource seem to have the commitment to the ongoing maintenance and stability of the resource?

Uniqueness - is the resource available in other forms e.g. other sites, print, CD-ROM,?

If the resource has been derived from another format e.g. print,

How effectively can information be retrieved from the resource?

Is a useful search engine provided?

Has a resource been designed to work well with one interface (e.g. Netscape), but be difficult to use with others (e.g. Lynx)?

Why is the information there? What was the motivation of the information provider when they made the information available?

Cross-checking the information - can you do this?

What is the purpose of the resource?

Relative value of the resource in comparison with others available on this topic?

Relative value of the resource in comparison with others already in the collection?

What other resources are available in this area?

What are the link selection criteria if any?

Is the site inward focused i.e. not just linking to other, external sites?

Is there an appropriate balance of inward pointing links and outward pointing links?

When was the web item produced?

When was the web item mounted?

Are there references to sites that have moved?

Does the document follow good graphic design principles?

Do the graphics and art serve a function or are they decorative?

Do the icons clearly represent was is intended?

Does the text follow basic rules of grammar, spelling and literary composition?

Is there an element of creativity, and does it ad or detract from the document itself?

Is there an option for multimedia browsers/line-mode browsers?

Is attention paid to the needs of the disabled, e.g. large print and graphic options; audio?

Is appropriate interactivity available?

When it is necessary to send confidential information out over the Internet, is encryption (i.e. a secure coding system) available? How secure is it?

Has the author had previous publications of note?

Is the information written on a topic in the author's area?

Can information located in the publication itself be used to determine the author's credentials?

Is the author someone who has been cited frequently by respectable sources?

Is the publisher 'University press'?

Is the information scholarly rather than popular?

Does the information appear to be valid, and well researched?

Is it primary material?

Is it merely vanity publishing?

Has the material been disseminated by a trade publisher?

Are there stated criteria for inclusion of information?

Appropriateness of format

Is there an opening mission statement/statement of the purpose of the resource?

Does the site give, or take?

Is original work available at this site?

What type of resources of relevance to the audience: listings, indexes, data, abstracts, addresses, phone numbers, reports, studies, summaries, reviews, surveys, dictionaries, definitions, news, newsletters, stock quotas, annual reports, service descriptions, regulations, technical data, guides, historical information?

What technology is appropriate for the audience: forms, ismaps, searches, databases, cgi scripts, Java applications, frames, web sites, gopher site, ftp, WAIS, telnet, effective application,

If the site contains data or information that is time-sensitive how current is this data and information?

How time sensitive is the information, and how does this relate to frequency of update?

Criteria balance

What type of site is relevant to the audience: academic, government, commercial, trade/industry, non-profit, private?

Information from which geographical areas is relevant to the audience : local, nation-wide, from particular countries or continents or world wide?

Quality control: publishers/peer review/refereed journals/

Is the publisher known to you and reputable?

Have you heard of the author before?

Next	Table of Contents

Page maintained by: UKOLN Metadata Group,
Last updated: 2-Apr-1998