metadata

Enhancing searchAn update on taxonomies, metadata and thesauri: 

Enhancing search An update on taxonomies, metadata and thesauri Leonard Will Willpower Information

Summary: 

Summary Metadata creation is cataloguing Taxonomies are classifications Thesauri and classifications are complementary ways of grouping concepts Facet analysis is a useful technique for constructing schemes systematically Most computer search interfaces are inadequate

Metadata = catalogue records: 

Metadata = catalogue records Resources: any things that can be identified documents, web pages, images, sound files, teaching packages, books, museum objects, people, organisations Metadata: structured information about resources May be included with resources (e.g. “CIP”) or collected in separate “union catalogues” (e.g. OAI-PMH) Some from the resource itself (size, format), some from external sources (provenance, location, accessibility)

Metadata standards: 

Metadata standards Anglo-American Cataloguing Rules (AACR) Encoded Archival Description (EAD) Learning Object Metadata (LOM) Spectrum standard for museum information Friend of a Friend (FOAF) and vCard e-Government Metadata Standard (eGMS) Dublin Core - lowest common denominator

Kinds of standards: 

Kinds of standards Content standards: which pieces of information are to be recorded (DC, AACR) Value standards: how is the information to be recorded (= DC encoding schemes) formats (ISO date format, NCA name formats, AACR) lists of valid values (thesauri, authority files) Structure standards: how the information is to be grouped and labelled for use by computers and humans (XML schemas, MARC) Application profiles: Choices from the above

Dublin Core metadata: 

Dublin Core metadata Title Creator Subject Description Publisher Contributor Date Type Format Identifier Source Language Relation Coverage Rights + element refinements

Subject: 

Subject “Typically, Subject will be expressed as keywords, key phrases or classification codes that describe a topic of the resource. Recommended best practice is to select a value from a controlled vocabulary or formal classification scheme.”

Taxonomies = controlled vocabularies: 

Taxonomies = controlled vocabularies “Taxonomy”: woolly meaning -> confusion keep it for biological classification systems Knowledge organization systems (KOS) a better expression for the general concept Main types are thesauri classification schemes ontologies

Thesauri and classification schemes: 

Thesauri and classification schemes Thesauri and classification schemes are alternative ways of showing concepts and their relationships They are complementary and both approaches are needed They can both be built on the principles of facet analysis

Building blocks of all knowledge organisation schemes: 

Building blocks of all knowledge organisation schemes concepts relationships 35 m cameras CC:H012 BT: film cameras aqualungs CC: D002 BT: diving equipment camera accessories CC: H002 BT: photographic equipment NT: flash guns light meters tripods RT: cameras

Relationships are between concepts, not words: 

Relationships are between concepts, not words BT NT vehicles road vehicles conveyances voitures 388.34 629.2 cars automobiles autos private cars 388.342 629.222 Choose one term as a descriptor to label the concept: cars USE automobiles

Preferred term substitution: 

Preferred term substitution Anything on farming? I use the term agriculture for farming, so I’ll search for that

Relationships between concepts: 

Relationships between concepts Paradigmatic, or a priori: apply generally, independently of any specific document shoes BT footwear shoes RT shoemakers Syntagmatic, or a posteriori: concepts that are related only in the context of a specific document shoes : history shoes : prices A thesaurus can show these A classification scheme can also show these

Searching hierarchies: 

Searching hierarchies I need informationon road vehicles I know that buses,cars and lorries are all kinds of road vehicles, so I’ll search for these terms as well as for road vehicles

Searching related terms: 

Searching related terms Please give me informationabout agriculture OK,I’ll look for that. Would you also be interested in items dealing with forestry, livestock or pet breeding?

Paradigmatic relationshipsin a thesaurus: 

Paradigmatic relationships in a thesaurus Many relationships are indicated as RT/RT, but their nature is not specified, so cannot be used for systematic grouping (ontologies overcome this) Hierarchical generic-specific relationship (BT/NT) allows (requires) grouping of concepts into facets - the terms have to be in the same facet

What is a facet?(Sometimes called a fundamental facet): 

What is a facet? (Sometimes called a fundamental facet) A high-level grouping of concepts of the same inherent category, e.g. activities, disciplines, people, materials, places, times. For example: animals, mice, daffodils and bacteria could all be members of a living organisms facet; digging, writing and cooking could all be members of an activities facet; birthdays, wars and football matches could all be members of an events facet. A concept cannot belong to more than one facet

Facets in the AAT: 

Facets in the AAT associated (i.e. abstract) concepts physical attributes styles and periods agents activities materials objects

What is an array?(Sometimes called a subfacet): 

A grouping of concepts within a facet by some stated characteristic of division. vehicles <vehicles by number of wheels> bicycles tricycles four-wheeled vehicles automobiles <vehicles by load carried> goods vehicles lorries passenger vehicles automobiles buses What is an array? (Sometimes called a subfacet) Node labels showing characteristics of division Array Array A concept may occur in more than one array

Parametric search: 

Parametric search Searching for resources that have one or more specified characteristics e.g. vehicles which have three wheels AND are used for carrying passengers This is an important and useful aspect of post-coordinate searching, but it is not faceted classification

Ways of displaying concepts and their paradigmatic relationships: 

Ways of displaying concepts and their paradigmatic relationships 1. Alphabetically, with their relationships 35 mm cameras BT: film cameras aqualungs BT: diving equipment camera accessories BT: photographic equipment NT: flash guns light meters tripods RT: cameras

Ways of displaying concepts and their paradigmatic relationships: 

Ways of displaying concepts and their paradigmatic relationships 2. Hierarchically - one tree for each facet (fields of work) . diving . photography . physics . . optics (people) <people by age> . infants . children . adults <people by occupation> . divers . models (people) . photographers . physicists (equipment) . diving equipment . . aqualungs . . diving suits . . . dry suits . . . wet suits . . face masks . photo equipment . . cameras

Ways of displaying concepts and their paradigmatic relationships: 

Ways of displaying concepts and their paradigmatic relationships 3. In subject groups or categories (microthesauri) one tree for each facet in each category (fields of work) . diving . . scuba diving . . snorkel diving (people) . divers (equipment) . diving equipment . . aqualungs . . diving suits . . . dry suits (fields of work) . photography . . colour photography (people) . models (people) . photographers (equipment) . photo equipment . . cameras 797.23: DIVING 770: PHOTOGRAPHY

Combining concepts :syntagmatic relationships: 

Combining concepts : syntagmatic relationships (places) A1 Italy A2 The Netherlands A3 Russia (people) B1 potters B2 repairers B3 ceramicists (activities) C1 moulding C2 throwing C3 decoration (objects) D1 earthenware D2 porcelain D3 stoneware Combine to express compound subjects - either post-coordinate, for searching: porcelain AND decoration AND Russia or pre-coordinate, for browsing: porcelain decoration in Russia: D2C3A3 Node labels showing facet names

Order of combining facets: 

Order of combining facets thing - kind - part - property - material - process - operation - system operated on - product - by-product - agent - space - time - form e.g. porcelain (thing) - decoration (process) - in Russia (space) A facet may occur more than once in a string

Faceted classificationwith processes subordinated to objects: 

Faceted classification with processes subordinated to objects (processes) A ceramic production processes in general AA forming in general AAA coiling AAB moulding AAC throwing AB decoration in general ABA glazing ABB transfer printing (objects) B ceramics in general BB earthenware in general (processes) BB.AA forming of earthenware BB.AAB moulding of earthenware BB.AB decoration of earthenware BB.ABA glazing of earthenware BB.ABB transfer printing of earthenware BC porcelain in general (processes) BC.AA forming of porcelain BC.AAB moulding of porcelain Words shown in blue may be omitted as they are implied by the hierarchical structure

Faceted classificationgeneration of subject strings: 

Faceted classification generation of subject strings (objects) B ceramics BB earthenware (processes) BB.AA forming BB.AAB moulding BB.AB decoration BB.ABA glazing BB.ABB transfer printing BC porcelain (processes) BC.AA forming BC.AAB moulding ceramics > earthenware > forming ceramics > earthenware > forming > moulding ceramics > earthenware > decoration ceramics > earthenware > decoration > glazing ceramics > earthenware > decoration > transfer printing ceramics > porcelain ceramics > porcelain > forming ceramics > porcelain > forming > moulding

Alphabetical index: 

Alphabetical index ceramic production processes A ceramics B coiling : forming : ceramic production AAA decoration : ceramic production AB decoration : earthenware : ceramics BB.AB earthenware : ceramics BB forming : ceramic production AA forming : earthenware : ceramics BB.AA forming : porcelain : ceramics BC.AA glazing : decoration : ceramic production ABA glazing : decoration : earthenware : ceramics BB.ABA moulding : earthenware : ceramics BB.AAB moulding : forming : ceramic production AAB moulding : porcelain : ceramics BC.AAB porcelain : ceramics BC throwing : forming : ceramic production AAC transfer printing : decoration : ceramic production ABB transfer printing : decoration : earthenware : ceramics BB.ABB

The same concepts viewed in different ways: 

The same concepts viewed in different ways Thesaurus view Good for searching if you know what you want Like a gazetteer Like a book’s index Gets quickly to individual concepts Usually arranged by facet Shows paradigmatic relationships Lets you combine concepts when searching Classification view Good for browsing or surveying a topic Like a map Like a book’s contents page Shows related concepts together Usually arranged by discipline Shows syntagmatic and paradigmatic relationships Shows compound topics as pre-combined subject strings

Some clarifications: 

Some clarifications A classification can be both hierarchical and faceted A classification built on faceted principles can be enumerative A symbolic notation is not essential, and should not determine the structure A classification can arrange compound topics in a useful linear sequence - a thesaurus cannot One-to-one mapping between a thesaurus and a classification is not possible A “guide to popular topics” may be used to supplement a systematic classification

Use of a thesaurus: 

Use of a thesaurus A thesaurus as a search aid with unindexed material Allows searching on terms linked to the term asked for Software support for formulating questions Browsing the thesaurus to choose terms Combining terms with AND, OR, NOT and ( )

An ambiguous search interface: 

An ambiguous search interface Does this mean: (lorries OR cars) AND diesel ? or does it mean: lorries OR (cars AND diesel) ?

Thesaurus creation and management: 

Thesaurus creation and management Standards BS/ISO standards give helpful guidance Draft revised BS standard now out for comments Software Many packages available Best if integrated with database used for cataloguing Cooperative thesaurus development and use DIY is a major and continuing task

Thesaurus development never ends: 

Thesaurus development never ends It is an ongoing task It needs a knowledgeable thesaurus editor It needs cooperation and input from indexers and users User feedback

What we need: 

What we need Software for the combined development of thesaurus and classification Thesaurofacet; Classaurus; ROOT; Bliss; Taxomita Software support for combining facets when searching, using a thesaurus. Often referred to as faceted classification, but not the same thing Flamenco; View-based searching; No zero match (NZM) Software support for browsing in a classified catalogue with notation, captions and an alphabetical index

Links and further information: 

Links and further information <http://www.willpowerinfo.co.uk/>