I S K O |
Encyclopedia of Knowledge Organization |
home about ISKO join ISKO Knowledge Organization journal ISKO events ISKO chapters ISKO people ISKO publications Encyclopedia KO literature KO institutions ⇗ KOS registry 🔒 members contact us |
edited by Birger Hjørland and Claudio Gnoli
Information retrievalby Birger Hjørland 1. IntroductionInformation retrieval (IR) and → knowledge organization (KO) are two research fields that, on the one hand, are separate fields of study, but on the other hand, have the same aim: to facilitate the findability of documents, knowledge, and information. Anderson and Pérez-Carballo’s (2005) handbook of KO has the title Information Retrieval Design, which indicates the close connection between KO and IR, where IR is about search processes, while KO is about designing optimal structures for IR (in addition to other purposes KO may serve). Today, the field of IR has mainly migrated from information science to computer science and has developed systems used in search engines such as Google, which are extremely successful. There is, however, a surprisingly simple objection to the underlying principles in mainstream IR research: they are not based on scientific or scholarly norms on which documents or knowledge claims have the best scientific or scholarly foundation and correspond to our best theories and findings. It seems obvious that users need to retrieve what is regarded as true knowledge (or to be more precise, what is considered our best substantiated knowledge claims). The main approaches in IR are discussed in Section 3. In this respect, the field of KO has often had the goal, at the least implicitly, to classify and represent documents and knowledge in accordance with updated scientific knowledge (e.g., to classify books about birds in accordance with the classification of birds in ornithology). Despite this aim, the theory of KO has lacked an adequate toolset of conceptualization to cope with it (and often, approaches have dominated that do not deal adequately with the problems. This is discussed in Section 2). The purpose of this article is to provide arguments and conceptualization for creating methods and principles to develop systems and processes in IR and KO that aim at providing users with our best substantiated knowledge. To do so, this article argues, we need to base IR on KO, and we need to base KO on insights derived from the philosophy of science. 2. The field of knowledge organizationKO is sometimes termed “information organization” and Salaba (2020, 391) found that “information organization” is now by far the most used name for courses in educational programs in North American ALA-accredited programs. It is also sometimes termed “knowledge representation”, as in the subtitle of the official journal of ISKO, Knowledge Organization: “International Journal devoted to Concept Theory, Classification, Indexing and Knowledge Representation”. KO is about knowledge organizing processes such as → indexing, → tagging, → classifying, describing, and organizing documents and information, and about → knowledge organization systems (KOS) such as classification systems, → thesauri, and → ontologies. KO has a practical aim. Although it is also a theoretical field, the aim of both practical activities and empirical and theoretical research is to support practical activities. The practical aims are the sole justification for KO. It has been claimed, for example, that KOSs such as thesauri and controlled vocabularies are obsolete today, cf. Salton (1996). KO must show that its processes and systems are necessary. If, for example, search engines such as Google can fulfill all practical needs without relying on KO, there is no need for this field. KO must always consider itself in relation to all possible alternative approaches, whether they have been developed inside or outside the field itself. Specifically, we must demonstrate, why, for example, Google is not enough (cf. Hjørland 2012). This article contains arguments about the necessity of KO. The KOSs developed for organizing documents and information are primarily about organizing concepts. The conceptual structures used in KOSs are to a large degree derived from specific domains of knowledge. Documents about birds, for example, are often organized according to how ornithologists organize the birds themselves. This principle was recognized by Henry Bliss, who argued (1933, 37): “To make the [bibliographic] classification conform to the scientific and educational organization of knowledge is to make it the more practical”, and this is probably the main reason the field was and still is named KO. The roots of KO lie in the following:
The connections between these four fields are important for the development of KO as a field of study and practice but have often been neglected. This article argues that subject knowledge and its foundation in the philosophy of science is the most important perspective for KO, but this perspective has so far not been very influential in KO. Alternatively, influential perspectives have been:
Approaches to KO have mostly been dominated by the dichotomy between psychological, cognitive understandings on the one hand, and technological understandings on the other. It has been claimed, for example, that there are two kinds of “relevance”: human based relevance assessment and computer-based assessments. This dichotomy was criticized by Hjørland (2010) who argued that “systems relevance” is an oxymoron because systems are made by humans who have determined the criteria of relevance used by the systems. Relevance in the user-oriented school considers “real users” (as opposed to subject expert) to be best to evaluate the relevance of documents and information. In the next section, we consider a thought experiment of searching for cities in Sweden and here it is claimed that the relevant information may be found in a map or gazetteer constructed by some experts, not what the user believes are Swedish cities. Both the “systems approach” and the “user approach” (as well as the dichotomy itself) are therefore problematic positions, and a third way is needed. A third way is the → domain analytical approach (Hjørland 2017), according to which both human information needs and technological approaches are understood as influenced by the understanding and background knowledge of the actors (including the computer programmers and mediators), which is shaped by the social and disciplinary contexts, the traditions, and the paradigms in which the actors have been socialized. 3. Challenges from IRSearch engines such as Google represent an impressing technology and its importance as aid to find relevant documents and information can hardly be overrated. We should acknowledge that both IR in general and search engines like Google have, in many ways, turned deeply rooted beliefs within library and information science and KO upside down. Nonetheless, everything has its limitations, and it is the job of research to suggest new ways forward. In this connection, it is important to consider the purposes of searching. Most users are probably not interested in exhaustive searches, but in high precision, and this may be one of the reasons for the popularity of Google. However, for some purposes, in particular academic purposes, exhaustive searches are often necessary, and it is important that tools are available for such purposes, and this may well be one of the weaknesses of Google and related systems. When you search a system like Google, you typically type in a few words and study the first part of the result list (we shall not here consider, for example, picture or music retrieval, but we consider the fundamental principles to be the same). This principle, that the system as a response to an input retrieves a set of documents, was by Warner (2010) termed “query transformation” and was by him opposed to a principle that is far older but less influential today, which he called “selection power”, which is about the user’s ability to make relevant distinctions during a search (these principles are further discussed in Hjørland 2015). The principle of query transformation implies that you typically must know the words (or other symbols) that correspond to the words (symbols) in documents you would like to retrieve. This poses a theoretical problem, because it seems impossible to select terms from documents you do not know (since, following Socrates (Plato 380 BCE), if you already knew them, you would not be making a subject search for them). This has been interpreted as a claim about the principal impossibility for searching in general. In library and information science the distinction between “known item search” and “subject search” is well established. Sokrates/Plato’s argument is clearly not about known item searching, which obviously is unproblematic. In relation to subject searching this seems also unproblematic, as everyone is doing this on Google every day. There is an important point, however. Unknown documents of relevance for a given inquiry may have to be searched in a context and with concepts as well as symbolic systems unknown for the searcher. This is particularly the case if there have been paradigm shifts in the field of enquiry. Don Swanson is perhaps the only information scientists who have ever expressed the depth of this problem. He concluded (1986, 114): “Any search function is necessarily no more than a conjecture and must remain so forever”. The problem of knowing relevant search terms is, of course, made smaller because an initial search may provide hits containing further potential words to search (related to technologies known as “query expansion”, which often depends partly on KOSs for identifying synonyms, narrower terms, etc.). This means that iterative searches partly remedy the problem of identifying relevant search terms. Still, however, the initial conceptualization of the topic of the search is important. The main difference in relation to searches based on KOSs is that the latter provides conceptual structures to help navigate and thereby identify relevant terms, symbols, and concepts. A KOS may, for example, be a classification of cities according to geography, as done, for example, on a map or in a geographical classification system (a gazetteer), in which you are informed about a conceptual structure and may make adequate selections as you go. If you are interested in information about, for example, Swedish cities (including, perhaps, towns, villages and other settlements classified as such), this can be carried out about Sweden in general or about a region of Sweden; you do not have to know their names beforehand but can just use the classification. This is probably the basic difference between mainstream IR and KO. In IR, you typically depend on a match between a search term and documents containing this term in title, abstract, full text, etc. IR may of course also apply information such as descriptors, classification codes, etc., from KOSs, but the main approaches in IR is about information from the document itself, not about value-added information. The utilization of reference lists in documents for IR mostly form part of the field of bibliometrics, rather than in mainstream IR (see Hjørland 2013; Araújo et al. 2021). The study of how different parts of both the documents themselves and information added in bibliographical records contribute as “subject access points” for IR is discussed by Hjørland and Kyllesbech Nielsen 2001). Contrasting to IR, KO typically is about KOSs containing semantic relations between concepts and providing, for example, a full list of cities in a particular part of Sweden. In IR, there is a technique known as “relevance feedback” in which users may indicate whether a found item is relevant or not, and the system may modify its search by including words from items that the user has marked as relevant (a possible technique for “query expansion”). The search may also eliminate words from items marked as nonrelevant, and thus increase the precision of the search. This technique still presupposes, however, that the searcher knows which words are relevant. In our geographical example, if a user does not know whether a given city name suggested by the system is about a Swedish or a Norwegian city, they may not be able to provide useful feedback, and the feedback may be harmful by making the system suggest Norwegian cities rather than Swedish. If a user is searching for Swedish town, then “Stockholm” is a relevant hit, whereas “Oslo” is an incorrect hit. Therefore, criteria for what should be found (i.e., what is relevant) are not to be found in the searcher’s belief (or in psychological studies as suggested by an influential school in information science). Criteria for what should be found must be based on KOSs containing the best existing descriptions of the realities, often derived from scientific and scholarly studies. We recognize that the objectivity of science is an issue being debated in science studies. Still, however, this does not make any view as good as any other, and our geographical example demonstrates a relatively uncontroversial case. Looking at the principle underlying Google’s search engine, we find that four main principles are (a) “exact match”, (b) “best match”, (c) popularity measures, and (d) personalization (we shall not consider other issues such as the contents of the database and the influence of advertising, which are separate questions, less connected to the core theory of IR and KO). (a) If you type in a sentence, such as: “It seems to be based on the problematic assumption that relations between concepts are a priori”, Google will retrieve the one article (and its possible copies and versions) that contains this exact sentence. This exact match is obtained because the search applies proximity operators and thereby can retrieve documents identical to the query. This is not, however, what is generally understood by “exact match” techniques (or “set-retrieval”), which were defined by Turtle and Croft (1992, 284): Exact-match retrieval models use matching functions that, given a query, partition the document collection into two sets, those that match the query and those that do not. Documents in the matching set are generally not ranked (although they may be ordered by date, alphabetically, or some other criterion). Exact-match models are generally simple and efficient and form the basis of most commercial retrieval packages [in 1992, not in 2021]. By far the most common exact-match model is the Boolean model.(It is no longer true that retrieved sets are not ranked. In 2019, “best match” replaced “most recent” as the default sort order for search results in PubMed, cf. Fiorini et al. 2018; Sampson et al. 2021). Exact match techniques allow searchers to use a “building blocks search strategy”, in which well-defined search sets are constructed and combined by the searcher (see Harter 1986, 242). Exact match systems may or may not be combined with one or more KOS, but the principles behind exact match should be considered separately from the principles of KOSs. A disadvantage by exact match search techniques — if not combined with one or more KOS, as they usually are in “classical databases” — is, as we have seen, that the search is vulnerable about the users knowing the right terms, why the search may not be effective in terms of recall and precision. “Classical databases”, such as MEDLINE, are based on exact match techniques, and this seems important for serious searches, where high recall is important (e.g., in evidence-based medicine, cf. Hjørland 2015). (Frei and Qiu 1993 found that “the main problem of Boolean searching is not its performance. For many users the main obstacle is being able to use Boolean logic effectively in order to formulate queries in the way a commercial retrieval system requires”.) (b) If you type in a number of terms such as “concepts”, “relations” and “a priori” from the example in point a, Google will make a so-called “best match” search (also called “partial match”, “relevance ranking” or “weighted retrieval”) and retrieve millions of documents in a ranked order according to some principles, which are more or less business secrets. (The one article retrieved in point a is not among the top results.) To a large degree, the principles used are well established principles from IR research (see, e.g., Baeza-Yates and Ribeiro-Neto 2011; Manning et al. 2009; Roelleke 2013). These principles are mainly based on the relative frequency of terms in the whole database or collection, in the single documents and in the queries, in addition to issues such as the lengths of documents and the proximity of query terms within a document. Well-known examples of best match technologies are “vector space” (Salton et al. 1975) and “probabilistic” models (Robertson and Jones 1976). Additionally, kinds of artificial intelligence (machine learning techniques) are used, in which algorithms learn to distinguish relevant documents and rank them accordingly (see, e.g., Fiorini et al. 2018). Such technologies are considered superior in computer science. As Robertson (2008) wrote: “statistical approaches won, simply. They were overwhelmingly more successful” compared to other approaches such as thesauri. The disadvantages of best match technologies are (1) that the searcher does not have full control over the research process (but saves time if they choose to trust the algorithms), and (2) that the system ranks documents according to “relevance”, as if relevance is an objective concept, which clearly is a problematic assumption because different scientific perspectives and paradigms have different criteria for relevance (see Hjørland 2002; 2010). Best match techniques are often based on similarity measures, but “similar” is a relative concept: Anything is similar with any other thing, depending on criteria, and it is easy to demonstrate that similarity based on words can be problematic because that means that a given text will by this criterion not be considered similar to its translation; (3) the techniques work on words or symbol structures (as opposed to concepts), which are associated with different meanings in different contexts. However, finding documents about a given subject is different from finding documents containing given words, and even containing given concepts (see Hjørland 2017, Section 3). Furthermore, because the principles behind best match are statistical, there is an element of popularity measure in this. If a given term is associated with a given meaning in a given context, that meaning cannot be separately identified; instead, the dominating meaning influences what is found. In other words, the principle disregards the insight from Kuhn that terms change meaning after scientific revolutions, or, said differently, in a way, it considers signs to be independent of context, which is a problematic assumption. Today, best match techniques represent the dominating IR paradigm, as applied in search engines. It challenges the techniques applied in “classical databases” such as MEDLINE. Paris and Tibbo (1998) wrote: The results from this study, then, support Robertson and Thompson’s (1990) conclusion that there is little difference in the levels of efficiency between weighted and Boolean retrieval mechanisms, but directly contradict the statements made by Belkin and Croft (1987) and Turtle and Croft (1992) about the superior performance of partial match techniques over exact match techniques. These results do not in any way prove the superiority of exact match techniques over partial match techniques, but they do suggest that different queries demand different retrieval mechanisms. Further studies and analyses are needed to determine which elements of a query make it best suited for partial match or exact match retrieval. In evidence-based medicine (EBM), the use of classical databases still represents the dominating approach but is increasingly being challenged by best match techniques. Hjørland (2015) presents arguments for set-based techniques for purposes for which high recall is important (such as EBM). The change in the dominating search paradigm from selection power to query transformation implied a dequalification of professional searchers (information specialists) and of competent users. It is characteristic for professional searchers that they master a wide range of strategies to increase recall (finding more relevant documents) as well as to increase precision (avoiding more non-relevant documents). Robertson (2000, 4–5, italics in original) pointed out, however, that with the best match technologies used by search engines, not only has this mastering disappeared, but even the concepts have lost their meaning: To make a more direct statement: the concept of a precision-enhancing device has one meaning in the context of set-based retrieval, and another and quite different meaning in the context of ranked-output retrieval. The ‘same’ device (such as ‘using phrases’) might very well be a precision device in one context and not in the other. The term precision device itself was coined in the former context: whether it is a valid concept for the latter is not obvious. The same is the case for recall devices (2000, 5): Just to pursue the same line of argument a little further, recall devices are also problematic, despite their logical (rather than statistical) status in the set-retrieval context. Again, in the TREC tradition, we tend to measure recall at some arbitrary large cutoff (say 1000 documents). This immediately destroys any claim to logical status for a recall-enhancing device. Even if we do something which (logically speaking) can only increase the size of the retrieved set, such as expanding the query with a lot of synonyms, it might still reduce recall at 1000 documents. It seems that we, in the new context, have not only lost the professional ability to make qualified searching, but even in our research have lost important concepts and thereby part of the ability to understand what is going on in terms of optimizing IR. (c) It is well known that Google also uses a kind of popularity measure; the more in-links a certain document has, the greater the weight it is given and the higher it is listed in the ranked order shown to the user. This is often, if not in most cases, working very well because people often want the same as the majority. However, in searching for rare diseases, for example, this has proven a bad principle because rare diseases are, by definition, not a majority issue (for empirical demonstration of the failure of this principle for IR about rare diseases, see Dragusin et al. (2013a; 2013b). (d) The fourth major principle in search engines is personalization; Google can identify users’ IP address and thereby their physical location as well as their search history on Google, and may adapt, not just the advertisements, but also the so-called “organic results” in the ranked list presented to the user. This provides an element of subjectivity and randomness into the search and harms the ability to make conscious search strategies. It is also a double-edged sword; sometimes, it works well, but other times, you may want to eliminate this element, you may want more objective searches, you may have changed interests, or you may be searching on behalf of others. This is why the focus on past search interests may be harmful rather than fruitful. A major problem in Google’s principles is that scientific and scholarly criteria are absent in the four principles presented above. In our former example, we considered a search for all Swedish cities in a certain region of Sweden. Given a quality map, or gazetteer, such a query can be answered based on cartography or geographical research. This is just a simple example of the main view presented in this article, that what should be found by IR, and what should be represented in KOSs, is what is considered true knowledge according to our best research and scientific theories about the content or subject matter. Although other examples may be more difficult than our geographical one, this does not invalidate the principle, but raises the philosophical problem about how science and scholarship obtain knowledge, how robust that knowledge is, and whether it reflects an objective reality. The principle that IR should find documents according to their scientific trustworthiness (rather than, for example, according to the searcher’s guess on which words relevant documents must contain or according to popularity measures) seems to be an obvious demand, and it is surprising that this line or research in IR and KO seems to be almost entirely absent. Of course, academic quality and trustworthiness may be correlated with, for example, popularity measures and journal impact factors, but these are only indirectly associated with quality, and such correlations must be investigated before they should be relied on. For now, we leave the question on how science and scholarship discover or construe knowledge, but shall consider how the scientific and scholarly quality of search results may be considered in IR. There are different strategies for doing so, including:
To conclude this section, the working hypothesis behind this paper is that the dominating computer science approaches mainly focus on statistical relations between terms in single documents, terms in collections of documents and terms in queries, in addition to issues such as the lengths of documents and the proximity of query terms within a document. For example, a document that has all of the query terms occurring many times would be displayed first, followed by other documents where the query terms appear less. In addition, kinds of IR are used to identify “relevant” documents, often based on similarity measures. Although these approaches have so far been extremely successful, there is a need for alternatives based on knowledge of scholarly documentation and communication, including scholarly conceptions, traditions, and “paradigms” and the basis in the philosophy of science. This implies a more overall, top-down approach to IR. Such an approach is, among other things, about the construction of KOS, which is an interdisciplinary field in which computer science is also active, but which seems to be conflicting with dominating approaches to search engines. 4. Knowledge organization systems and the semantic staircaseThere are many kinds of KOS (cf. Mazzocchi 2018). Here, we just look at three kinds: classification systems, thesauri, and ontologies. It is the hypothesis that KOSs can be classified according to the semantic staircase (Figure 1), and that this model is the most important characteristic distinguishing kinds of KOS. Our sole aim in the description of these three kinds is to make this hypothesis clear to the reader. Therefore, many other issues concerning these KOSs are not dealt with in the following presentation. 4.1. Classification systemsKnowledge organization is primarily about bibliographic classification systems, which are systems for classifying documents and document representations. Documents are, however, about things in the world, e.g., about animals, celestial bodies, musical instruments, etc., and therefore bibliographical classifications to a high degree reflect classifications of things in the world. We may call such systems scientific classifications to distinguish them from bibliographic classifications, but scientific classifications in this sense include classifications made by scholars (e.g., → musical instruments or literary genres) and → folk classifications (e.g., genres of popular music). “Scientific classification” is here used as a generic concept for all kinds of classifications that bibliographic classifications may rely on. So, a bibliographic classification such as the Dewey Decimal Classification relies on how, for example, plants and animals have been classified by zoologists (although library classification systems in particular often are very conservative in updating, and unfortunately often reflect outdated knowledge, cf. Blake 2011, 469–470). The present article is written on the assumption that to serve important functions for IR, KOSs must be concerned with updated and trustworthy knowledge, rather than with outdated or problematic knowledge. Figure 2 shows an example of a classification system. The intention of this classification example is to illustrate two points: The first point is that the dominating kind of relation in classifications is the generic relation (or “is a” relation); a bird is a vertebrate, and a vertebrate is an animal (although other → hierarchical relations can also be used). The second point is that class names are also concepts: “birds”, “vertebrates” and “animals” are classes as well as concepts. We may therefore say that a classification system organizes concepts (this claim is not generally accepted; however, the main spokesman for the view that KOSs do not represent concept is Barry Smith, and we shall return to this point in Section 5). Finally, animal, vertebrate and bird are also words (or terms or symbols), and concepts having verbal expressions are said to be lexicalized. KOSs often, for example, list synonyms, which are relations between words rather than between concepts. Thus, classifications or KOSs also display lexical relations between words (or, more broadly, between signs since other kinds of → notations may be used). This is important because a major function of many KOSs is to serve as controlled vocabularies. 4.2. ThesauriThesauri are defined in ISO 2011 (ISO 25964-1; clause 2.62) as: “controlled and structured vocabulary in which concepts are represented by terms, organized so that relationships between concepts are made explicit, and preferred terms are accompanied by lead-in entries for synonyms or quasi-synonyms”. A problem with this and related definitions in other standards is, however, that they fail to distinguish thesauri from ontologies. The solution suggested here is to define a thesaurus as a KOS with the limited and predefined set of semantic relations it displays. If that set is expanded, we are no longer dealing with thesauri but with ontologies. Figure 3 shows an example from a thesaurus. A thesaurus may also contain a classification system, and this is the case with the UNESCO Thesaurus (the terms are then organized hierarchically rather than alphabetically). This also points to the narrow relations between kinds of KOS. Explicitly, the ISO (2011) definition of thesauri as well as the UNESCO thesaurus organizes
concepts. Mostly, thesauri also have lead-in terms (or synonyms) and thus also organize
terms. We see again the generic relation between concepts (broader, narrower), but now also
another relation: “related concepts”. Thus, thesauri contain more explicit semantic relations
than classification systems. (The UNESCO thesaurus is, by the way, not without problems.
For example, zoology is normally not considered a broader concept in relation to birds, but
a broader concept in relation to ornithology, and 4.3. OntologiesOntologies are kinds of KOS that are used in relation to front-end information technologies such as “the semantic Web”, but which are also used — in line with traditional KOSs — for IR/literature searching (see e.g. Wächter et al. 2008). Compared to classification systems and thesauri, they mostly have a much higher level of granularity and are closely related to actual scientific research in the domain. In practice, they tend to be more explicit and precise in their definitions. The Foundational Model of Anatomy ontology (Rosse and Mejino 2008) describes the difference between an anatomical ontology and other anatomical tools such as atlases, textbooks, dictionaries, thesauri, or term lists. In relation to thesauri, it is written that: Thesauri organize their content according to the meaning of their terms. However, since these terms are not explicitly defined, the meanings have to be implied by each user on
the basis of perceived similarities and differences between terms. The FMA, by contrast
explicitly defines the classes of its taxonomy, and links all these classes through an inheritance hierarchy to a single root:
Compare, however, this quote with the following by Aitchison et al. (2000, 34):
The symbol SN is used [in thesauri] to represent scope notes, which sometimes include definitions […]. As the trend is now toward the blurring of the difference between thesauri and terminological databanks, the tendency appears to be towards the increase in the number of definitions in thesauri. Svenonius (1997) advocates the inclusion of as much definitional material as possible. More attention appears to be given to the form of definitions. For example, a model is suggested (Hudon 1996) for preparing logical definitions for indexing and retrieval thesauri. The inclusion of more or less definitions should not be taken as a definitional difference, since this is a quality issue that varies widely among individual KOSs. Ontologies are also mostly constructed by using formal languages, and many authors consider the use of such formal languages a necessary condition for a KOS to be an ontology. Gruber (1993, 199) wrote: A body of formally represented knowledge is based on a conceptualization: the objects, concepts, and other entities that are presumed to exist in some area of interest and the relationships that hold among them (Genesereth and Nilsson 1987). A conceptualization is an abstract, simplified view of the world that we wish to represent for some purpose. Every knowledge base, knowledge-based system, or knowledge-level agent is committed to some conceptualization, explicitly or implicitly.Thereafter followed a widely cited definition: An ontology is an explicit specification of a shared conceptualization. The same definition seems, however, to be valid for, for example, classification systems
such as the periodic table in physics and chemistry. Colomb (2007, 42) actually uses the
periodic table as an example of an ontology and writes: “This example is interesting
because it is an ontology with several facets of subclasses, and because it includes a system
of instances as well as classes”). Gruber’s definition also seems to fit biological taxonomies,
and is therefore unspecific. It is a fundamental ambiguity in the use of the term ontology in information science in that it is both used (as in the semantic staircase, Figure 1) as one
specific kind of KOS with some specific requirements (see, e.g., Soergel et al. 2004), and as a generic term
for other kinds of KOS. Following the idea of the semantic staircase, it is here suggested to define ontologies as kinds of KOS with the largest number of semantic relations between
the concepts. It is typical of ontologies, however, that they often represent connections
between entities and properties. The Fish Ontology architecture (Ali et al. 2017, 6), for example,
provides links between the property Another aspect of Gruber’s definition is the already mentioned controversy about whether “concepts” and “conceptualizations” should be considered the units in ontologies, a problem that will be discussed later in this article. One issue related to this problem should, however, be mentioned here. Ontologies are often supposed to be tools from which any new tools needed in the future might be produced. Rosse and Mejino (2008, 59) wrote: “The Foundational Model of Anatomy (FMA) ontology is being developed to fill the need for a generalizable anatomy ontology, which can be used and adapted by any computer-based application that requires anatomical information”. They also wrote, however, that FMA “is both a theory of anatomy and an ontology artifact”. As such, it is a conceptualization in Gruber’s sense, and as such its application has inbuilt limitations in relation to applications based on other conceptualizations, an issue we come back to in the discussion of concepts and realism. Smith et al. (2005) suggested the following relations as the most important ones for biomedical ontologies:
We observe the expansion of semantic relations compared to classification systems and thesauri. There seems to be no limit to the number of relations that may be used, and new kinds are discovered (or constructed) when ontologies are constructed for new domains. Ontologies therefore differ from classifications and thesauri by providing many more kinds of semantic relations between concepts. (An anonymous reviewer suggested that this list by Smith et al. 2005 “is just making up reality, an illusion of reality for the sake of efficiency and consistency”. Perhaps it is better to say that it is one selection among other possible selections, the fruitfulness of which represents a theoretical assumption in need of justification.) 4.4. The semantic staircaseThe semantic staircase is a classification of KOSs according to how many kinds of semantic relations they display. According to Olensky (2010), the term semantic staircase was first used in German by Blumauer and Pellegrini (2006, 16) as “Semantische Treppe”. Obrst (2010, 30–35) presented a related term “The ontology spectrum” which is a classification, not of KOSs, but of “ontologies”, which considers, for example, classification systems and thesauri as kinds of ontologies. In our descriptions from classification systems over thesauri to ontologies, we showed that the number of semantic relations did indeed increase. Regarding Figure 1, it should be noted that a glossary typically is an alphabetic listing that does not provide semantic relations between the concepts, and that we consider taxonomy and classification to be synonyms. The verification of the hypothesis of the semantic staircase requires that it can be shown that the higher forms of KOS are able to represent the lower forms. More research on this is needed, but some supporting views are: Garshol (2004) suggested that topic maps (which he says are based on an ontology framework) can represent other kinds of KOS: The relationship between topic maps and traditional classification schemes might be that topic maps are not so much an extension of the traditional schemes as on a higher level. That is, thesauri extend taxonomies, by adding more built-in relationships and properties. Topic maps do not add to a fixed vocabulary but provide a more flexible model with an open vocabulary. A consequence of this is that topic maps can actually represent taxonomies, thesauri, faceted classification, synonym rings, and authority files, simply by using the fixed vocabularies of these classifications as a topic map vocabulary. Another supporting view is the idea that it is possible to transform a classification system into a thesaurus (without related terms). Aitchison (1986) examined if the second edition of the Bliss Bibliographic Classification can be used as a source for thesaurus terms and structure (i.e., concepts and their semantic relations). Although she described some problems, these problems seem not to refuse the idea that a classification can be transformed into a thesaurus, but just to point out some issues in the specific classification used (one could say some problems in its quality). A third supporting view is that it seems to be evident, that if it can be established, for example, that a bird is a vertebrate (or in general that X is an A), then this is a building block that can be used in both classifications, in thesauri and in ontologies, or in any other kind of KOS. By implication, it seems unfruitful to continue studying, for example, classifications and thesauri, as separate objects. We should rather be studying KOSs in general, i.e., concepts, conceptual systems, and conceptual/-semantic relations. (Nevertheless, of course, anything we have learned about, for example, classification schemes and thesauri, is still useful in this generalized context.) Different kinds of KOS are different in relation to the kinds of semantic relations they can display. However, a central issue is not about kinds of KOS but about determining the relevant/fruitful/true relations. An anonymous reviewer wrote: In fact another interpretation […] could be that ontologies impose the constraints (sometimes simplifications) required by computer logic and the definition of classes, inheritance and hierarchy that are proper of object-oriented programming, while the scope notes and the “logical inconsistencies” of thesauri could present a more flexible opportunity to explain and represent the complexities of science in a more humanistic/verbal way.This quote raises some deep and very interesting problems. In this connection it can be mentioned that Temmerman (1997) wrote about “Questioning the Univocity Ideal” in terminology studies and that Deemter (2010) from a general philosophical point of view, wrote about praising vagueness. Such references support the question addressed by the reviewer, which, to my knowledge, never has been seriously addressed in knowledge organization. If fruitful, this view challenges the idea of the semantic staircase. There are also more traditional issues about scientific and scholarly criteria for IR and KO. For example, how do we determine whether X is a kind of A? It has been claimed by Svenonius (2004, 583) that “paradigmatic relationships are those that are context-free, definitional, and true in all possible worlds”. At the same time, the literature demonstrates a common understanding that paradigmatic relations are the kinds of semantic relations used in thesauri and other knowledge organization systems (including equivalence relations, hierarchical relations, and associative relations). It is a strange claim. Relations between species of birds, for example, are, as discussed in Section 5.2 determined in ornithology and subject to different theories and paradigm shifts (see further Hjørland 2015). To a large degree, this must be done, of course, by scientific research. So, a good KOS is one that is based in solid subject knowledge, while a bad KOS is not. The view expressed by Svenonius (2004) discourages information specialists to consider the scholarly literature. If KOSs shall be used and serve their functions, they must be trusted by the users. Unfortunately, there are indications that this need not be the case (cf. Fidel 1991, 511 who wrote: “Over half the time searchers neglected to consult a thesaurus, they did so either because they did not trust the quality of the thesaurus, because the thesaurus was not available, or because they had to search several databases for a request”). 5. Concept theory and realismSo far, we have assumed that concepts are the elements in KOSs, but also said that this view is not without its detractors. The view that KOSs are primarily about the organization of concepts and that concepts are units of knowledge, has been expressed by, among others, Dahlberg 2009; Hjørland 2003; Sowa 1984; Patel et al. 2019. There are, however, reasons here to reconsider these claims. As formerly indicated, Barry Smith is probably the leading detractor, but also Machado et al. (2020) asked if KO can do without concepts and Herre (2010), although disagreeing with Smith by considering concepts important, has also saw universals as a necessary category in KOSs. As we consider this discussion of high importance, we shall address it in some depth. The questions to be addressed in the subsections of this section are: Section 5.1: Challenges from “Smithian realism”, should concepts be replaced by “universals” as the units in KOSs? Section 5.2: What are concepts? The semiotic triangle. Are concepts units of knowledge? Section 5.3: Does a KOS need to contain universals and symbolic structures in addition to concepts as claimed by Herre (2010, 301)? Finally, in Section 5.4: Pragmatic realism. 5.1. Challenges from “Smithian realism”Smith and co-authors (Smith 2004; Smith and Ceusters 2007; Arp et al. 2015) discuss ontologies and criticize the conceptualist understanding. Arp et al. (2015, 7) write: The code assigned to France, for example, is ISO 3166-2:FR and the code is assigned to France itself — to the country that is otherwise referred to as Frankreich or Ranska. It is not assigned to the concept of France (whatever that might be). This example is somewhat atypical for concepts and a bit difficult because (1) France
is an individual concept rather than a general concept; (2) the meaning of the concept
“France” is determined by publicly available conventions: we know how the borders
and the definition of a particular country is decided — typically following wars (whereas
scientific concepts typically are developed by research). Nonetheless, even in this case,
it can be argued that the ISO code 3166-2:FR is assigned to a part of reality determined
by a conception, as we shall see when we introduce the semiotic triangle in Section 5.2.
(The related term As the alternative for concepts, Smith, in many writings, has argued that “universals” or “types” are the units in KOSs. Smith and Ceusters (2010) presented some definitions of realism, antirealism, nominalism and conceptualism, but then declared (140–141): Since 2002 we have been attempting to move beyond such disputes by developing a methodology, which we call ‘ontological realism’, that will capture what we believe to be a kernel of practical significance in these debates by addressing the question what it is to which the terms used in ontologies should be seen as referring. Because ontological realism is a methodology, and not a doctrine, it stands in no logical relation to any of the metaphysical doctrines specified above. This capitulated attempt to base the realist methodology in deep philosophical arguments looks like a weakness; is it perhaps a partial retreat from earlier realist claims? Types and universals are explained in this way. Smith and Ceusters (2010, 141): Types or universals — we shall always use these terms synonymously in what follows — are to be understood as counterparts in reality of (some of) the general terms used in the formulation of scientific theories. Particulars are concrete individual entities (entities that exist in space and time and that exist only once); types or universals are to be understood as repeatable. This means that, for each given type, we can in principle discover of indefinitely many particulars that they are its instances. It has been agued by Herre (2010) that Smith and followers are wrong, that KOSs cannot do without concepts. He wrote (2010, 303) that Smith’s position (described in, among other places, Smith 2004; Smith and Ceusters 2007) is:
Herre (2010, 303–304) found that the problem in Smith’s argument is that in relation to condition 3, no definition for reality representation is provided and that there is no representation of reality without concepts. This is not seen as a problem for realism in general, only for what he 2010, 303) termed “Smithian realism” in contrast to his own “integrative realism”. Arp, Smith and Spear (2015, 7) further wrote: The goal of ontology for the realist is not to describe the concepts in people’s heads. Rather, ontology is an instrument of science, and the ontologist, like the scientist, is interested in terms or labels or codes—all of which are seen as linguistic entities — only insofar as they represent entities in reality. The goal of ontology is to describe and adequately represent those structures of reality that correspond to the general terms used by scientists. This quote is important because KOSs should be based on knowledge developed by scientists and not — as assumed by cognitive theories — by psychological studies of people, which clearly seems a kind of idealism and opposed to realism. Still, however, we need to consider concepts. There are two levels involved in discussing concepts in KOSs: (1) the researchers doing the research are influenced by different paradigms, which make scientists’ use of general terms concepts, rather than passive registrations of reality; (2) at the level of KOS construction, the information scientists must consider the scientific literature. Again, this cannot be just as passive registrations of reality, selections and decisions are made. All this is missing in “Smithian realism”, but is well-captured by Leonelli (2016, 32–33), who made a description for the real-life problems interpreting the scientific literature for metadata construction: TAIR curators wishing to collect data on a given gene (say the Unknown Flowering Object [UFO] gene in Arabidopsis thaliana) could not compile data from each relevant publication, as it would be too time consuming: even just a keyword search on PubMed for “UFO Arabidopsis” results in over fifty journal articles, only one or two of which are used as a reference for an annotation. Hence curators chose what they saw as the most up-to-date and accurate publications, which as a consequence became “representative” publications for that entity […]. These choices are impossible to regulate through fixed and objective standards. Indeed, bioinformaticians have been trying to automate the process of extraction for years, with little success. The very reasons why the process of extraction requires manual curation are the reasons why it is hard to divorce it from subjective judgment: the choices involved are informed by a curator’s expertise and her ability to bridge between the original context of data production and that of data dissemination. To conclude this Section: “Smithian realism” represents important arguments about finding the warrant of KOSs in the scholarly literature rather than in the heads of people. Still, however, its insistence on “universals” and a naïve approach to reality representation is problematic; we cannot do without concepts. 5.2. What are concepts?To understand concepts, we shall first have a look at the semiotic triangle (or “the triangle of meaning”). The version used here was produced by Ogden and Richards (1923, 14) in a discussion of the relations between thoughts, words, and things. The triangle has, however, a long history (see Sowa 2000, 58–59). The “referent” in Figure 4 is in some versions of the semiotic triangle called “object”, “symbol” is sometimes termed “sign vehicle”, and “thought or reference” may be termed “concept” or “sense”. The broken line at the base of the triangle indicates that there is not a direct relationship between the symbol and the referent: A given symbol is only related to a referent by somebody (or a system) knowing this sense of the symbol (e.g., the term cat is only understood as referring to a cat by people or systems with this knowledge of English). The Danish structural linguist Louis Hjelmslev (1943, 81) demonstrated that a term in one language often does not correspond exactly to the equivalent term in another language. Cat may have a slightly different meaning in relation to the German Katze: Each natural language is a classification system that classifies the world differently. Another way to express this is that the model involves mediation: the object is related to the sign vehicle via the mediation of the concept/sense. This understanding of the mediated nature of terms is in opposition to the view presented above as “Smithian realism” and to the corresponding suggestion to use universals as units in KOSs. The mediated view relates to a broad range of philosophies. It is implied, for example, in Kant’s philosophy, in Peirce’s and other pragmatists’ thinking, in hermeneutics (in the hermeneutic circle), and in Thomas Kuhn’s philosophy of science, to which we now turn. Kuhn (1962) wrote about scientific revolutions, for example, how the Copernican theory that the Earth revolves around the Sun replaced the former theory of Ptolemy that the Sun revolves around the Earth. Kuhn found that in such “paradigm shifts”, the terms involved in the theories gained new meanings. Kuhn highlighted the issue of conceptual changes in science and has had a huge influence on the thinking about concepts and conceptual changes. Thagard (2003, 666–667) wrote: [T]he acceptance of the Copernican theory that the earth revolves around the sun required the rejection of the Ptolemaic theory that the sun revolved around the earth. Replacement was not merely a matter of one theory being substituted for another, but also involved shifts in meaning of the concepts used in the theories. In the Copernican revolution, for example, the concept “planet” shifted to include the earth and exclude the sun and moon”. Kuhn thus exemplified changes in the meaning of terms: Paradigm one: Ptolemaic astronomers might learn the concepts "star" and "planet" by having the Sun, Moon, and Mars pointed out as instances of the concept "planet" and some fixed stars as instances of the concept "star". Thus, the terms star and planet gained a new meaning and astronomy gained a new classification of celestial bodies. A given KOS may organize concepts such as "star" and "planet" and such an organization necessarily represents a given paradigm. There is no way to define or organize star and planet independent of paradigm/interpretation. This example fits the semiotic triangle very well: there are no direct connections between a part of reality and the symbol used for it, the connection depends on the concepts, which again depends on conceptions/paradigms. Some readers may argue that this example is not of much relevance because today we know that Copernicus was right. This is established knowledge and is no longer just considered a theory. Therefore, contemporary science need not consider "star" and "planet" as concepts based on a conception or a paradigm. We can just follow Smith and say that we are referring to universals or types understood as observer-independent invariants of reality. This is wrong, however (although typical for what Kuhn termed “normal science”). Contemporary science depends also on concepts that are based on underlying conceptualizations, and it is important to understand concepts as embedded in theories. Only one example shall be given here: In 1992, the first volume of the Handbook of the Birds of the World (Del Hoyo et al. 1997) was published and volume 17, the most recent volume, was published in 2013. During the 21-year period of publishing this handbook, the classification of birds changed substantially (cf. Fjeldså 2013). There are indications that the shift in bird classification suggested by Fjeldså in the last volume represents a paradigm shift in the sense of Kuhn compared to the classification used in the work, decided before the first volume was published. This shift of classification in ornithology is part of broader paradigm of developments in biological taxonomy during the 20th Century. However, in opposition to Kuhn’s description in the physical sciences, these biological paradigms tend to exist in parallel. This issue, whether paradigms only exist one at a time or at the same time as competing programs, is a point where many philosophers disagree with Kuhn. This is also the case with the present author, as reflected in definition of concepts as cited in the present article. Among these biological paradigms are numerical taxonomy (or phenetics), which uses the overall likeness of organisms as a classification criterion and → genealogical classification which uses common ancestry as the basis of classification. The development of molecular techniques in biological taxonomy has of course also had a huge influence the development towards the new classification suggested by Fjeldså. The question for us is: has this revolution in classification changed the concepts used in ornithology, e.g., in the name of species and families of birds? Mayr and Bock (1994, 12, italics in original) provided the following example: When reviewing the manuscript of an excellent new ornithological text, one of us was startled to read the comment ‘the Yellow-throated Longclaw (Macronyx croceus), a member of the pipit family (Passeridae)’. Every ornithologist knows that the pipit family is the Motacillidae and that the Passeridae (the Old World sparrows), if recognized as a separate family, is composed of the sparrows of the genera Passer, Petronia, Carpospiza and Montifringilla. After recovering from our shock, we realized that the authors of this text were following the newly proposed classification by Sibley and Ahlquist (1990), in which the pipits and their relatives are placed as a subfamily, Motacillinae, together with the Passerinae, Prunellinae, Ploccinae and Estrildinae, in an expanded family Passeridae. The point is not whether Sibley and Ahlquist are correct in allying these taxa into a single family but rather a matter of case of communication among all ornithologists. Even as specialists in avian systematics, we had difficulty understanding the quoted expression and required several minutes to realize what the authors meant. One of the characteristics of Kuhn’s paradigms is the taxonomic incommensurability thesis that makes communication difficult between researchers working in different paradigms. Therefore, the quote by Mayr and Bock (1994) can be taken as an indication that a Kuhnian paradigm shift has taken place in ornithology, and that the concepts indeed changed. What, then, are concepts? Whereas concepts are often understood as internal representations in individuals, Kuhn’s theory considers their public, social nature as primary. Only secondarily concepts become internal representations as something individuals learn by participating in a culture, subculture, disciplinary tradition, or paradigm. On this basis, Hjørland (2009, 1522–1523) suggested the following definition: Concepts are dynamically constructed and collectively negotiated meanings that classify the world according to interests and theories. Concepts and their development cannot be understood in isolation from the interests and theories that motivated their construction, and, in general, we should expect competing conceptions and concepts to be at play in all domains at all times. This definition partly provides an answer to the problem formulated in the start of this Section 4: are concepts units of knowledge? Kuhn’s claim that concepts have different meanings in different paradigms can be considered a version of “meaning holism” or “semantic holism”. The concept “information” seems to be a clear example in library and information studies (LIS), where, for example, Shannon’s information theory, the cognitive view, semiotic and social-oriented views seem to provide incommensurable concepts of “information”. We may still say that concepts are units of knowledge in the sense that any sentence expressing knowledge (or knowledge claims) are built on terms representing concepts. In relation to concept analysis, however, it seems necessary to consider the theories of which concepts form parts (e.g., one cannot answer the question “what is information” without considering the different theories and interests for which this concept is considered important). 5.3. Does a KOS need to contain universals and symbolic structures in addition to concepts?Herre (2010, 301) wrote: “We hold that any reasonable foundational ontology must include these three types of categories [universals, concepts, and symbol structures]”. Because ontologies are kinds of KOSs (cf. Biagetti 2020), we shall here not limit the discussion to (foundational) ontologies but consider this problem as a general issue for all kinds of KOS. Herre’s discussion is theoretically advanced, but nonetheless, there is a need to consider his definitions briefly. He defined these concepts as follows:
A few objections to Herre’s definitions are:
Words, terms, symbols, and symbolic structures are often used in KOSs to represent concepts. In addition, KOSs may contain other words that do not refer to concepts but just to other words. A KOS can be a pure conceptual structure (e.g., classifying animals as in Figure 2) and the relation between concepts are semantic relations. However, very often, a KOS is also constructed as a controlled vocabulary, which includes synonyms for each concept. The concept "city" may be represented by, for example, the terms city and metropolis. In thesauri, synonyms are displayed as “lead in terms” to the “preferred terms”. We may distinguish between the pure conceptual or semantic structure itself (e.g., the kinds of animals and their relations) and the lexical (or lexical semantic relations) between terms, e.g., which terms are considered synonyms. The distinction made here between semantic relations and lexical relation is not common in the linguistic literature, which seems to be unclear on this point. This distinction represents, however, a tradition in knowledge organization. Soergel (1998, 2–3), for example, wrote “WordNet makes the commonly accepted distinction between conceptual-semantic relations, which link concepts, and lexical relations, which link individual words”. And: “Synonymy is, of course, a lexical relation, and terminology relations are relations between words or between words and concepts, but not relations between concepts”. In this context, it should be emphasized that synonymity is not an intrinsic quality of words but is the characteristics that two or more signs are considered replaceable/interchangeable by somebody, in a given context. An example: The Thesaurus of Psychological Index Terms (visited 8 February 2021) lists The conclusion concerning words or symbolic structures is that they often are parts of KOSs, but not necessarily. We have also claimed that universals (as defined by Herre) cannot form part of KOSs, as there is no way to include the corresponding universals as something in addition to concepts. This will be explored in more detail in the following Section. 5.4. Pragmatic realismSo far, we have encountered two different kinds of realism: “Smithian realism” and Herre’s “integrative realism” and we saw that “Smithian realism” was an attempt to avoid forms of psychologism and idealism. Herre refers to Searle (1995) and his claim of realism being based on the construct “common intentionality” which is a result of communication and society. However, as Kuhn (1962) demonstrated, it is not enough that a given group of people connects the same meaning to something (e.g., define the term “planet” in the same way) because after a paradigm shift, the term is defined in a new way, and the former view is now understood as subjective. As we cannot exclude the possibility of yet another paradigm shift, we cannot guarantee that the new understanding is realist, as opposed to a collective subjectivism. Therefore, universals cannot be represented, only concepts (and symbols). How can this view be called “realism” or “materialism” as opposed to “subjectivism” and “idealism”? It is certainly not a claim that there exist specific scientific methods that can guarantee objective representations in KOSs (if this was the case, we should have defended universals rather that concepts as the units). Pragmatic realism is the view that paradigms overall develop toward better representations of reality, that science makes progress (a view conflicting with Kuhn’s) and that good science is more than observation and logic: it is also about values and social interests. Research reflects reality and social interests at the same time, as argued, for example, by Barnes et al. (1996), and the better this is considered, the more realist research can be. The realism of science is not given by a well-defined methodology, but by self-correcting mechanisms and by the role of pragmatic factors in theory-acceptance. While Kuhn (1970, 263) emphasizes how our ontologies are implied by our theories and paradigms, he nevertheless emphasizes that we cannot freely invent arbitrary structures: “Though different solutions have been received as valid at different times, nature cannot be forced into an arbitrary set of conceptual boxes. On the contrary […] the history of the developed sciences shows that nature will not indefinitely be confined in any set which scientists have constructed so far”. The world provides resistance to our conceptualizations in the form of anomalies, that is, situations in which it becomes clear that something is wrong with the structures given to the world by our concepts. In this way, Kuhn’s view may be interpreted as (pragmatic) realist. 6. ConclusionsWhen people seek documents, information, or knowledge to answer or clarify questions, they should be given the knowledge that corresponds to our best scientific or scholarly theories and findings. Processes and systems for providing such knowledge developed in IR and KO should provide “relevant” documents to users. There has, however been a problematic tendency in information science to understand “relevance” as either based in user studies and cognitive science (in “the cognitive paradigm”) or in technological issues (in “the systems view”). The neglected third position is to base relevance in subject knowledge and, ultimately, in the philosophy of science (cf. Hjørland 2010). Because Kuhn (1962) refused the positivist idea of “incrementalism” (that there is a continuous accumulation of an ever-increasing stock of truths), the identification of the most qualified and relevant documents is difficult. The literature (or “the universe of recorded knowledge”) in which we perform IR cannot just be considered bits of true knowledge in which each bit is as good as any other. On the contrary, the literature must be understood as a mixture of different voices, some of which conflict with each other. The relevance of a given search set of documents (or a given relevance ranking of documents) is therefore a hypothesis, the answer to which concerns the conflict between different paradigms in the subject area. This is step deeper than the problem raised by Swanson (1986) that any search function forever must remain a conjecture, because it makes the adequacy of search functions — and thereby search engines and knowledge organization systems — depending on paradigms in the subject area. Based on this insight, Hjørland (2017; this conclusion is only in the online version 1.4) suggested that the domain analytic approach to classification and KO can be summarized in this way:
Research in ontologies as KOSs is today the field, in which subject specialists and philosophers are working together with computer and information scientists. As has been demonstrated in the present article, conflicting philosophies are also at play in this domain, and we have demonstrated the need of an approach related to Kuhn’s theory of paradigms in addition to pragmatic and critical theories acknowledging the role of goals, interests, and consequences in knowledge. The article has thus provided the arguments and conceptualizations put forward in the introduction for rethinking IR and KO to provide documents and knowledge that are in accordance with our best substantiated knowledge claims. AcknowledgmentsThe author thanks the three anonymous reviewers of the original journal for fine reviews, two of which increased the quality of the article. The journal uses "open reviews", they are published at https://www.mdpi.com/2078-2489/12/3/135/review_report. Claudio Gnoli was guest editor of the original special issue. ReferencesAcharya, Anurag, Alex Verstak, Helder Suzuki, Sean Henderson, Mikhail Iakhiaev, Cliff Chiung Yu Lin and Namit Shetty. 2014. “Rise of the Rest: The Growing Impact of Non-Elite Journals”. http://arxiv.org/pdf/1410.2217v1.pdf. Aitchison, Jean, Alan Gilchrist and David Bawden. 2000. Thesaurus Construction and Use: A Practical Manual, 4th. Ed. London: Aslib Aitchison, Jean. 1986. “A Classification as a Source for a Thesaurus: The Bibliographic Classification of H. E. Bliss as a Source of Thesaurus Terms and Structure”. Journal of Documentation 42, no.3: 160-81. Ali, Najib M., Haris A. Khan, Amy Y-Hui Then, Chong Ving Ching, Manas Gaur and Sarinder Kaur Dhillon. 2017. “Fish Ontology Framework for Taxonomy-based Fish Recognition”. PeerJ 5: e3811; DOI 10.7717/peerj.3811 Anderson, James D. and José Pérez-Carballo. 2005. Information Retrieval Design: Principles and Options for Information Description, Organization, Display and Access in Information Retrieval Databases, Digital Libraries, Catalogs, and Indexes. St. Petersburg, Fl: Ometeca Institute. Available as HTML at: https://web.archive.org/.... Araújo, Paula Carina de, Renata Cristina Gutierres Castanha and Birger Hjørland. 2019. “Citation Indexing and Indexes”. ISKO Encyclopedia of Knowledge Organization, eds. Birger Hjørland and Claudio Gnoli. https://www.isko.org/cyclo/citation Arp, Robert, Barry Smith and Andrew D. Spear. 2015. Building Ontologies with Basic Formal Ontology. Cambridge, MA: The MIT Press. Baeza-Yates, Ricardo and Berthier Ribeiro-Neto. 2011. Modern Information Retrieval: The Concepts and Technology behind Search (2nd ed.). New York: Addison Wesley. Barnes, Barry, David Bloor and John Henry. 1996. Scientific Knowledge: A Sociological Analysis. Chicago: The University of Chicago Press. Belkin, Nicholas J. and William Bruce Croft. 1987. “Retrieval Techniques”. Annual Review of Information Science and Technology 22, 109-45. Biagetti, Maria Teresa. 2020. “Ontologies (as knowledge organization systems)”. In ISKO Encyclopedia of Knowledge Organization, eds. Birger Hjørland and Claudio Gnoli. https://www.isko.org/cyclo/ontologies Blake, James. 2011. “Some Issues in the Classification of Zoology”. Knowledge organization 38, no. 6: 463-72. Bliss, Henry Evelyn. 1933. The Organization of Knowledge in Libraries and the Subject Approach to Books. New York: Henry Holt. Blumauer, Andreas and Tassilo Pellegrini. 2006. “Semantic Web und semantische Technologien: Zentrale Begriffe und Unterscheidungen”. In Semantic Web, eds. Tassilo Pellegrini and Andreas Blumauer. Berlin: Springer, 9-29. https://doi.org/10.1007/3-540-29325-6_2. Caputo, John D. 2018. Hermeneutics: Facts and Interpretation in the Age of Information. London, UK: Penguin. Colomb, Robert M. 2007. Ontology and the Semantic Web. Amsterdam, Netherlands: IOS Press. Dahlberg, Ingetraut. 2009. “Brief Communication: Concepts and Terms – ISKO's Major Challenge”. Knowledge Organization 36, no. 2/3: 169-77. Deemter, Kees van. 2010. Not Exactly: In Praise of Vagueness. Oxford, UK: Oxford University Press. Del Hoyo, Josep, Andrew Elliott and Jordi Sargatalet Vicens (eds). (1992-2013). Handbook of the Birds of the World. Vol. 1-17. Barcelona: Lynx Edicions. Dragusin, Radu, Paula Petcu, Christina Lioma, Birger Larsen, Henrik L. Jørgensen, Ingemar J. Cox, Lars Kai Hansen, Peter Ingwersen and Ole Winther. 2013a. “FindZebra: A Search Engine for Rare Diseases”. International Journal of Medical Informatics 82, no. 6: 528-38. http://www.sciencedirect.com/science/article/pii/S1386505613000166 Dragusin, Radu, Paula Petcu, Christina Lioma, Birger Larsen, Henrik L. Jørgensen, Ingemar J. Cox, Lars Kai Hansen, Peter Ingwersen and Ole Winther. 2013b. “Specialised Tools are Needed when Searching the Web for Rare Disease Diagnoses”. Rare Diseases 1, no. 1: Article: e25001. doi:10.4161/rdis.25001. http://www.tandfonline.com/doi/full/10.4161/rdis.25001 Fellbaum, Christiane. 2010. “WordNet”. In Theory and Applications of Ontology: Computer Applications, eds. Roberto Poli, Michael Healy and Achilles Kameas. Dordrecht: Springer, 231-43. DOI 10.1007/978-90-481-8847-5_10. Fidel, Raya. 1991. “Searchers’ Selection of Search Keys: II. Controlled Vocabulary or Free-Text Searching”. Journal of the American Society for Information Science 42: 501–14. Fiorini, Nicolas, Kathi Canese, Grisha Starchenko, Evgeny Kireev, Won Kim, Vadim Miller, Maxim Osipov, Michael Kholodov, Rafis Ismagilov, Sunil Mohan, James Ostell and Zhiyong Lu. 2018. “Best Match: New Relevance Search for PubMed”. PLoS Biology 16, no. 8: e2005343. https://doi.org/10.1371/journal.pbio.2005343. Fjeldså, Jon. 2013. “Avian Classification in Flux”. In Handbook of the Birds of the World. Special volume 17 (pp. 77-146 + references, pp. 493-501). Barcelona: Lynx Edicions. Frei, Hans-Peter and Yonggang Qiu. 1993. “Effectiveness of Weighted Searching in an Operational IR Environment”. In Information Retrieval ’93, von der Modellierung zur Anwendung; Proceedings der 1. Tagung Information Retrieval '93. Konstanz: Universität Verlag Konstanz, 41-54. Preprint available at: http://citeseerx.ist.psu.edu/... Furner, Jonathan. 2016. “Type–Token Theory and Bibliometrics“. in Theories of Informetrics and Scholarly Communication, ed. Cassidy R. Sugimoto. Berlin: De Gruyter Saur, 119–47. DOI: https://doi.org/10.1515/9783110308464-009. Garshol, Lars Marius. 2004. "Metadata? Thesauri? Taxonomies? Topic maps! Making sense of it all". Journal of Information Science 30, no. 4: 378-391. Available online at: http://www.ontopia.net/topicmaps/materials/tm-vs-thesauri.html. Genesereth, Michael R. and Nils John Nilsson. 1987. Logical Foundations of Artificial Intelligence. Los Altos, CA: Morgan Kaufmann. Gruber, Thomas R. 1993 "A Translation Approach to Portable Ontology Specifications". Knowledge Acquisition 5, no. 2: 199–220. Harter, Stephen P. 1986. Online Information Retrieval: Concepts, Principles, and Techniques. New York: Academic Press. Herre, Heinrich. 2010. “General Formal Ontology (GFO): A Foundational Ontology for Conceptual Modelling”. In Theory and Applications of Ontology: Computer Applications, eds. Roberto Poli, Michael Healy and Achilles Kameas. Dordrecht: Springer, 297-345. DOI 10.1007/978-90-481-8847-5_14. Hjelmslev, Louis. 1943. Omkring Sprogteoriens Grundlæggelse. Copenhagen, Denmark B. Lunos bogtrykkeri. Hjørland, Birger. 2002. “Epistemology and the Socio-Cognitive Perspective in Information Science”. Journal of the American Society for Information Science and Technology 53, no. 4: 257–70. Hjørland, Birger. 2003. “Fundamentals of Knowledge Organization”. Knowledge Organization 30, no 2: 87-111. Hjørland, Birger. 2009. “Concept Theory”. Journal of the American Society for Information Science and Technology 60, no. 8: 1519–36. Hjørland, Birger. 2010. “The Foundation of the Concept of Relevance”. Journal of the American Society for Information Science and Technology 61, no. 2: 217-37. DOI: 10.1002/asi.21261 Hjørland, Birger. 2011. “Evidence Based Practice: An Analysis Based on the Philosophy of Science”. Journal of the American Society for Information Science and Technology 62, no. 7: 1301-1310. Hjørland, Birger. 2012. “Is Classification Necessary after Google?” Journal of Documentation 68, no. 3: 299-317. Hjørland, Birger. 2013a. “Citation Analysis: A social and Dynamic Approach to Knowledge Organization”. Information Processing and Management 49: 1313–13. DOI http://dx.doi.org/10.1016/j.ipm.2013.07.001. An HTML version with small updates of a preprint appears in ISKO Encyclopedia of Knowledge Organization at: https://www.isko.org/cyclo/citation_analysis. Hjørland, Birger. 2013b. “User-based and Cognitive Approaches to Knowledge Organization: A Theoretical Analysis of the Research Literature”. Knowledge Organization 40, no. 1: 11-27. Also available in ISKO Encyclopedia of Knowledge Organization, eds. Birger Hjørland and Claudio Gnoli. http://www.isko.org/cyclo/user_based. Hjørland, Birger. 2015a. “Are relations in thesauri ‘context-free, definitional, and true in all possible worlds’?” Journal of the Association for Information Science and Technology 66, no. 7: 1367-1373. Hjørland, Birger. 2015b. “Classical Databases and Knowledge Organization: A Case for Boolean Retrieval and Human Decision-making During Searches”. Journal of the Association for Information Science and Technology 66, no. 8: 1559-1575. Hjørland, Birger. 2017b. “Domain Analysis”. Knowledge Organization 44, no. 6: 436-464. Also available in ISKO Encyclopedia of Knowledge Organization, eds. Birger Hjørland and Claudio Gnoli. https://www.isko.org/cyclo/domain_analysis Hjørland, Birger. 2017c. “Subject (of Documents)”. Knowledge Organization 44, no. 1: 55-64. Also available in ISKO Encyclopedia of Knowledge Organization, eds. Birger Hjørland and Claudio Gnoli, http://www.isko.org/cyclo/subject. Hjørland, Birger. 2020. “Political versus Apolitical Epistemologies in Knowledge Organization”. Knowledge Organization 47(6): 461-485. DOI:10.5771/0943-7444-2020-6-461. Hjørland, Birger and Lykke Kyllesbech Nielsen. 2001. “Subject Access Points in Electronic Retrieval”. Annual Review of Information Science and Technology 35, 249-298. Also available in ISKO Encyclopedia of Knowledge Organization, eds. Birger Hjørland and Claudio Gnoli. http://www.isko.org/cyclo/sap. Hudson, Michèle. 1996. “Preparing Terminological Definitions for Indexing and Retrieval Thesauri: A Model“. Advances in Knowledge Organization 5: 363-9. ISO 25964-1: 2011 (E). Information and Documentation—Thesauri and Interoperability with Other Vocabularies—Part 1: Thesauri for Information Retrieval. Geneva, Switzerland: International Organization for Standardization. Kuhn, Thomas S. 1970. “Reflections on My Critics”. In Criticism and the Growth of Knowledge, eds. Imre Lakatos and Alan Musgrave. Cambridge: Cambridge University Press, 231-78. Kuhn, Thomas S. 1962. The Structure of Scientific Revolutions. Chicago, IL: University of Chicago Press. Lardera, Marco and Birger Hjørland. 2020. “Keyword”. ISKO Encyclopedia of Knowledge Organization, eds. Birger Hjørland and Claudio Gnoli. https://www.isko.org/cyclo/keyword. Leclercq, Henri. 1978. “Europe: Term for Many Concepts”. International Classification 5, no. 3: 156-62. Leonelli, Sabina. 2016. Data-Centric Biology: A Philosophical Study. Chicago, IL: University of Chicago Press. Leydesdorff, Loet (2006). “Can Scientific Journals be Classified in terms of Aggregated Journal-Journal Citation Relations using the Journal Citation Reports?” Journal of the American Society for Information Science and Technology 57, no. 5: 601-13. Machado, Luís, Graça Simões, Claudio Gnoli and Renato Souza. 2020. “Can an Ontologically-Oriented KO Do Without Concepts?” Advances in Knowledge Organization 17: 502-6. Manning, Christopher D., Prabhakar Raghavan and Heinrich Schütze. 2009. An Introduction to Information Retrieval. Cambridge, UK: Cambridge University Press. Retrieved from http://nlp.stanford.edu/IR-book/pdf/irbookonlinereading.pdf. Mayr, Ernst and Walter J. Bock. 1994. “Provisional Classifications v Standard Avian Sequences: Heuristics and Communication in Ornithology”. Ibis 136, no. 1: 12–18. Mazzocchi, Fulvio. 2018. “Knowledge organization system (KOS)”. Knowledge Organization 45, no.1: 54-78. Also available in ISKO Encyclopedia of Knowledge Organization, eds. Birger Hjørland and Claudio Gnoli, http://www.isko.org/cyclo/kos. Moss, Wilfred Raymond. 1964. “Categories and Relations: Origins of Two Classification Theories”. American Documentation 15, no. 4: 296-301. Obrst, Leo. 2010. “Ontological Architectures”. In Theory and Applications of Ontology: Computer Applications, eds. Roberto Poli, Michael Healy and Achilles Kameas. Dordrecht: Springer, 27-66. DOI 10.1007/978-90-481-8847-5_2. Ogden, Charles Kay and Ivor Armstrong Richards. 1923. The Meaning of Meaning: A Study of the Influence of Language Upon Thought and of the Science of Symbolism. London: Routledge & Kegan Paul. Olensky, Marlies. 2010. “Semantic Interoperability in Europeana: An Examination of CIDOC CRM in Digital Cultural Heritage Documentation”. Bulletin of IEEE Technical Committee on Digital Libraries 6, no. 2, https://web.archive.org/web/20130620181231/https://www.ieee-tcdl.org/Bulletin/v6n2/Olensky/olensky.html. Paris, Lee Anne H. and Helen R. Tibbo. 1998. “Freestyle vs. Boolean: A Comparison of Partial and Exact Match Retrieval Systems”. Information Processing & Management 34, nos. 2-3: 175-90. Patel, Archana, Sarika Jain and Shishir K. Shandilya. 2019. “Data of Semantic Web as Unit of Knowledge”. Journal of Web Engineering 17, no. 8: 647–74. doi: 10.13052/jwe1540-9589.1783 Picard, Claire-France, Sylvain Durocher and Yves Gendron. 2019. “Desingularization and Dequalification: A Foray into Ranking Production and Utilization Processes”. European Accounting Review 28, no. 4: 737-65. DOI: 10.1080/09638180.2018.1535323. Plato. 380 B.C.E. Meno. Translated by Benjamin Jowett. https://www.gutenberg.org/files/1643/1643-h/1643-h.htm#link2H_4_0003. Rafferty, Pauline. 2018. “Tagging”. Knowledge Organization 45, no. 6: 500-516. Also available in ISKO Encyclopedia of Knowledge Organization, eds. Birger Hjørland and Claudio Gnoli. http://www.isko.org/cyclo/tagging. Richards, Richard A. 2016. Biological Classification: A Philosophical Introduction. Cambridge, UK Cambridge University Press. Robertson, Stephen E. 2000. “Salton award lecture: On theoretical arguments in information retrieval”. Talk given at SIGIR 2000, Athens, July 2000. ACM SIGIR Forum 34, no. 1: 1–10. https://web.archive.org/web/20130323060107/http://www.sigir.org/forum/S2000/salton_lecture.pdf. Robertson, Stephen E. 2008. “The State of Information Retrieval”. ISKO-UK. Presentation available at https://web.archive.org/web/20190512123726/http://event-archive.iskouk.org/sites/default/files/robertson.pdf. Robertson, Stephen E. and C. L. Thompson. 1990. “Weighted Searching: The CIRT Experiment”. In lnformatics 10: Prospects for Intelligent Retrieval, Proceedings of a Conference Jointly Sponsored by Aslib, the Aslib Informatics Group and the Information Retrieval Specialist Group of the British Computer Society, King's College, Cambridge, 21-23 March 1989, ed. Karen Spärck Jones. London: Aslib, 153-65. Robertson, Stephen E. and Karen Spärck Jones. 1976. “Relevance Weighting of Search Terms”. Journal of the American Society for Information Science 27, no. 3: 129–46. doi:10.1002/asi.4630270302. Roelleke, Thomas. 2013. Information Retrieval Models: Foundations and Relationships. Synthesis Lectures on Information Concepts, Retrieval, and Services 27. San Rafael, CA: Morgan & Claypool. Rosse, Cornelius and José L. V. Mejino. 2008. “The Foundational Model of Anatomy Ontology”. In Anatomy Ontologies for Bioinformatics: Principles and Practice, eds. Albert Burger, Duncan Davidson and Richard Baldock. London: Springer, 59-117. Salaba, Athena. 2020. “Knowledge Organization Requirements in LIS Graduate Programs”. Advances in Knowledge Organization 17, 384-93. Salton, Gerald, Anita Wong and Chung-Shu Yang. 1975. “A Vector Space Model for Automatic Indexing”. Communications of the ACM 18, no. 11: 613–20. Salton, Gerald. 1996. “Letter to the Editor. A New Horizon for Information Science?” Journal of the American Journal for Information Science 47, no. 4: 333. Sampson, Margaret, Nassr Nama, Katharine O’Hearn, Kimmo Murto, Ahmed Nasr, Sherri L. Katz , Gail Macartney, Franco Momoli and J. Dayre McNally. 2021. “Creating Enriched Training Sets of Eligible Studies for Large Systematic Reviews: The Utility of PubMed’s Best Match algorithm”. International Journal of Technology Assessment in Health Care 37, e7: 1–6. https://doi.org/10.1017/S0266462320002159. Searle, John 1995. The Construction of Social Reality. New York, NY: Free Press. Sibley, Charles and Jon E. Ahlquist. 1990. Phylogeny and Classification of Birds: A Study in Molecular Evolution. New Haven: Yale University Press. Smith, Barry and Werner Ceusters. 2010. “Ontological Realism: A Methodology for Coordinated Evolution of Scientific Ontologies”. Applied Ontology 5, nos. 3-4: 139–88. DOI 10.3233/AO-2010-0079. Smith, Barry, and Werner Ceusters. 2007. “Ontology as the Core Discipline of Biomedical Informatics”. In Computing, Philosophy, and Cognitive Science: The Nexus and the Liminal, eds. Susan Alice Jane Stuart and Gordana Dodig Crnkovic. Newcastle: Cambridge Scholars Press, 104-22. Smith, Barry, Werner Ceusters, Bert Klagges, Jacob Köhler, Anand Kumar, Jane Lomax, Chris Mungall, Fabian Neuhaus, Alan L. Rector and Cornelius Rosse. 2005. “Relations in Biomedical Ontologies”. Genome Biology 6: R46.1-R46.15. doi:10.1186/gb-2005-6-5-r46. Available at: https://genomebiology.biomedcentral.com/articles/10.1186/gb-2005-6-5-r46. Smith, Barry. 2004. “Beyond Concepts: Ontology as Reality Representation”. In Proceedings of FOIS 2004: International Conference on Formal Ontology and Information Systems, Turin, 4-6 November 2004, edited by Achille C. Varzi and Laure Vieu. Amsterdam: IOS Press. https://philpapers.org/archive/SMIBCO; available from: https://www.researchgate.net/publication/244107491_Beyond_Concepts_Ontology_as_Reality_Representation [accessed Feb 07 2021]. Soergel, Dagobert, Boris Lauser, Anita Liang, Frehiwot Fisseha, Johannes Keizer and Stephen Katz. 2004. “Reengineering Thesauri for New Application: The AGROVOC Example”. Journal of Digital Information 4, no. 4. https://journals.tdl.org/jodi/index.php/jodi/article/view/112/111. Soergel, Dagobert. 1998. “WordNet” [Book Review]. D-Lib Magazine 4, no. 10: 1-7. http://www.dlib.org/dlib/october98/10bookreview.html. Sowa, John F. 1984. Conceptual Structures: Information Processing in Mind and Machine. Reading, MA: Addison-Wesley. Sowa, John F. 2000. “Ontology, Metadata, and Semiotics”. In Conceptual Structures: Logical, Linguistic, and Computational Issues: ICCS 2000, eds. Bernhard Ganter and Guy W. Mineau. Lecture Notes in Computer Science, vol 1867. Berlin: Springer, 55-81. https://doi.org/10.1007/10722280_5. Structural Informatics Group. “The Foundational Model of Anatomy ontology (FMA)”. University of Washington, WA (Website). Available online: http://sig.biostr.washington.edu/projects/fm/AboutFM.html (accessed on 17 March 2021). Svenonius, Elaine. 1997. ”Definitional Approaches in the Design of Classification and Thesauri and Their Implications for Retrieval and Automatic Classification”. In Knowledge Organization for Information Retrieval, ed. I. C. McIlwaine. The Hague, Netherlands: International Federation for Information and Documentation, 12-16. Svenonius, Elaine. 2004. “The Epistemological Foundations of Knowledge Representations”. Library Trends 52: 571–87. Swanson, Don R. 1986. “Undiscovered Public Knowledge”. The Library Quarterly 56, no. 2: 103-18. Temmerman, Rita. 1997. “Questioning the Univocity Ideal: The Difference between Socio-Cognitive Terminology and Traditional Terminology”. Hermes Journal of Linguistics 18, 51–90. Available online: https://tidsskrift.dk/her/article/view/25412/22333 (accessed on 17 March 2021). Thagard, Paul. 2003. “Conceptual Change”. In Encyclopedia of Cognitive Science, ed. Lynn Nadel. London: Macmillan, Vol. 1: 666–70. Retrieved February 17, 2021 from http://cogsci.uwaterloo.ca/Articles/conc.change.pdf. Thomasson, Amie. 2019. “Categories”. In The Stanford Encyclopedia of Philosophy (Summer 2019 Edition), ed. Edward N. Zalta. https://plato.stanford.edu/archives/sum2019/entries/categories/. Turtle, Howard R. and William Bruce Croft. 1992. “A Comparison of Text Retrieval Models”. The Computer Journal 35, no. 3: 279-90. UNESCO Thesaurus. Paris: United Nations Educational, Scientific and Cultural Organization. Available online: http://vocabularies.unesco.org/browser/thesaurus/en/ (accessed on 17 March 2021). Wächter, Thomas, Dimitra Alexopoulou, Heiko Dietze, Jörg Hakenberg and Michael Schroeder. 2008. “Searching Biomedical Literature with Anatomy Ontologies”. In Anatomy Ontologies for Bioinformatics: Principles and Practice, eds. Albert Burger, Duncan Davidson and Richard Baldock. London: Springer, 177-94. Wardy, Robert. 1998. “Categories”. In Routledge Encyclopedia of Philosophy Vol. 1-10, ed. Edward Craig. London: Routledge (electronic version, no. pagination). Warner, Julian. 2010. Human Information Retrieval. Cambridge, MA: MIT Press.
Version 1.0 published 2021-06-01
Article category: This IEKO article, version 1.0 is a reprint of an open access article published 20 Mar 2021 at https://www.mdpi.com/2078-2489/12/3/135. How to cite it:
©2021 ISKO. All rights reserved. |