Reference publication year spectroscopy (RPYS) of Eugene Garfield’s publications

Scientometrics, Dec 2017

Which studies, theories, and ideas have influenced Eugene Garfield’s scientific work? Recently, the method reference publication year spectroscopy (RPYS) has been introduced, which can be used to answer this and related questions. Since then, several studies have been published dealing with the historical roots of research fields and scientists. The program CRExplorer (http://​www.​crexplorer.​net) was specifically developed for RPYS. In this study, we use this program to investigate the historical roots of Eugene Garfield’s oeuvre.

A PDF file should load here. If you do not see its contents the file may be temporarily unavailable at the journal website or you do not have a PDF plug-in installed and enabled in your browser.

Alternatively, you can download the file locally and open with any standalone PDF reader:

Reference publication year spectroscopy (RPYS) of Eugene Garfield’s publications

Reference publication year spectroscopy (RPYS) of Eugene Garfield's publications Lutz Bornmann 0 1 2 Robin Haunschild 0 1 2 Loet Leydesdorff 0 1 2 Eugene 0 1 2 Robin Haunschild 0 1 2 0 Amsterdam School of Communication Research (ASCoR), University of Amsterdam , PO Box 15793, 1001 NG Amsterdam , The Netherlands 1 Max Planck Institute for Solid State Research , Heisenbergstr. 1, 70569 Stuttgart , Germany 2 Division for Science and Innovation Studies, Administrative Headquarters of the Max Planck Society , Hofgartenstr. 8, 80539 Munich , Germany Which studies, theories, and ideas have influenced Eugene Garfield's scientific work? Recently, the method reference publication year spectroscopy (RPYS) has been introduced, which can be used to answer this and related questions. Since then, several studies have been published dealing with the historical roots of research fields and scientists. The program CRExplorer ( was specifically developed for RPYS. In this study, we use this program to investigate the historical roots of Eugene Garfield's oeuvre. Cited references; Garfield; Historical roots; Reference publication year spectroscopy; RPYS; Pioneer; Bibliometrics Introduction Bibliometrics has become a central component of research evaluation. Field-normalized indicators are used to assess the scientific performance of institutions and countries. Individual researchers are well informed about their h index. The development to this prominence of bibliometrics had not been possible without the groundbreaking work of Eugene Garfield (EG). EG conceptualized citation indexing in science and published the underlying concept in Science (Garfield 1955) . His invention of the index ‘‘revolutionized the world of scientific information and made him one of the most visionary figures in information science and scientometrics’’ (van Raan and Wouters 2017) . In the 1960s, he started the professional use of bibliometrics by founding the Institute for Scientific Information (ISI) (now Clarivate Analytics, see He developed the Science Citation Index, the Social Sciences Citation Index, and the Arts and Humanities Citation Index. These indexes are predecessors of the Web of Science (WoS) which is well-known today to scholars (Small 2017; Wouters 1999b) . During EG’s lengthy career, he published more than 1500 publications (see In this study, we are interested in the roots of EG’s oeuvre. Which studies, theories, and ideas have influenced EG’s own scientific work? Marx et al. (2014) introduced reference publication year spectroscopy (RPYS), which can be used to answer this and related questions. In recent years, several studies have been published dealing with the historical roots of research fields. For example, Hou (2017) deals with the historical roots of citation analysis in a recent study. Thor et al. (2016a) developed the CRExplorer—a program specifically designed for RPYS ( In the study, we use this program to investigate the historical roots of EG’s oeuvre. Dataset The study is based on papers published by EG. We used his ResearcherID to collect his publications and added some further publications which are not covered by the ResearcherID. The dataset consists of n = 1558 papers published between 1954 and 2016 (containing 15,890 cited references, CRs). The papers have been retrieved from the WoS. The downloaded files were imported in the CRExplorer for further processing (Thor et al. 2016a, b) . The removing, clustering, and merging functionalities of the CRExplorer have been used to clean the CR dataset, especially for variants of the same CR. The clustering and merging of variants (using volume and page number information) lead to a slightly reduced set of CRs (n = 15,850). A further 199 CRs were deleted because the bibliographic information was unprecise (for example, no reference publication year, RPY, was provided). We formed two datasets from this initial set for the RPYS: (1) (2) Dataset including self-citations by EG We deleted those CRs which have occurrences of less than 10% in a single year (i.e. the share of occurrences for a CR among the occurrences of all CRs in one year is less than 10%). This step leads to the first set of 328 CRs. Note that this also removes two of the most referenced CRs with n = 100 and n = 97 occurrences as their share of occurrences in their RPYs is 9.9 and 8.3%, respectively. However, there are a number of CRs which appeared in Current Contents without a volume number; so they do not provide useful bibliometric information (see below). Dataset without self-citations We deleted all self-cited publications (n = 1283). Since the CR data in the WoS only contains the first author name, the identification of self-citations is restricted to this first name. As above, we deleted those CRs which have occurrences of less than 10% in a single year (see above). This step results in the second final set of 316 CRs. Although the difference between data set 1 and data set 2 (12 CRs) appears to be rather small at a first glance, the spectrogram Results changes significantly. Most self-cited CRs (n = 1271) are removed due to the occurrence threshold of 10% in a single year. The 1558 papers authored by EG were published in 125 different journals, but 68.2% of his papers were published in Current Contents. In the 1950s, Current Contents has been founded by EG as a rapid alerting service (Small 2017) . The first subject edition covered biology and medicine. Other subject editions were added later, and the original version was renamed into Current Contents Life Sciences. Initially, Current Contents consisted of printed versions of reproduced title pages of major peer-reviewed journals. An author index with addresses and a subject index were provided as well. This indicates that EG’s publications in Current Contents have a status different from papers in peer-reviewed journals. Similarly, EG founded The Scientist as a professional magazine for scientists in 1986. Although this journal was also incorporated into the Science Citation Index, it does not contain references and is thus only registered for being cited; including a Journal Impact Factor (JIF) of 0.369 in 2015. Table 1 shows the journals in which EG has published at least 10 papers. The journals shown contain 88.6% of EG’s publication output. EG has published most of his papers (80.9%) between 1970 and 1990. During these two decades, he has published 60 papers per year on average. However, 77.8% of the papers during this time frame were published in Current Contents. The unusual distribution of EG’s papers across journals and publication years shows that EG has been an unusual scientist preferring a journalistic medium. Without the publications in Current Contents and The Scientist, EG’s oeuvre is 257 publications in scholarly journals containing 2244 references. Figure 1 compares the citations to EG’s full and scholarly oeuvre. The two papers in Science of 1955 and 1972 are heavily cited. The erratic blue-colored curve is mainly citation of Current Contents and to a large extent self-citation. The peak in 2006 is an article in JAMA entitled ‘‘The history and meaning of the journal impact factor’’. We discuss the other important CRs using Table 3 which shows the CRs with the largest number of occurrences within data set 2 (without self-citations). On the first glance, we can observe significantly lower numbers of occurrences for the CRs. Thus, these publications were less important for EG to write his papers than his own publications. The CRs in Table 3 can be divided into three groups: (1) bibliometrics, (2) biology, and (3) nonscholarly material. The group of CRs related to bibliometrics is the largest group in Table 3 with five CRs (the fifth, seventh, eighth, ninth, and tenth CR). The group of CRs which belong to the field of biology is only slightly smaller with four CRs (the first, second, fourth, and eleventh CR). The smallest group of CRs which belongs to non-scholarly material is composed of RPY Garfield, E., 1955, Citation indexes for science—new dimension in 1955 61 documentation through association of ideas. Science, 122(3159), 108–111 Garfield, E., 1971, Current Contents, P5 1971 54 Garfield, E., 1972, Citation analysis as a tool in journal evaluation: journals can 1972 64 be ranked by frequency and impact of citations for science policy studies. Science, 178(4060), 471–479 Garfield, E., 1972, Current Contents, 1101, P5 1972 57 Garfield, E., 1973, Current Contents, P5 1973 73 Garfield, E., 1974, Current Contents, P5 1974 61 Garfield, E., 1975, Current Contents, P5 1975 79 Garfield, E., 1978, Current Contents, P5 1978 88 Garfield, E., 1985, Current Contents, V43, P3 1985 75 Garfield, E., 1987, Current Contents, P3 1987 62 Garfield, E., 1988, Current Contents, P3 1988 54 The CRs which are responsible for the large peaks in Fig. 2 are shown Beyond doubt, EG has been one of the most influential scientists in the field of bibliometrics. The field would perhaps not exist, if EG had not introduced the idea of indexing citations for quantitative analyses in the history and philosophy of science (Elkana et al. 1978; Gingras 2016; Wouters 2000) . EG created the fundament on which all empirical studies in bibliometrics are based. In addition to the idea of citation indexing, he initiated several lines of research in bibliometrics later on. For example, the development of indicators based on bibliometric data started with the introduction of the JIF (Garfield 2006; Garfield and Sher 1963) . Since this initial introduction, the development of several RPY (advanced) indicators followed in bibliometrics which do not only refer to journals (several journal-based indicators can be found in Clarivate Analytics’ Journal Citation Report), but also to other entities (e.g., to single researchers with the h index). EG was the first who formulated a list of possible reasons why documents are cited in publications (Bornmann and Daniel 2008) . Thus, he started the discussion in bibliometrics about the meaning of citations and the formulation of underlying theoretical approaches. A further example of his groundbreaking work is the introduction and development of algorithmic historiography (Garfield 2004; Garfield et al. 1964; Leydesdorff 2010) . The method which can be applied by using the historiographic software HistCiteTM ‘‘facilitates the understanding of paradigms by enabling the scholar to identify the significant works on a given topic’’ (Garfield et al. 2003, p. 400) . Similar software, which has been developed on this base later on, are CitNetExplorer (, see van Eck and Waltman 2014) and CRExplorer (, see Thor et al. 2016a, b) . This study deals with EG’s roots (studies, theories, and ideas) and how they are reflected in EG’s publications. We used the CRExplorer—which has its roots in EG’s own software developments—and applied RPYS to his publication set. The results show that EG has cited his own publications in many cases. This can be possibly traced back to the fact that EG was a pioneer not only in shaping the citation index, but also in many lines of research in bibliometrics. Furthermore, inspiring inputs might have been come from noncitable sources. For example, Shepard’s Citations is a citation index which is used in US legal research. It lists all authorities who cite particular cases, statutes, or other legal authorities. EG later acknowledged that his citation index was heavily influenced by Shepard’s Citations (Wouters 1999a) . However, this does not reflect in (or cannot be retrieved from) his citations, because there does not exist a paper on Shepard’s Citations which could be cited in this context. Among the papers most referenced by EG are some non-scholarly publications, some publications from the early evolving field of bibliometrics, and publications from other disciplines for the presentation of examples. The heterogeneity of the cited publications demonstrates the wide-spreading interests of EG which range from the historiography of science as an empirical operationalization for questions in the history and philosophy of science (e.g. Elkana et al. 1978; Gingras 2016) , citation indexing as an approach to document retrieval (Garfield 1955), journal evaluation for library management (Bradford 1950; Garfield 1957, 1972) , the mapping of the sciences (Garfield 1987; Small and Garfield 1985) , to bibliometrics and the theory of citation (Garfield 1975, 1979) . The prevailing publication and citation of non-scholarly publications makes clear that EG’s interests are not limited by scholarly bounds. They reach beyond the narrow definitions of scientific epistemological interests and perform the translation of the latter into knowledge-based innovations. Acknowledgements Open access funding provided by Max Planck Society. Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. Bornmann , L. , & Daniel , H. -D. ( 2008 ). What do citation counts measure? A review of studies on citing behavior . Journal of Documentation , 64 ( 1 ), 45 - 80 . Bradford , S. ( 1934 ). On the scattering of papers on scientific subjects in scientific periodicals . Engineering , 137 ( 193 ), 85 . Bradford , S. C. ( 1950 ). Documentation. Washington, DC: Public Affairs Press. Elkana , Y. , Lederberg , J. , Merton , R. K. , Thackray , A. , & Zuckerman , H. ( 1978 ). Toward a metric of science: the advent of science indicators . New York, NY: Wiley. Garfield , E. ( 1955 ). Citation indexes for science-new dimension in documentation through association of ideas . Science , 122 ( 3159 ), 108 - 111 . Garfield , E. ( 1957 ). Breaking the subject index barrier-a citation index for chemical patents . Journal of the Patent Office Society , 39 ( 8 ), 583 - 595 . Garfield , E. ( 1972 ). Citation analysis as a tool in journal evaluation . Science , 178 ( 4060 ), 471 - 479 . Garfield , E. ( 1975 ). The 'Obliteration Phenomenon' in science-and the advantage of being obliterated! Current Contents , 51 ( 52 ), 5 - 7 . Garfield , E. ( 1979 ). Citation indexing-its theory and application in science, technology, and humanities . New York, NY: Wiley. Garfield , E. ( 1987 ). Launching the ISI Atlas of Science: For the new year, a new generation of reviews . Current Contents (1) , 3 - 8 . Garfield , E. ( 2004 ). Historiographic mapping of knowledge domains literature . Journal of Information Science , 30 ( 2 ), 119 - 145 . Garfield , E. ( 2006 ). The history and meaning of the journal impact factor . Journal of the American Medical Association , 295 ( 1 ), 90 - 93 . Garfield , E. , & Sher , I. H. ( 1963 ). New factors in the evaluation of scientific literature through citation indexing . American Documentation , 14 ( 3 ), 195 - 201 . Garfield , E. , Pudovkin , A. I. , & Istomin , V. S. ( 2003 ). Why do we need algorithmic historiography? Journal of the American Society for Information Science and Technology, 54 ( 5 ), 400 - 412 . 1002/Asi.10226. Garfield , E. , Sher , I. H. , & Torpie , R. J. ( 1964 ). The use of citation data in writing the history of science . Philadelphia, PA: Institute for Scientific Information. Gingras , Y. ( 2016 ). Bibliometrics and research evaluation: uses and abuses . Cambridge MA: MIT Press. Gross , P. L. K. , & Gross , E. M. ( 1927 ). College libraries and chemical education . Science , 66 , 385 - 389 . Hou , J. ( 2017 ). Exploration into the evolution and historical roots of citation analysis by referenced publication year spectroscopy . Scientometrics , 110 ( 3 ), 1437 - 1452 . 2206-9. Leydesdorff , L. ( 2010 ). Eugene Garfield and algorithmic historiography: Co-words, co-authors, and journal names . Annals of Library and Information Studies , 57 ( 3 ), 248 - 260 . Lowry , O. H. , Rosebrough , N. J. , Farr , A. L. , & Randall , R. J. ( 1951 ). Protein measurement with the Folin phenol reagent . Journal of Biological Chemistry , 193 ( 1 ), 265 - 275 . Marx , W. , Bornmann , L. , Barth , A. , & Leydesdorff , L. ( 2014 ). Detecting the historical roots of research fields by reference publication year spectroscopy (RPYS) . Journal of the Association for Information Science and Technology , 65 ( 4 ), 751 - 764 . Pudovkin , A. I. , & Garfield , E. ( 2002 ). Algorithmic procedure for finding semantically related journals . Journal of the American Society for Information Science and Technology , 53 ( 13 ), 1113 - 1119 . https:// Small , H. ( 2017 ). A tribute to Eugene Garfield: Information innovator and idealist . Journal of Informetrics , 11 ( 3 ), 599 - 612 . 2017 . 04 .006. Small , H. , & Garfield , E. ( 1985 ). The geography of science-disciplinary and national mappings . Journal of Information Science , 11 ( 4 ), 147 - 159 . Thor , A. , Marx , W. , Leydesdorff , L. , & Bornmann , L. ( 2016a ). Introducing CitedReferencesExplorer (CRExplorer): A program for reference publication year spectroscopy with cited references standardization . Journal of Informetrics , 10 ( 2 ), 503 - 515 . Thor , A. , Marx , W. , Leydesdorff , L. , & Bornmann , L. ( 2016b ). New features of CitedReferencesExplorer (CRExplorer) . Scientometrics , 109 ( 3 ), 2049 - 2051 . van Eck , N. J. , & Waltman , L. ( 2014 ). CitNetExplorer: A new software tool for analyzing and visualizing citation networks . Journal of Informetrics , 8 ( 4 ), 802 - 823 . 2014 . 07 .006. van Raan , A. F. J. , & Wouters , P. ( 2017 ). Eugene Garfield 1925 -2017: Visionary information scientist . Retrieved April 26 , 2017 , from n -q2y2c4& title=eugene-garfield1925-2017-visionary-information-scientist. Wouters , P. ( 1999a ). The citation culture . Unpublished Ph.D. Thesis , University of Amsterdam, Amsterdam Wouters, P. ( 1999b ). The creation of the Science Citation Index . Medford: Information Today Inc. Wouters , P. ( 2000 ). Garfield as alchemist . In B. Cronin & H. B. Atkins (Eds.), The web of knowledge: A Festschrift in honor of Eugene Garfield (Vol . ASIS Monograph Series) (pp. 65 - 71 ). Medford, NJ: Information Today.

This is a preview of a remote PDF:

Lutz Bornmann, Robin Haunschild, Loet Leydesdorff. Reference publication year spectroscopy (RPYS) of Eugene Garfield’s publications, Scientometrics, 2017, 1-10, DOI: 10.1007/s11192-017-2608-3