Impact factor

From Wikipedia, the free encyclopedia
Jump to: navigation, search

The impact factor, often abbreviated IF, is a measure reflecting the average number of citations to articles published in science and social science journals. It is frequently used as a proxy for the relative importance of a journal within its field, with journals with higher impact factors deemed to be more important than those with lower ones. The impact factor was devised by Eugene Garfield, the founder of the Institute for Scientific Information (ISI), now part of Thomson Reuters. Impact factors are calculated yearly for those journals that are indexed in Thomson Reuter's Journal Citation Reports.

Contents

Calculation

In a given year, the impact factor of a journal is the average number of citations received per paper published in that journal during the two preceding years.[1] For example, if a journal has an impact factor of 3 in 2008, then its papers published in 2006 and 2007 received 3 citations each on average. The 2008 impact factor of a journal would be calculated as follows:

A = the number of times articles published in 2006 and 2007 were cited by indexed journals during 2008
B = the total number of "citable items" published by that journal in 2006 and 2007. ("Citable items" are usually articles, reviews, proceedings, or notes; not editorials or Letters-to-the-Editor.)
2008 impact factor = A/B

(Note that 2008 impact factors are actually published in 2009; they cannot be calculated until all of the 2008 publications have been processed by the indexing agency.)

New journals, which are indexed from their first published issue, will receive an impact factor after two years of indexing; in this case, the citations to the year prior to Volume 1, and the number of articles published in the year prior to Volume 1 are known zero values. Journals that are indexed starting with a volume other than the first volume will not get an impact factor until they have been indexed for three years. Annuals and other irregular publications sometimes publish no items in a particular year, affecting the count. The impact factor relates to a specific time period; it is possible to calculate it for any desired period, and the Journal Citation Reports (JCR) also includes a 5-year impact factor.[2] The JCR shows rankings of journals by impact factor, if desired by discipline, such as organic chemistry or psychiatry.

Use

The IF is used to compare different journals within a certain field. The ISI Web of Knowledge indexes more than 11,000 science and social science journals[3] and the results are widely available.

Criticisms

Numerous criticisms have been made of the use of an impact factor, including the more general debate on the usefulness of citation metrics. Criticisms mainly concern the validity of the impact factor, policies that alter it, and its incorrect application.[4]

Validity

Editorial policies which alter the impact factor

A journal can adopt editorial policies that increase its impact factor.[13][14] These editorial policies may not solely involve improving the quality of published scientific work.

Incorrect application of impact factor

This does not work well since a small number of publications are cited much more than the majority - for example, about 90% of Nature's 2004 impact factor was based on only a quarter of its publications, and thus the importance of any one publication will be different from, and in most cases less than, the overall number.[23] The impact factor, however, averages over all articles and thus underestimates the citations of the most cited articles while exaggerating the number of citations of the majority of articles. Consequently, the Higher Education Funding Council for England was urged by the House of Commons Science and Technology Select Committee to remind Research Assessment Exercise panels that they are obliged to assess the quality of the content of individual articles, not the reputation of the journal in which they are published.[24]

Responses

Other measures of impact

Related indices

Some related values, also calculated and published by the same organization, are:

These measures apply only to journals, not individual articles or individual scientists (unlike the H-index). The relative number of citations an individual article receives is better viewed as citation impact.

It is, however, possible to measure the Impact factor of the journals in which a particular person has published articles. This use is widespread, but controversial. Garfield warns about the "misuse in evaluating individuals" because there is "a wide variation from article to article within a single journal".[10] Impact factors have a large, but controversial, influence on the way published scientific research is perceived and evaluated.

PageRank algorithm

In 1976 a recursive impact factor that gives citations from journals with high impact greater weight than citations from low-impact journals was proposed.[28] Such a recursive impact factor resembles the PageRank algorithm of the Google search engine, though the original Pinski and Narin paper uses a "trade balance" approach in which journals score highest when they are often cited but rarely cite other journals. A number of subsequent authors have proposed related approaches to ranking scholarly journals.[29][30][31] In 2006, Johan Bollen, Marko A. Rodriguez, and Herbert Van de Sompel also proposed using the PageRank algorithm.[32] From their paper:

ISI Impact Factor PageRank Combined
1 52.28 ANNU REV IMMUNOL 16.78 Nature 51.97 Nature
2 37.65 ANNU REV BIOCHEM 16.39 Journal of Biological Chemistry 48.78 Science
3 36.83 PHYSIOL REV 16.38 Science 19.84 New England Journal of Medicine
4 35.04 NAT REV MOL CELL BIO 14.49 PNAS 15.34 Cell
5 34.83 New England Journal of Medicine 8.41 PHYS REV LETT 14.88 PNAS
6 30.98 Nature 5.76 Cell 10.62 Journal of Biological Chemistry
7 30.55 Nature Medicine 5.70 New England Journal of Medicine 8.49 JAMA
8 29.78 Science 4.67 Journal of the American Chemical Society 7.78 The Lancet
9 28.18 NAT IMMUNOL 4.46 J IMMUNOL 7.56 NAT GENET
10 28.17 REV MOD PHYS 4.28 APPL PHYS LETT 6.53 Nature Medicine

The table shows the top 10 journals by ISI Impact Factor, PageRank, and a modified system that combines the two (based on 2003 data). Nature and Science are generally regarded as the most prestigious journals, and in the combined system they come out on top.

The Eigenfactor is another PageRank-type measure of journal influence,[33] with rankings freely available online.[34]

Article level metrics

Starting in March 2009, the Public Library of Science introduced "article level metrics[35] on every article in all of their titles.

See also

References

  1. ^ "Introducing the Impact Factor". http://www.thomsonreuters.com/products_services/science/academic/impact_factor/. Retrieved 2009-08-26. 
  2. ^ "JCR with Eigenfactor". http://www.thomsonreuters.com/content/press_room/sci/350008. Retrieved 2009-08-26. 
  3. ^ "Web of Knowledge > Real Facts > Quality and Quantity". http://wokinfo.com/realfacts/qualityandquantity/. Retrieved 2010-05-05. 
  4. ^ a b "European Association of Science Editors statement on impact factors". http://www.ease.org.uk/statements/EASE_statement_on_impact_factors.shtml. Retrieved 2009-03-25. 
  5. ^ Erjen van Nierop (2009). "Why do statistics journals have low impact factors?". Statistica Neerlandica 63 (1): 52–62. doi:10.1111/j.1467-9574.2008.00408.x. http://www3.interscience.wiley.com/cgi-bin/fulltext/121630940/PDFSTART. 
  6. ^ Mike Rossner, Heather Van Epps, and Emma Hill (December 17, 2007). "Show me the data". Journal of Cell Biology. http://www.jcb.org/cgi/content/full/179/6/1091. 
  7. ^ "Thomson Scientific Corrects Inaccuracies In Editorial - Citation Impact Center - Thomson Reuters Forums". http://forums.thomsonscientific.com/ts/blog/article?message.uid=717. Retrieved 2009-08-31. 
  8. ^ Joint Committee on Quantitative Assessment of Research (June 12, 2008). "Citation Statistics" (PDF). International Mathematical Union. http://www.mathunion.org/fileadmin/IMU/Report/CitationStatistics.pdf. 
  9. ^ S.A. Marashi. On the identity of “citers”: are papers promptly recognized by other investigators? (2005) Med. Hypotheses 65, 822. PubMed 15990244.
  10. ^ a b Eugene Garfield (June 1998). "The Impact Factor and Using It Correctly". Der Unfallchirurg 101 (6): 413–414. PMID 9677838. http://www.garfield.library.upenn.edu/papers/derunfallchirurg_v101(6)p413y1998english.html. 
  11. ^ Gami AS, Montori VM, Wilczynski NL, Haynes RB (2004). "Author self-citation in the diabetes literature". CMAJ 170 (13): 1925–7. doi:10.1503/cmaj.1031879. PMID 15210641. PMC 421720. http://www.pubmedcentral.nih.gov/articlerender.fcgi?tool=pubmed&pubmedid=15210641. 
  12. ^ Natasa Kovacic and Aleksandra Misak (2004). "Author self-citation in medical literature". CMAJ 170 (13): 1929–30. doi:10.1503/cmaj.1040513. http://www.cmaj.ca/cgi/content/full/170/13/1929. 
  13. ^ Richard Monastersky (October 14, 2005). "The Number That's Devouring Science". The Chronicle of Higher Education. http://chronicle.com/free/v52/i08/08a01201.htm. 
  14. ^ Douglas N. Arnold; Kristine K. Fowler (2011). "Nefarious Numbers". Notices of the American Mathematical Society 58 (3): 434-437. arXiv:1010.0278. 
  15. ^ PLoS Medicine Editors (June 6, 2006). "The Impact Factor Game". PLoS Medicine (PLoS Medicine) 3 (6): e291. doi:10.1371/journal.pmed.0030291. PMID 16749869. 
  16. ^ Agrawal A (2005). "Corruption of Journal Impact Factors". Trends in Ecology and Evolution 20 (4): 157. doi:10.1016/j.tree.2005.02.002. PMID 16701362. http://www.eeb.cornell.edu/agrawal/research/papers/other%20pdfs/agrawal%202005%20tree%20corruption.pdf. 
  17. ^ Fassoulaki A, Papilas K, Paraskeva A, Patris K (2002). "Impact factor bias and proposed adjustments for its determination". Acta Anaesthesiologica Scandinavica 46 (7): 902–5. doi:10.1034/j.1399-6576.2002.460723.x. PMID 12139549. 
  18. ^ Harm K. Schuttea, Jan G. Svec (2007). "Reaction of Folia Phoniatrica et Logopaedica on the Current Trend of Impact Factor Measures". Folia Phoniatrica et Logopaedica 59 (6): 281–285. doi:10.1159/000108334. PMID 17965570. 
  19. ^ "Journal Citation Reports - Notices". http://admin-apps.isiknowledge.com/JCR/static_html/notices/notices.htm. Retrieved 2009-09-24. 
  20. ^ New impact factors yield surprises - The Scientist - Magazine of the Life Sciences
  21. ^ What does it mean to be #2 in Impact? - Thomson Reuters Community
  22. ^ Seglen PO (1997). "Why the impact factor of journals should not be used for evaluating research". BMJ 314 (7079): 498–502. PMID 9056804. PMC 2126010. http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2126010/pdf/9056804.pdf.  Free PDF download for the public.
  23. ^ "Not-so-deep impact" (This editorial is available free of charge.). Nature 435 (7045): 1003–4. June 23, 2005. doi:10.1038/4351003b. PMID 15973362. http://www.nature.com/nature/journal/v435/n7045/full/4351003b.html. 
  24. ^ "House of Commons - Science and Technology - Tenth Report". 2004-07-07. http://www.publications.parliament.uk/pa/cm200304/cmselect/cmsctech/399/39912.htm. Retrieved 2008-07-28. 
  25. ^ International Council for Science statement
  26. ^ DFG press release (http://www.dfg.de/en/service/press/press_releases/2010/pressemitteilung_nr_07/index.html)
  27. ^ Impact Factor, Immediacy Index, Cited Half-life
  28. ^ Gabriel Pinski and Francis Narin (1976). "Citation influence for journal aggregates of scientific publications: Theory with application to literature of physics". Information Processing & Management 12: 297–312. doi:10.1016/0306-4573(76)90048-0. 
  29. ^ S. J. Liebowitz and J. P. Palmer. (1984). "Assessing the relative impacts of economics journals". Journal of Economic Literature (American Economic Association) 22 (1): 77–88. http://www.jstor.org/pss/2725228. 
  30. ^ I. Palacios-Huerta and O. Volij (2004). "The measurement of intellectual influence". Econometrica 72: 963–977. doi:10.1111/j.1468-0262.2004.00519.x. 
  31. ^ Y. K. Kodrzycki and P. D. Yu (2006). "New approaches to ranking economics journals". B. E. Journal of Economics Analysis and Policy 5. doi:10.2202/1538-0645.1520. 
  32. ^ Johan Bollen, Marko A. Rodriguez, and Herbert Van de Sompel. (December 2006). "Journal Status". Scientometrics 69 (3). http://www.arxiv.org/abs/cs.GL/0601030. 
  33. ^ C. T. Bergstrom. (May 2007). "Eigenfactor: Measuring the value and prestige of scholarly journals". College & Research Libraries News 68 (5). http://www.ala.org/ala/mgrps/divs/acrl/publications/crlnews/2007/may/eigenfactor.cfm. 
  34. ^ eigenfactor.org
  35. ^ Article-Level Metrics Information

External links

Personal tools
Namespaces
Variants
Actions
Navigation
Interaction
Toolbox
Print/export
Languages