Programområder Statistikk Ansatte Aktiviteter Publikasjoner Prosjekter

Nordisk Bibliometri Workshop

11th Nordic Workshop on Bibliometrics and Research Policy

Time: September 28th - 29th 2006

Place: Oslo, University College of Oslo & NIFU STEP

Call for papers and presentations

Workshop organizer:

Dr. phil. Antje Klitkou, NIFU STEP, Oslo

Dr. Nils Pharo, University College of Oslo

Bibliometric researchers in the Nordic countries have arranged annual Nordic workshops on bibliometrics since 1996:

  • 1996 in Helsinki
  • 1997 in Stockholm
  • 1998 in Oslo
  • 1999 in Copenhagen
  • 2000 in Oulu
  • 2001 in Stockholm
  • 2002 in Oslo
  • 2003 in Aalborg
  • 2004 in Turku
  • 2005 in Stockholm

The general scope of the workshops is to present recent bibliometric research in the Nordic countries and to create better linkages between the bibliometric research groups and their PhD students.

We will organise the workshop in cooperation with the University College of Oslo and we especially invite the students who are going to participate at the NORSLIS Roadshow "Studying the Web and its use" the 27th and 28th of September at the University College of Oslo.

There are no fees for participating in the Nordic workshops on bibliometrics.

The workshop will start at about 13 on Thursday the 28th of September and end at about 16 on the 29th. On Thursday evening there will be a dinner at a restaurant.

On Thursday the seminar will take place in room 311 in the college's conference center in Pilestredet 46 (Campus map is available at, note that the airport bus will stop by the location called "Holbergs plass" in the mid bottom of the map).

On Friday the seminar will take place at NIFU STEP, Wergelandsveien 7 (6th floor). This is nearby the Royal Castle and the National Theatre station (compare the map for details).

You will have to arrange travel and hotel all by yourself. It may be difficult to find a hotel room in Oslo, so please book as soon as possible.

All participants are requested to make a presentation of a research paper or a research idea.

Please, let me know if you are coming and also submit a max 200 word abstract on what you would like to present as soon as possible and no later than August 1st.




Registration and Opening


Mike Thelwall
Professor of Information Science. School of Computing & Information Technology, University of Wolverhampton, UK
Invited paper:
Webometrics: What is it Good for?

Thelwall (347,87 kB)

The research field of webometrics began to emerge from bibliometrics almost ten years ago, with the promise that the web could reveal new information about patterns of academic research. A significant body of mostly methodological or exploratory studies has since emerged. We are now in a better position to judge what webometric techniques can deliver and how best to use them. Two key generic findings are that it is relatively easy to get large-scale data from the web, and that this data is often of a relatively low quality. As a result it seems that web-based citation or link analysis should not be used as the primary evidence for evaluating the work of scientists or academic departments, although they can be used to provide supporting evidence of research uses that are not recorded in any citation index, such as mentions in undergraduate or postgraduate course reading lists. Webometrics can be used for relational analyses, however, such as identifying groups of departments within a subject that have similar research interests, or identifying connections between departments and government or commercial sector organisations. In addition, web research can assess how effectively research groups are using the web to publicise themselves. Given the importance of the web for increasingly many scholarly activities, this may be a particularly important function. Finally, webometric research has a role to play in helping us to understand how researchers and others use the web to find and share information.


Jesper Wiborg Schneider
Department of Information Studies Royal School of Library and Information Science, Aalborg, Denmark
Comparison of ordination results by use of Procrustes analysis

Schneider_Borlund (154,52 kB)

The presentation introduces the Procrustes analysis as a tool for quantitative evaluation of ordination results in informetric studies. The motivation for the present introduction is spurred by the recent debate on choice of proximity measures and their potential influence upon clustering and ordination results. Previously, we have introduced the Mantel statistic as a technique for comparison of proximity measures. Procrustes analysis and the Mantel statistic are related. Common to these techniques are the application of permutation procedures in order to test hypothese about matrix resemblances. Specifically, Procrustes analysis finds the optimal translation, dilation, and rotation of one ordination result in order to make a superimposition that maximizes the fit between the two configurations.


Kim Holmberg
MSc, PhD Student
Faculty of Economics and Social Sciences, Department of Information Studies Åbo Akademi University, Finland
Government-university-industry hyperlinking and suitable applications for webometric research methods

Holmberg (1,28 MB)

The goal of this research is to study hyperlinking between, to and from triple helix websites in the region of Finland Proper and to develop and test suitable applications for webometric methods. The link data will be gathered from municipal websites, business websites and from university departments websites. Link data will be gathered and analysed by interlinking, co-inlinking and co-outlinking. Results from link analyses will be compared with data collected from other reliable information sources. These include earlier research, interviews, surveys and geographic data. Results so far show a strong correlation between municipal interlinking and the geography of the region.
When the quantitative part of this research is finished, linking motivations and behaviour will be studied with interviews and a web-based survey. As the linking behaviour determines the usability of link data, it can also indicate how link data could be used. The overwhelming goal of this research is to develop and test an application for link analysis. Preliminary hypothesis is that these three different link analysis methods may indicate different types of relationships with real practical value between the surveyed websites and the institutions they represent.


Coffe break


Olle Persson
Inforsk, Dept. of Sociology, Umeå University, Sweden
Wolfgang Glänzel
Katholieke Universiteit Leuven, Steunpunt O&O Statistieken, Leuven, Belgium
Testing the predictive value of bibliometric assessments
The paper describes a workable method for testing the predictive value of bibliometric assessments. The main conclusion of this exercise is that past bibliometric performance does predict future bibliometric performance reasonably well. However, one must be open to the fact that some authors, for various reasons, do perform better or worse than expected. Using aggregates of authors, such as those formed by co-authorship links, improves the prediction somewhat. The strength of correlations found in this study is of the same magnitude as found in a study of field normalized citation impact and peer evaluation among research groups in physics (Rinia et al 1998). If bibliometric performance predicts peer rating as well as future bibliometric impact, the combined use of peer review and bibliometric assessment would be the ideal approach. What peer reviews fail to see bibliometrics may discover and vice versa.


Ulf Sandström
Linköping University, Tema Institute, Sweden
Counting it all: Bibliometric method for national publications in social sciences

Sandstrom (357,88 kB)

This paper proposes a method for counting of national and international output from research groups. Web of Science gives information on source material (journal articles letters and reviews). In the Web of Science it also possible to find citations to non-source material (journals, books, chapters in books, and reports). National databases, in Sweden Libris, give full information on all books, chapters in books (selective) and reports in series. Another national database, ArtikelSök, give information on articles in Swedish journals (scientific and political/cultural journals). Also, using the ArtikelSök makes it possible to create a sort of impactindex: how many times are a researcher interviewed and reviewed by others. In all, these different measures make up a good picture of the level of activity and productivity from a research group. The method will be illustrated with a material from a research institute during 1998-2005.


Restaurant Dinner



Hanna-Mari Pasanen
Researcher, M.Sc., Group for Science, Technology and Innovation Studies - TaSTI, University of Tampere, Finland
The use of bibliometric data as the basis for performance indicators of Finnish universities

Pasanen (342,65 kB)

The paper presents the main results of a project focusing on issues of using bibliometric indicators in the performance measurement of Finnish universities. The emphasis of the project was on the usability of the national KOTA-database, which contains data on Finnish universities’ publishing activity.
While the need to monitor the productivity of universities has created pressures to develop instruments for the quantitative evaluation of university research, the use of bibliometric indicators as a tool of performance-based management should be considered with awareness of technical and methodological problems related to bibliometric data. Moreover, the various forms of publications and diversity of publishing cultures among the academic disciplines should be taken into account if
publication productivity is employed as a criterion of the public funding system of universities.
More detailed studies of publishing practices are still needed in order to draw a picture of how they could be taken into consideration in the development of Finnish ibliometric databases and indicators. Our next objective is to collect a large bibliometric data set covering all the disciplines in a few Finnish universities and to study factors related
to the publishing practices and publishing activity in different discipline groups.

Nils Pharo
Oslo University College, Norway

Pharo (118,04 kB)

In the paper I present a bibliometric study of the collaborative effects of research education within library and information science in the Nordic countries. The study compares inter-nordic co-authorship during two periods, 1987-997 when no formal networks existed and 1998-2005, during which networks have been in operation.


Gunnar Sivertsen & Antje Klitkou
NIFU STEP, Oslo, Norway
Measuring research in the health sector

Sivertsen_Klitkou (371,46 kB)

In our paper we will report about the annual measurement of research activities in the health sector of Norway. This measurement is connected to a research funding formula used by the Ministry of Health. The data retrieval is based on ISI data and the national journal article index. A quarter of all Norwegian articles in the ISI data base has at least one address from a Norwegian hospital. The articles are attributed to the hospitals in collaboration with the hospitals.
We will also report from a comparative study of Scandinavian articles in clinical medicine.


Birger Larsen & Henrik L. Jørgensen
Royal School of Library and Information Science, Denmark
H:S Bispebjerg Hospital, Denmark
Danish Clinical Biochemistry Research in the context of Danish Medical Science

Larsen_Jorgensen (393,64 kB)

In this study we analyse the publication output and citations received by Danish researchers in Clinical Biochemistry and compare it to a random sample of Danish researchers in other fields. The aim is to study the status of Clinical Biochemistry as a research field in Denmark. The researchers were identified among the members of the Danish Medical Association and data collected from PedMed and Web of Science. Both publication output over time and citations received were studied.



We will continually update the list of presentations on this site!

With best regards

Antje Klitkou
NIFU STEP Studies in Innovation, Research and Education
Wergelandsveien 7
NO-0167 Oslo

Sist oppdatert 10.10.2006 av Kirsten Fuglestved