Skip to main content
The Library is open 24/7

The Library

Research Support

What are Research Metrics?

Research metrics are quantitative values designed to help evaluate research outputs according to a variety of indicators. These indicators may relate to the author, the journal or the paper. There are a large number of metrics available, but they all have some limitations, and any indications they give should be evaluated against a broader background of peer-review. 

The tabs in the box below cover Citation based metrics, Journal Impact Factors, Journal Rankings, H-Index and Altmetrics.

 

Metrics

When we talk about ‘Bibliometrics’ we refer to the quantitative measures used to assess research output i.e. publication and citation data analysis.

The number of citations an article receives (from authors of other papers) is generally considered to be a useful indication of a paper’s impact and value to the wider scientific research community.

Staff note: Symplectic includes citation count information from Scopus. The only citations displayed within Symplectic will be those cited by sources gathered by Scopus.

click here to access Scopus

 

 

N.B. Google Scholar is a free alternative that has broader coverage of sources where the citation may occur, but lacks the quality control of Scopus. It is important to note that citation data from each source may vary.

Quantitative measures provide just one part of the picture.  They should only be used where it is appropriate to do so and with an understanding that it is extremely difficult to compare across disciplines without taking into account a discipline's publication and citation patterns.

The main citation tools may not offer the ability to produce appropriate and accurate metrics in Humanities, Engineering and Computer Science which are less dependent on journals when compared to other disciplines. The coverage of areas within the Social Sciences is also limited in a number of tools.

Journal Impact Factor, also known as JIF or IF, is a means of judging the relative importance of a journal within its field. The term is commonly used, but Journal Impact Factor is only one of various metrics which can be used for this task with means of measuring concepts like ‘worth’ and ‘importance’ of course open to debate.

If a title has an Impact Factor, it is usually listed in the ‘About’ section of a journal’s homepage. An annually updated list of journals with Impact Factors is available, as well as a searchable list of titles.

Leeds Beckett Library’s main tool for assessing the importance of journals by metrics is Scopus. There is more information on its use in the next tab, Journal Rankings, with subject-specific advice available from your Academic Librarian.

Like an impact factor, journal rankings enable you to find out which journals have the most influence in a particular discipline.

Journal Analyzer from Scopus allows you to search for data from individual journal titles or compare journals by discipline. It has 2 journal ranking tools which use different methodologies:

  • SCImago calculates using citations from Scopus over the previous 3 years and gives more weight to citations from highly ranked journals.
  • SNIP (Source Normalized Impact per Paper) normalises for subject differences to contextualise the number of citations in a given field.

SNIP and SJR (Scientific Journal Rankings) are also freely available online: http://www.journalmetrics.com/

Other useful tools include Publish or Perish which analyses data from Google Scholar: http://www.harzing.com/pop.htm

More information on journal rankings is available from module 3 of MyRI's helpful tutorial on measuring research impact, and your Academic Librarian can also advise.

 

The h-index is a popular metric in the sciences and is used to assess an individual, group of individuals or an institution. The h-index (a single number) takes into account productivity (paper count) AND impact (citations). If an individual has a h-index of 7, this means that 7 of their papers have been cited at least 7 times each.

A word of caution: As with other key metrics, the h-index can only be used effectively by comparing like with like, for example: similar institutions, individuals in a similar discipline and at a similar stage in their career. The calculation will also depend on the tool used.

STAFF note: Symplectic derives h-index from Web of Science (not subscribed to by Leeds Beckett) and Scopus and will only apply to publication records from those sources.

click here to access Scopus

 

h-index

 

N.B. Google Scholar is a free alternative that has broader coverage but lacks the quality control of Scopus It is important to note that citation data from each source may vary.

Quantitative measures provide just one part of the picture.  They should only be used where it is appropriate to do so and with an understanding that it is extremely difficult to compare across disciplines without taking into account a discipline's publication and citation patterns.

It is also widely acknowledged that the main citation tools do not offer the ability to produce appropriate and accurate metrics in Humanities, Engineering and Computer Science which are less dependent on journals when compared to other disciplines. The coverage of areas within the Social Sciences is also limited in a number of tools.

Altmetrics are alternative metrics - rather than the traditional bibliometrics that measure your citation counts and journal impact factors that you may be used to.

Altmetrics measure the 'mentions' of your research (anything with a DOI), through social media, blogs, news reports and websites. They can be a powerful tool in helping you disseminate your research beyond the academic sphere, providing results as soon as your research is published and allowing you to ensure it is represented and interpreted accurately. 

There are several tools you can use to check your alternative metrics; Impact StoryKudosPlum Analytics and Altmetric.We use Altmetric as it integrates with Symplectic and our repository - you may have seen the coloured 'donut' icon next to your article which indicates the Altmetric score for each output:

You can see your donuts on Symplectic or next to each record in the repository. Each coloured strand represents a different type of 'mention' and Altmetric calculates an overall score, giving more weight to news reports and adjusting for duplication. Clicking on the donut will take you to a detailed page where you can see each of these mentions and where they originate. This enables you to monitor how your research is disseminated.

The Research Service provide support with altmetrics and using social media to effectively disseminate your research - please contact us if you would like any guidance.

STAFF note: Symplectic Elements tracks altmetrics via http://www.altmetric.com/ for any record that includes a Digital Object Identifier (DOI).

Look out for the altmetric "donut" on your records in Symplectic:

Loading ...

Contact your Academic Librarian