In recent decades, the ‘evidence-based medicine’ movement has become widely accepted and, consequently, decisions regarding what is best practice are informed by the best available evidence
. However, an ever-increasing quantity of evidence published in literature has meant that healthcare providers, researchers, and policy makers are inundated with unmanageable amounts of information, which can hinder, rather than inform, rational decision making
. It is therefore vital that healthcare professionals, including pharmacists, appreciate the importance of evaluating the available evidence when attempting to answer a clinical question
. A literature review can therefore be considered “the comprehensive study and interpretation of literature that relates to a particular topic”
When conducted correctly, a literature review can be viewed as more than simply a cursory overview of the literature on a given topic. Indeed, they are often viewed as a piece of research in their own right. A historical example of the value of literature reviews in informing evidence-based practice is that of streptokinase in the treatment of myocardial infarction (MI). In the 1970s, 33 separate clinical trials comparing streptokinase with a placebo for the treatment of MI had been conducted and their results published. Individually, these trials provided inconclusive evidence regarding the role of streptokinase. However, a re-analysis of their combined results clearly demonstrated the beneficial effect of streptokinase. As a result the medicine became part of the standard treatment following MI, thereby transforming care and saving lives
Narrative versus systematic literature reviews
Literature reviews can be broadly divided into narrative (descriptive) reviews and systematic reviews
. The most important difference between the two categories of reviews is the difference in their level of associated scientific rigour. Narrative literature reviews provide an overview of the literature, typically from the perspective of an ‘expert in the field’
. Such reviews often report findings in a format that includes a brief summary of each included study. While such reviews can be informative, particularly when there has been no previous attempt to assimilate the literature in a given area, narrative reviews are often criticised as having a high risk of various types of bias associated with them
. Narrative reviews typically rely on subjective and non-systematic methods of selecting and reviewing data. Consequently, authors may intentionally or unintentionally cite only those literature sources that reinforce the author’s preconceived hypotheses or promote their own views on a topic
In contrast to a narrative review, a systematic literature review aims to identify all the available evidence on a topic and appraise the quality of that evidence
. Therefore, such reviews have the ability to either answer the research question or, failing that, identify gaps in the existing literature which highlight the need for further high quality research into a specific area
. Established in 1993, the Cochrane collaboration is an international organisation that produces systematic reviews, often regarded as the gold standard of evidence, concerning the effectiveness of healthcare interventions.
The purpose of a literature review
Literature reviews may be conducted for a variety of reasons, for example, to form part of a research proposal or introductory section in an academic paper, or to inform evidence-based practice
. The original focus of evidence-based medicine concerned mainly clinical research questions, such as the streptokinase example. However, increasingly, more research is being conducted in the area of health services research, which incorporates social science perspectives with the contribution of individuals and institutions that deliver care. Pharmacy practice research (a sub-type of health services research) is concerned with investigating how and why people access pharmacy services, new roles for pharmacists, and outcomes for patients as a result of pharmacy services
. Whether conducting either a clinical pharmacy or a pharmacy practice literature review, the following basic principles outlined in this article should be followed.
Searching with a strategy
While time and resource constraints may not allow for a definitive systematic review to be conducted, those attempting to undertake a literature review should nevertheless adopt a ‘systematic approach’
. The first step in any literature review is to define the research question (i.e. the scope of the review). This will inform which studies or other forms of evidence are to be included and excluded from the literature review.
Questions that should be asked at this stage include:
- Which study designs are relevant to the review? For example, double-blind randomised controlled trials, observational studies or qualitative research.
- Is there a particular population of interest? For example, paediatrics, pregnant women or people living in care homes.
- Are there particular outcomes of interest? For example, mortality, costs or quality of life.
The literature search strategy is a fundamental component of any literature review, because errors in the search process could produce an incomplete and therefore biased evidence base for the review. Where possible, reviewers should consult with a pharmacy or healthcare librarian who can assist in developing and refining an appropriate search strategy
. The search should be conducted in more than one electronic database to help ensure all relevant papers are identified. The main medical literature databases are Medline and Embase. International Pharmaceutical Abstracts (IPA) is also an important database to consider because it indexes many pharmacy-specific journals not found in the larger databases. It should also be remembered that pharmacy literature often overlaps with other disciplines therefore consideration should be given to databases such as the Cumulative Index of Nursing and Allied Health (CINAHL), as well as condition-specific databases, for example PsycInfo.
When conducting searches on electronic databases, thought must be given to the search terms used. Several keywords can exist for each search term and all should be included in the search (e.g. older adult/elderly/aged, are all terms that could be used synonymously). Most databases also have the facility to identify all possible endings of the key terms; this is usually denoted with an asterisk. For example, by searching for ‘pharm*’, articles containing any of the following would be retrieved: pharmacist, pharmacists, pharmacy, pharmaceutical. Boolean operators (e.g. ‘and’, ‘or’, ‘not’) can also be used to combine search terms to refine the search results
Avoiding publication bias
It has been well documented that studies that report significant results are more likely than those reporting non-significant results to be published, cited by others and produce multiple publications, introducing what is known as ‘publication bias’. Consequently, such studies are also more likely to be identified and included in systematic reviews
For this reason, efforts should be made to identify all relevant literature on the review topic so the search should not be limited solely to electronic databases
. Additional search strategies include hand-checking relevant article reference lists and personal communication with experts in the field. Searching the ‘grey literature’ is of particular importance for pharmacy practice literature reviews because relevant articles written by non-academic pharmacists are often not published in traditional academic journals
The importance of such additional search strategies cannot be underestimated. Greenhalgh and Peacock reported that, in a literature review concerning innovations in healthcare organisations, 51% of the sources included in the eventual review were identified by hand-searching reference lists, while an additional 24% were identified through personal communications
. The search strategy, including databases searched, all search terms used, the limits of the search (for example, written in the English language, published in the last decade), the number of results retrieved from each resource and the date the search was conducted should be carefully documented. Although it can never be guaranteed that the entirety of relevant literature will be identified, conducting the search in a systematic manner will help avoid omissions, and where they do exist they can be said to be unintentional
Once the search has been performed, the next step is to screen the titles or abstracts (or both) of the identified articles against the predefined inclusion and exclusion criteria. If the article cannot be excluded on the basis of the information contained in the abstract, efforts must be made to access the full paper in order to reach a decision. Conducting a literature review can be a time-consuming process and the time taken to complete is directly related to number of citations identified by the initial search. Allen et al.
calculated that it would take a reviewer more than 1,000 hours to complete a literature review involving the screening of 2,500 articles. For this reason, it is worth considering the use of free citation management software, such as Refworks, Mendeley and Endnote, which can be used to manage references retrieved from the literature search.
Studies identified as part of a literature review may report contradictory findings and the quality of the individual studies will have a direct impact on the overall findings of the literature review. When assimilating the evidence identified, the reviewer should attempt to assess the quality of the evidence provided by the individual studies to arrive at valid conclusions
. It is recommended that when conducting a literature review, the author should make a judgement of the quality of the evidence provided within the included studies or articles using appropriate assessment guidelines
. For example, the Cochrane Collaboration’s risk-of-bias tool attempts to aid quality assessment in terms of assessing potential sources of bias in studies.
In an effort to draw quantitative conclusions within a systematic review, data from individual studies may be pooled quantitatively and reanalysed. A meta-analysis is a statistical method used to combine the outcomes of individual studies to produce data with more power than the individual studies. By pooling the results of individual studies, the sample size is effectively increased, thereby increasing the statistical power of the analysis, which in turns narrows the confidence interval around the effect size, with the result that the overall estimate of effect is more robust
. Individual studies included in the analysis are assigned weights, with greater weight assigned to studies with larger sample sizes. The results of a meta-analysis are often displayed graphically in what is known as a “forest plot”
Publishing your literature review
Targeting an appropriate journal
- Ensure the scope of your review aligns with the scope of the journal. Familiarise yourself with the journal’s mission statement and the typical content of the journal.
- Be aware of the journal’s target audience in relation to the scope of the review (e.g. does the journal have a pharmacy-specific or multidisciplinary audience? Does the journal have a national or international readership?)
- Consider whether the journal offers open-access publishing. Increasingly, funding bodies stipulate that articles are published only in open-access journals.
- Look at the journal’s impact factor. While articles published in journals with higher impact factors tend to get cited more, high-impact journals have lower article acceptance rates, making it potentially more challenging to get your review published.
Submitting the manuscript
- Familiarise yourself with the journal’s ‘guidelines for authors’. These will dictate the accepted word limit of a review in addition to other formatting and submission stipulations surrounding tables, figures and references, etc.
- Write a cover letter, addressed to the editor of the journal, to accompany your manuscript submission. The cover letter should highlight why the review is important and why you think it is a good fit for the chosen journal.
Reading this article counts towards your CPD
You can use the following forms to record your learning and action points from this article from Pharmaceutical Journal Publications.
Your CPD module results are stored against your account here at The Pharmaceutical Journal. You must be registered and logged into the site to do this. To review your module results, go to the ‘My Account’ tab and then ‘My CPD’.
Any training, learning or development activities that you undertake for CPD can also be recorded as evidence as part of your RPS Faculty practice-based portfolio when preparing for Faculty membership. To start your RPS Faculty journey today, access the portfolio and tools at www.rpharms.com/Faculty
If your learning was planned in advance, please click:
If your learning was spontaneous, please click:
 Akobeng AK. Understanding systematic reviews and meta-analysis. Arch Dis Child 2005;90:845–848. doi: 10.1136/adc.2004.058230
 Mulrow CD. Systematic Reviews: Rationale for systematic reviews.The BMJ 1994;309:597. doi: 10.1136/bmj.309.6954.597
 Guyatt G, Cairns J, Churchill D et al. Evidence-based medicine: a new approach to teaching the practice of medicine. JAMA 1992;268:2420–2425. doi: 10.1001/jama.268.17.2420
 Aveyard H. Doing a literature review in health and social care: a practical guide. 3rd Edn. Open University Press 2014. doi: 10.7748/ns.29.27.30.s33
 Grant MJ & Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J 2009;26:91–108. doi: 10.1111/j.1471-1842.2009.00848.x
 Green BN. Writing narrative literature reviews for peer-reviewed journals: secrets of the trade. J Chiropr Med 2006;5:101–117. doi: 10.1016/S0899-3467(07)60142-6
 Greenhalgh T & Peacock R. Effectiveness and efficiency of search methods in systematic reviews of complex evidence: audit of primary sources.The BMJ. 2005;331:1064–1065. doi: 10.1136/bmj.38636.593461.68
 Jesson J & Lacey F. How to do (or not to do) a critical literature review. Pharmacy Education 2006;6:139–148. doi: 10.1080/15602210600616218
 Babar Z. Pharmacy Practice Research Methods: Adis/Springer International Publishing, Switzerland, 2015.
 McKee M & Britton A. Conducting a literature review on the effectiveness of health care interventions. Health Policy Plan 1997;12:262–267. doi: 10.1093/heapol/12.3.262
 McGowan J & Sampson M. Systematic reviews need systematic searchers. J Med Libr Assoc 2005;93:74–80.
 Cronin P, Ryan F & Coughlan M. Undertaking a literature review: a step-by-step approach. BJN 2008;17:38–43. doi: 10.12968/bjon.2008.17.1.28 059
 Sterne J, Egger M & Smith GD. Investigating and dealing with publication and other biases in meta-analysis. The BMJ 2001;323:101. doi: 10.1136/bmj.323.7304.101
 Crumley ET, Wiebe N, Cramer K et al. Which resources should be used to identify RCT/CCTs for systematic reviews: a systematic review. BMC Med Res Methodol 2005;5:24. doi: 10.1186/1471-2288-5-24
 Charrois T, Durec T & Tsuyuki R. Systematic reviews of pharmacy practice research: methodologic issues in searching, evaluating, interpreting, and disseminating results. Ann Pharmacother 2009;43:118–122. doi: 10.1345/aph.1l302
 Allen E & Olkin I. Estimating time to conduct a meta-analysis from number of citations retrieved. JAMA 1999;282:634–635. PMID: 10517715
 JÃ¼ni P, Altman DG & Egger M. Assessing the quality of controlled clinical trials. The BMJ 2001;323:42–46. doi: 10.1136/bmj.323.7303.42
 Lewis S & Clarke M. Forest plots: trying to see the wood and the trees. The BMJ 2001;322:1479–1480. doi: 10.1136/bmj.322.7300.1479