evaluate literature review

Literature reviews

• Introduction
• Conduct your search
• Store and organise the literature

Evaluate the information you have found

Critique the literature.

• Different subject areas
• Find literature reviews

When conducting your searches you may find many references that will not be suitable to use in your literature review.

• Skim through the resource. A quick read through the table of contents, the introductory paragraph or the abstract should indicate whether you need to read further or whether you can immediately discard the result.
• Evaluate the quality and reliability of the references you find. Our evaluating information  page outlines what you need to consider when evaluating the books, journal articles, news and websites you find to ensure they are suitable for use in your literature review.

Critiquing the literature involves looking at the strength and weaknesses of the paper and evaluating the statements made by the author/s.

Books and resources on reading critically

• CASP Checklists Critical appraisal tools designed to be used when reading research. Includes tools for Qualitative studies, Systematic Reviews, Randomised Controlled Trials, Cohort Studies, Case Control Studies, Economic Evaluations, Diagnostic Studies and Clinical Prediction Rule.
• How to read critically - business and management From Postgraduate research in business - the aim of this chapter is to show you how to become a critical reader of typical academic literature in business and management.
• Learning to read critically in language and literacy Aims to develop skills of critical analysis and research design. It presents a series of examples of `best practice' in language and literacy education research.
• Critical appraisal in health sciences See tools for critically appraising health science research.

• << Previous: Store and organise the literature
• Next: Different subject areas >>
• Last Updated: Nov 20, 2024 5:10 PM
• URL: https://guides.library.uq.edu.au/research-techniques/literature-reviews

Conducting a Literature Review

• Getting Started
• Define your Research Question
• Finding Sources
• Evaluating Sources
• Organizing the Review
• Cite and Manage your Sources

Introduction

The process of evaluating sources can take place when you first encounter a source, when you're reading it over, and as you incorporate it into your project. In general, some level of evaluation should take place at all of these stages, with different goals for each. The last evaluation will be discussed in "Organizing the Review," but we'll go over the first two here.

The overall purpose of evaluating sources is to make sure that your review has the most relevant, accurate, and unbiased literature in the field, so that you can determine what has already been learned about your topic and where further research may be needed.

Additional Resources

• Evaluate Sources by Kansas State University Libraries
• How to Evaluate Any Source by Skyline College Library

Evaluating Sources During the Initial Search Process

When you first encounter a potential source, you'll want to know very quickly whether it is worth reading in detail and considering for your literature review. To avoid wasting time on unhelpful sources as much as possible, it's generally best to run each article, book, or other resource you find through a quick checklist, using information you can find by skimming through the summary and introduction.

The two most common forms of early source evaluation are the "Big 5 Criteria" and the "CRAAP Test." These cover the same most significant variables for evaluation, and which one to use comes down to preference.

Big 5 Criteria:

The most important criteria for evaluating a potential resource are:

• Currency : When the source was published
• Coverage/Relevance : How closely related the source is to your topic and research question
• Authority : Who wrote the source and whether they are likely to be credible on the subject
• Accuracy : Whether the information is accurate or not (this will be more heavily evaluated further on in the research process, but you should skim through quickly for any obviously inaccurate information as a means of disqualifying the source)
• Objectivity/Purpose : Whether or not the source presents a biased point of view or agenda

A good rule of thumb for  Currency  is that medical, scientific, and technology resources should be published within the last 5 years to prevent the information from being out-of-date; for less time-sensitive topics like history or the humanities, resources published within the last 5-10 years are often acceptable.

CRAAP Test:

A helpful mnemonic to remember the evaluation criteria, CRAAP is an acronym for:

Helpful questions for initial evaluation:

• When was this source published?
• Is this source relevant to your topic?
• What are the author or authors' qualifications?
• Is the resource scholarly/peer-reviewed?
• Are sources cited to support the author's claims?
• Does the website or journal the source comes from have a bias to their reporting?
• Do you notice biased or emotional language in the summary or introduction?
• Do you notice spelling or grammatical errors in a quick examination of the source?
• Writing a Research Paper: Evaluate Sources by Kansas State University

Evaluating Sources During the Reading Process

Once a resource has passed the initial evaluation, you are ready to begin reading through it to more carefully determine if it belongs in your project. In addition to the questions posed above, which are always relevant to evaluating sources, you should look at your potential sources of literature with an eye to the following questions:

1. Is there any bias visible in the work?

You already began this process in the previous step and hopefully eliminated the most obviously unreliable sources, but as you read it is always important to keep an eye out for potential blind spots the author might have based on their own perspective. Bias is not inherently disqualifying -- a biased article may still have accurate information -- but it is essential to know if a bias exists and be aware of how it might impact how the information was gathered, evaluated, or delivered.

Peer-reviewed sources tend to be less likely to have this risk, because multiple editors had to go through the resource looking for mistakes or biases. They need to meet a much higher academic threshold.

2. How was the research conducted? Are there any strengths or weaknesses in its methodology?

It is important to understand how the study in your source was administered; a significant part of the literature review will be about potential gaps in the current research, so you need to understand how the existing research was done.

3. How does the author justify their conclusions?

Either through the results of their own research or by citing external evidence, an article, book, or other type of resource should provide proof of its claims. In the initial research process you checked to make sure that there was evidence supporting the author's assertions; now it is time to take a look at that evidence and see if you find it compelling, or if you think it doesn't justify the conclusions drawn by the article.

4. What similarities do these articles share?

Grouping your literature review by categories based on subtopic, findings, or chronology can be an extremely helpful way to organize your work. Take notes while you're reading of common themes and results to make planning the review easier.

5. Where does this research differ from the other sources?

While very close to the previous question, this one emphasizes what unique information, methodology, or insights a particular source brings to the overall understanding of the topic. What  new  knowledge is being brought to the table by this source that would justify it appearing in your literature review?

6. Does this source leave any unanswered questions or opportunities for further research?

Most scholarly journal articles will include a section near the end of the article addressing limits of their study and opportunities for further research. Examine these closely and see where other sources you have fill in the gaps, and where perhaps additional research needs to be done to gain a more complete understanding of your topic.

As you go through this process, you might find yourself eliminating certain sources that no longer seem like they fit with your project's goals, or getting inspired to search for additional sources based on new information you've found. This is a normal part of the research process, and additional searching may be necessary to fill in any gaps left after evaluating the sources you already have.

• << Previous: Finding Sources
• Next: Organizing the Review >>
• Last Updated: Sep 4, 2024 1:20 PM
• URL: https://libraryservices.acphs.edu/lit_review

Purdue Online Writing Lab College of Liberal Arts

Writing a Literature Review

Welcome to the Purdue OWL

This page is brought to you by the OWL at Purdue University. When printing this page, you must include the entire legal notice.

Copyright ©1995-2018 by The Writing Lab & The OWL at Purdue and Purdue University. All rights reserved. This material may not be published, reproduced, broadcast, rewritten, or redistributed without permission. Use of this site constitutes acceptance of our terms and conditions of fair use.

A literature review is a document or section of a document that collects key sources on a topic and discusses those sources in conversation with each other (also called synthesis ). The lit review is an important genre in many disciplines, not just literature (i.e., the study of works of literature such as novels and plays). When we say “literature review” or refer to “the literature,” we are talking about the research ( scholarship ) in a given field. You will often see the terms “the research,” “the scholarship,” and “the literature” used mostly interchangeably.

Where, when, and why would I write a lit review?

There are a number of different situations where you might write a literature review, each with slightly different expectations; different disciplines, too, have field-specific expectations for what a literature review is and does. For instance, in the humanities, authors might include more overt argumentation and interpretation of source material in their literature reviews, whereas in the sciences, authors are more likely to report study designs and results in their literature reviews; these differences reflect these disciplines’ purposes and conventions in scholarship. You should always look at examples from your own discipline and talk to professors or mentors in your field to be sure you understand your discipline’s conventions, for literature reviews as well as for any other genre.

A literature review can be a part of a research paper or scholarly article, usually falling after the introduction and before the research methods sections. In these cases, the lit review just needs to cover scholarship that is important to the issue you are writing about; sometimes it will also cover key sources that informed your research methodology.

Lit reviews can also be standalone pieces, either as assignments in a class or as publications. In a class, a lit review may be assigned to help students familiarize themselves with a topic and with scholarship in their field, get an idea of the other researchers working on the topic they’re interested in, find gaps in existing research in order to propose new projects, and/or develop a theoretical framework and methodology for later research. As a publication, a lit review usually is meant to help make other scholars’ lives easier by collecting and summarizing, synthesizing, and analyzing existing research on a topic. This can be especially helpful for students or scholars getting into a new research area, or for directing an entire community of scholars toward questions that have not yet been answered.

What are the parts of a lit review?

Most lit reviews use a basic introduction-body-conclusion structure; if your lit review is part of a larger paper, the introduction and conclusion pieces may be just a few sentences while you focus most of your attention on the body. If your lit review is a standalone piece, the introduction and conclusion take up more space and give you a place to discuss your goals, research methods, and conclusions separately from where you discuss the literature itself.

Introduction:

• An introductory paragraph that explains what your working topic and thesis is
• A forecast of key topics or texts that will appear in the review
• Potentially, a description of how you found sources and how you analyzed them for inclusion and discussion in the review (more often found in published, standalone literature reviews than in lit review sections in an article or research paper)
• Summarize and synthesize: Give an overview of the main points of each source and combine them into a coherent whole
• Analyze and interpret: Don’t just paraphrase other researchers – add your own interpretations where possible, discussing the significance of findings in relation to the literature as a whole
• Critically Evaluate: Mention the strengths and weaknesses of your sources
• Write in well-structured paragraphs: Use transition words and topic sentence to draw connections, comparisons, and contrasts.

Conclusion:

• Summarize the key findings you have taken from the literature and emphasize their significance
• Connect it back to your primary research question

How should I organize my lit review?

Lit reviews can take many different organizational patterns depending on what you are trying to accomplish with the review. Here are some examples:

• Chronological : The simplest approach is to trace the development of the topic over time, which helps familiarize the audience with the topic (for instance if you are introducing something that is not commonly known in your field). If you choose this strategy, be careful to avoid simply listing and summarizing sources in order. Try to analyze the patterns, turning points, and key debates that have shaped the direction of the field. Give your interpretation of how and why certain developments occurred (as mentioned previously, this may not be appropriate in your discipline — check with a teacher or mentor if you’re unsure).
• Thematic : If you have found some recurring central themes that you will continue working with throughout your piece, you can organize your literature review into subsections that address different aspects of the topic. For example, if you are reviewing literature about women and religion, key themes can include the role of women in churches and the religious attitude towards women.
• Qualitative versus quantitative research
• Empirical versus theoretical scholarship
• Divide the research by sociological, historical, or cultural sources
• Theoretical : In many humanities articles, the literature review is the foundation for the theoretical framework. You can use it to discuss various theories, models, and definitions of key concepts. You can argue for the relevance of a specific theoretical approach or combine various theorical concepts to create a framework for your research.

What are some strategies or tips I can use while writing my lit review?

Any lit review is only as good as the research it discusses; make sure your sources are well-chosen and your research is thorough. Don’t be afraid to do more research if you discover a new thread as you’re writing. More info on the research process is available in our "Conducting Research" resources .

As you’re doing your research, create an annotated bibliography ( see our page on the this type of document ). Much of the information used in an annotated bibliography can be used also in a literature review, so you’ll be not only partially drafting your lit review as you research, but also developing your sense of the larger conversation going on among scholars, professionals, and any other stakeholders in your topic.

Usually you will need to synthesize research rather than just summarizing it. This means drawing connections between sources to create a picture of the scholarly conversation on a topic over time. Many student writers struggle to synthesize because they feel they don’t have anything to add to the scholars they are citing; here are some strategies to help you:

• It often helps to remember that the point of these kinds of syntheses is to show your readers how you understand your research, to help them read the rest of your paper.
• Writing teachers often say synthesis is like hosting a dinner party: imagine all your sources are together in a room, discussing your topic. What are they saying to each other?
• Look at the in-text citations in each paragraph. Are you citing just one source for each paragraph? This usually indicates summary only. When you have multiple sources cited in a paragraph, you are more likely to be synthesizing them (not always, but often
• Read more about synthesis here.

The most interesting literature reviews are often written as arguments (again, as mentioned at the beginning of the page, this is discipline-specific and doesn’t work for all situations). Often, the literature review is where you can establish your research as filling a particular gap or as relevant in a particular way. You have some chance to do this in your introduction in an article, but the literature review section gives a more extended opportunity to establish the conversation in the way you would like your readers to see it. You can choose the intellectual lineage you would like to be part of and whose definitions matter most to your thinking (mostly humanities-specific, but this goes for sciences as well). In addressing these points, you argue for your place in the conversation, which tends to make the lit review more compelling than a simple reporting of other sources.

• UConn Library
• Literature Review: The What, Why and How-to Guide
• Evaluating Sources & Lit. Reviews

Literature Review: The What, Why and How-to Guide — Evaluating Sources & Lit. Reviews

• Getting Started
• Introduction
• How to Pick a Topic
• Strategies to Find Sources
• Tips for Writing Literature Reviews
• Writing Literature Review: Useful Sites
• Citation Resources
• Other Academic Writings

Reading Critically

To be able to write a good literature review, you need to be able to read critically. Below are some tips that will help you evaluate the sources for your paper.

Reading critically (summary from How to Read Academic Texts Critically)

• Who is the author? What is his/her standing in the field?
• What is the author’s purpose? To offer advice, make practical suggestions, solve a specific problem, to critique, or clarify?
• Note the experts in the field. Are there specific names/labs that are frequently cited?
• Pay attention to methodology. Is it sound? What testing procedures, subjects, and materials were used?
• Note conflicting theories, methodologies and results. Are there any assumptions being made by most/some researchers?
• Theories: Have they evolved overtime?
• Evaluate and synthesize the findings and conclusions. How does this study contribute to your project?

Useful links:

Tips to Evaluate Sources

Criteria to evaluate sources:

Authority : Who is the author? what is his/her credentials--what university he/she is affliliated? Is his/her area of expertise?

Usefulness : How this source related to your topic? How current or relevant it is to your topic?

Reliability : Does the information comes from a reliable, trusted source such as an academic journal?

Useful sites

• Critically Analyzing Information Sources (Cornell University Library)

Evaluating Literature Reviews and Sources

A good literature review evaluates a wide variety of sources (academic articles, scholarly books, government/NGO reports). It also evaluates literature reviews that study similar topics. This page offers you a list of resources and tips on how to evaluate the sources that you may use to write your review.

• A Closer Look at Evaluating Literature Reviews Excerpt from the book chapter, “Evaluating Introductions and Literature Reviews” in Fred Pyrczak’s Evaluating Research in Academic Journals: A Practical Guide to Realistic Evaluation , (Chapter 4 and 5). This PDF discusses and offers great advice on how to evaluate "Introductions" and "Literature Reviews" by listing questions and tips.

• Tips for Evaluating Sources (Print vs. Internet Sources) Excellent page that will guide you on what to ask to determine if your source is a reliable one. Check the other topics in the guide: Evaluating Bibliographic Citations and Evaluation During Reading on the left side menu.
• << Previous: Strategies to Find Sources
• Next: Tips for Writing Literature Reviews >>
• Last Updated: Sep 21, 2022 2:16 PM
• URL: https://guides.lib.uconn.edu/literaturereview