Evaluating information is an important part of the research process. Whilst searching for information you will gather a large amount of materials from many different sources. It is particularly useful when your search retrieves lots of different articles and is a good way of distinguishing which are more relevant to your research question. It is also a useful way of assessing whether the information is at an appropriate level for academic work.
Here are some useful articles to help you with evaluating research.
By the same authors, Step-by-step guide to critiquing research. Part 2: Qualitative research.
Many health research articles are written following the IMRAD structure. IMRAD is an acronym for Introduction Method Research Discussion (Mathieson and Upton, 2008). According to Crombie (1996), questions to consider when appraising/ critiquing articles are:
Introduction: why was the study undertaken? What was the research question or the purpose of the research? The aims of the research should be clearly identifiable and the introduction should ideally contain evidence of a literature review along with keywords used to find information.
Method: Greenhalgh (2010) argues that researchers should use this section and the quality of the methodology to decide whether the evidence is good enough to put into practice or use at an academic level on the strength is the section. Questions such as when, where and how was the study done. Who or which patient groups were included in the research? Was a pilot study conducted beforehand to identify potential problems? Details of the structure of questionnaires should be included along with any tests for validity and reliability (Crombie, 1996). The idea behind the methods section is that any researcher can replicate the study elsewhere.
Also consider:
Sample size: this will affect how reliable and valid the research is. Is the sample big enough? How has it been selected and has the researcher attempted to control any issues which may affect the validity and reliability of the research? Is there any evidence of bias e.g. sponsorship? Has the sample population been randomised?
Response rate: what proportion of the sample responded?
Setting: do the socioeconomic conditions of a particular geographical area mean that the research is not transferable to other areas? Can the results be generalised to the wider population?
Results: what are the results and do they answer the original research question? Have the results been analysed by more than one person? Are the results clearly presented?
Discussion: what are the implications for the research and is it applicable to your practice and day to day working role? The researcher should also include a discussion about how their research could be improved and any limitations of the research.
References
Crombie, I.K. (1996). The pocket guide to critical appraisal: a handbook for health care professionals. London: BMJ.
Greenhalgh, T. (2010). How to read a paper; the basics of evidence based medicine (4th ed.) London: BMJ.
Mathieson, I. and Upton, D. (2008). A podiatrist's guide to using research. Edinburgh: Churchill Livingstone Elsevier.
Health Knowledge: provides a list of useful questions to consider when critiquing a piece of research.
BMJ blog posts on how to read a paper - written by Trisha Greenhalgh
CASP: this is a popular framework for critical appraisal presenting a series of questions to consider depending upon the study type.
JBI critical appraisal tools- provides a similar list of appraisal documents to CASP, with some additional study/paper types.
Barts Critical Appraisal of RCTs using CASP - Barts Health Knowledge and Libraries have created a playlist with a video based on each part of the CASP checklist to help assess RCTs.
Appraising for antiracism - content and supporting checklists designed by Ramona Naicker at the NHS Northern Care Alliance. You can find a direct link to her appraisal checklist here, as well as a further collection of critical appraisal tools here.