Grading Criteria

Possible Points

Student’s Score

I. Format

10

A. Title page that includes name, topic, course title, date, instructor.

1

B. Structure

1. Neatly typewritten

2. Spelling and grammar

3. Logical topic development

5

C. Length (3-4 pages] not counting title page)

2

D. APA general formatting rules and citations throughout paper

2

II. Content

80

A. Summary of Article:

1. Examine the organization and presentation of the report

2. Complete, concise, clearly presented, and logically organized

3. Does not include excessive jargon that is difficult for students and practicing nurses to read

4. References are complete, current and consistent in forma

5. Authors have the educational and clinical credentials to conduct the study    

Remember, this is a critique of the research article, and the summary is a critique summary, not a summation of the author’s work.

20

B. Critique

Identification of report elements: Evaluate objectively, then explain how these elements from the chosen study meet (or do not meet) the expected definition and purpose of each element:

1. Research problem & purpose

2. Literature review

3. Conceptual framework

4. Research objective (statement, question, hypothesis)

5. Independent and dependent variables or research variables and concepts (depending on research design)

6. The stated operational and conceptual definitions for variables and concepts

7. Research design

8. Sampling method (not population), probability or non-probability – and plan type

9. Measurement reliability/validity

10. Data collection method/ including ethical consideration of human subjects, and ethical data collection methods

11. Data analysis method

12. Stated interpretation and discussion of findings, and application to clinical practice

30

Discuss strengths and weaknesses of the research.

In this comparison and analysis phase of the critique, consider how the research elements relate to one another, particularly in reference to the stated research design. Here is a suggestion list of elements to consider. Reference your Research text also, as this is not an exhaustive list.

· is the research objective format at a comparable level to the stated design

· do the operational tools measure the concept

· do the data reflect the level of measurement necessary for the stated statistics used

· is the sampling method and plan style appropriate for the chosen research design

· has the author related the theoretical framework to concept variables, and outcomes

· is the problem heuristic to nursing, does the theoretical basis related to nursing concerns

· are limitations (both types) and biases addressed – can you identify possible concerns to generalizability

· validity and reliability of instruments / data : of outcomes due to uncontrolled threats

· does the author support the study rigor expected for the stated design

· are study variables – demographics, setting – controlled sufficiently for chosen research design

1. Specify examples

2. Justify your criticisms of these examples

3. Suggest research method alternatives

20

Implications. Explore implications of the study for:

1. Professional clinical practice

2. Further research (higher level, replication for changes in elements)

10

III. References

10

1. APA style

2. Article criteria: <5 years, nurse authored, peer reviewed

3. USA published

Total Points

100

STANDARDS/EVALUATION CRITERIA

Research Problem and Purpose

1. What are the study problem and purpose? Is the problem sufficiently narrow in scope without being trivial? Does the purpose narrow and clarify the focus or aim of the study and identify the research variables, population, and setting?

2. Is the problem significant and relevant to nursing?

3. Was the study feasible to conduct in terms of money commitment; the researchers’ expertise; availability of subjects, facility, and equipment; and ethical considerations?

Literature Review

1. Are relevant previous studies identified and described?

2. Are relevant theories and models identified and described?

3. Are the references current? Examine the number of sources in the past 5 and 10 years in the reference list.

4. Are the studies critiqued by the author?

5. Is a summary of the current knowledge provided? This summary needs to include what is known and not known about the research problem.

6. Is the literature review organized to demonstrate the progressive development of ideas through previous research?

7. Is a theoretical knowledge base developed for the problem and purpose?

8. Does the literature review provide a rationale direction for the study?

9. Does the summary of the current empirical and theoretical knowledge provide a basis for the study?

Study Framework

1. Is a study framework identified? Is the framework explicitly presented or must it be extracted from the literature review? Is the framework presented with clarity?

2. Is a particular theory or model identified as a framework for the study?

3. Does the framework describe and define the concepts of interest? Does the framework present the relationships among the concepts? Is a map or model of the framework provided for clarity?

4. Link the concepts in the framework with the variables in the study. Is the framework linked to research purpose? Would another framework fit more logically with the study?

5. Is the framework related to nursing’s body of knowledge?

6. If a proposition from a theory is to be tested, is the proposition clearly identified and linked to the study’s hypothesis?

Research Objectives, Questions, or Hypotheses

1. Are the objectives, questions, or hypotheses clearly and concisely expressed?

2. Are the objectives, questions, or hypotheses logically linked to the research purpose?

3. Are the research objectives, questions, or hypotheses linked to concepts and relationships (propositions) from the framework?

Variables

1. Are the major variables or concepts identified and defined (conceptually and operationally)? Identify and define the appropriate variables included in the study:

a. Independent

b. Dependent

c. Research variables or concepts

2. Do the variables reflect the concepts identified in the framework?

3. Are the major variables or concepts identified and defined (conceptually and operationally) based on previous research and/or theories?

4. Is the conceptual definition of a variable consistent with the operational definition?

5. What attribute or demographic variables are examined in the study?

Design

1. Is the research design clearly addressed? Identify the specific design of the study. Was the best design selected to direct this stud?

2. Does the design provide a means to examine all of the objectives, questions, or hypotheses and the study purpose?

3. Does the study include a treatment or intervention? If so, is the treatment clearly described and consistently implemented? Is the treatment conceptually and operationally defined? Is the treatment appropriate for examining the study purpose and hypotheses?

4. Are the extraneous variables identified and controlled?

5. Were pilot study findings used to design the major study? If so, briefly discuss the pilot study and the findings. Indicate the changes made in the major study based on the pilot.

6. What are the threats to design validity? Were these threats identified by the researcher?

7. Have the threats to design validity (statistical conclusion validity, internal validity, construct validity, and external validity) been minimized?

8. Is the design logically linked to the sampling method and statistical analyses?

Sample, Population, and Setting

1. Is the target population to which the findings will be generalized defined? Are the inclusion and exclusion sample criteria described? Did the researchers indicate the method used to obtain the sample? Is the sampling method adequate to produce a sample that is representative of the study population? What are the potential biases in the sampling method?

2. Identify the sample size and indicate if a power analysis was conducted to determine sample size. What number and percentage of the potential subjects refused to participate? Is the sample size sufficient to avoid a Type II error?

3. Identify the characteristics of the sample. Identify the sample mortality or attrition from the study. If more than one group is used, do the groups appear equivalent?

4. Discuss the institutional review board approval and informed consent obtained. Are the rights of human subjects protected? Are the HIPAA privacy regulations followed in the study?

5. Discuss the setting and whether it was appropriate for the conduct of the study. Is the setting used in the study typical of clinical settings?

Measurements

1. Are the measurement strategies described by author, type, level of measurement, development, reliability and validity?

2. Do the instruments adequately measure the study variables?

3. Are the instruments sufficiently sensitive to detect differences between subjects?

4. Is the reliability of the instruments adequate for use in the study?

5. Is the validity of the instruments adequate for use in the study?

6. Do the instruments need further research to evaluate validity and reliability?

Answer the following, dependent on type of tools used in the critiqued study:

Scales and Questionnaires

7. Are the instruments clearly described?

8. Are the techniques to administer, complete, and score the instruments provided?

9. Are the reliability and validity of the instruments described? Did the researcher examine the reliability and validity of the instruments for the present sample?

10. If the instrument was developed for the study, is the instrument development process described?

Observation

11. Is what to be observed clearly identified and defined?

12. Are interrater and intrarater reliability described?

13. Are the techniques for recording observations described?

Interviews

14. Do the interview questions address concerns expressed in the research problem?

15. Are the interview questions relevant for the research purpose and objectives, questions, or hypotheses?

16. Does the design of the questions tend to bias subjects’ responses?

17. Does the sequence of questions tend to bias subjects’ responses?

Physiological Measures

18. Are the physiological measures or instruments clearly described?

19. Are the accuracy, precision, selectivity, and error of the physiological instruments discussed?

20. Are the methods for recording data from the physiological measures clearly described?

Data Collection

1. How were the study procedures implemented and data collected during the study? Is the data collection process clearly described? Is the training of data collectors clearly described and adequate?

2. Is the data collection process conducted in a consistent manner?

3. Are the data collection methods ethical?

4. Do the data collection methods address the research objectives, questions, or hypotheses?

Data Analyses

1. Are the data analysis procedures clearly described? Do the data analyses address each objective, question, or hypothesis?

2. What statistical analyses are included in the research report? Identify the analysis techniques used to describe the sample. Was the level of significance identified? Are the data analysis procedures appropriate to the type of data collected?

3. Are the results presented in an understandable way? Are tables and figures used to synthesize and emphasize certain findings?

4. Are the analyses interpreted appropriately?

5. If the results were nonsignificant, was the sample size sufficient to detect difference? Was a power analysis conducted to examine nonsignificant findings?

Interpretation of Findings

1. What is the researcher’s interpretation of findings? Are the results related to the study framework? If so, do the findings support the study framework? Are findings discussed in relation to each objective, question or hypotheses?

2. Which findings are consistent with those expected? Which findings are unexpected? Are significant and nonsignificant findings explained? Are the findings consistent with previous research findings?

3. Were the statistically significant findings also examined for clinical significance?

4. Does the interpretation of the findings appear biased? Are the biases in the study permitted?

5. Are there uncontrolled extraneous variables that may have influenced the findings?

6. Do the conclusions fit the results from the analyses? Are the conclusions based on statistically and clinically significant results?

7. How much confidence can be placed in the study findings?

8. What do the findings add to the current body of knowledge? Are the findings an accurate reflection of reality?

9. Did the researcher identify important study limitations?

10. How does the researcher generalize the findings? To what populations can the findings be generalized?

11. What implications do the findings have for nursing practice? Do any of the findings have potential for use in nursing practice?

12. What suggestions are made for further studies? What research questions emerge from the findings? Are these questions identified by the researcher?

13. Are there inconsistencies in the report? What are the missing elements of the study?

14. What is the overall quality of this study when the strengths and weaknesses are summarized? Could any of the weaknesses have been corrected?

15. Is the description of the study sufficiently clear to allow replication?