Homework answers / question archive / 1) A) How many observations were made in each phase of the experiment? Were they sufficient to establish a stable pattern of responding? B) What was the independent variable? Was it a direct intervention specifically designed as part of the study? C) Were the target behaviors representative of problems of long duration that were unlikely to change without direct intervention? 2) A) Was the survey descriptive, cross-sectional, or longitudinal? How did this design feature influence the interpretation of the results? B) What was (were) the dependent variable(s)? How was (were) it (they) operationally defined? Was (were) the dependent variable(s) operationally defined in terms of measures of objective data that could be counted with a high degree of accuracy and reliability? 3) A) If the survey instrument was translated into another language, what type of translation process was used? What kind of assurance do you have that the two forms were conceptually equivalent and culturally appropriate? How was accommodation made for language differences based on country of origin, geographic region, and education level of the respondents? B) What sampling strategy was used? Was it appropriate to reach adequate numbers of underrepresented groups (such as ethnic minorities or low-incidence disability groups)? 4) A) If interviews were used, were interviewers trained? What method was used to record the answers? Was it possible or desirable to “blind” the interviewers to an “experimental” condition? B) How did the surveyors handle differences between themselves and respondents in terms of gender, race or ethnicity, socioeconomic status, or disability? What consideration was given to interviewer effects? 5) A) Were any other response-pattern biases evident, such as question-order effects, response-order effects, acquiescence, no-opinion filter effects, or status quo alternative effects? B) What was the response rate? Was a follow-up done with nonrespondents? How did the respondents compare with the nonrespondents? C) Who answered the questions? Was it the person who experienced the phenomenon in question? Was it a proxy? How adequate were the proxies? 6) A) What is the reliability of the criterion variable (compared with the test used to make the prediction)? Is there a restricted range for the criterion variable? B) Were the results cross-validated with a separate, independent sample? C) Examine the wording of the questions

1) A) How many observations were made in each phase of the experiment? Were they sufficient to establish a stable pattern of responding? B) What was the independent variable? Was it a direct intervention specifically designed as part of the study? C) Were the target behaviors representative of problems of long duration that were unlikely to change without direct intervention? 2) A) Was the survey descriptive, cross-sectional, or longitudinal? How did this design feature influence the interpretation of the results? B) What was (were) the dependent variable(s)? How was (were) it (they) operationally defined? Was (were) the dependent variable(s) operationally defined in terms of measures of objective data that could be counted with a high degree of accuracy and reliability? 3) A) If the survey instrument was translated into another language, what type of translation process was used? What kind of assurance do you have that the two forms were conceptually equivalent and culturally appropriate? How was accommodation made for language differences based on country of origin, geographic region, and education level of the respondents? B) What sampling strategy was used? Was it appropriate to reach adequate numbers of underrepresented groups (such as ethnic minorities or low-incidence disability groups)? 4) A) If interviews were used, were interviewers trained? What method was used to record the answers? Was it possible or desirable to “blind” the interviewers to an “experimental” condition? B) How did the surveyors handle differences between themselves and respondents in terms of gender, race or ethnicity, socioeconomic status, or disability? What consideration was given to interviewer effects? 5) A) Were any other response-pattern biases evident, such as question-order effects, response-order effects, acquiescence, no-opinion filter effects, or status quo alternative effects? B) What was the response rate? Was a follow-up done with nonrespondents? How did the respondents compare with the nonrespondents? C) Who answered the questions? Was it the person who experienced the phenomenon in question? Was it a proxy? How adequate were the proxies? 6) A) What is the reliability of the criterion variable (compared with the test used to make the prediction)? Is there a restricted range for the criterion variable? B) Were the results cross-validated with a separate, independent sample? C) Examine the wording of the questions

Statistics

Share With

1) A) How many observations were made in each phase of the experiment? Were they sufficient to establish a stable pattern of responding? B) What was the independent variable? Was it a direct intervention specifically designed as part of the study? C) Were the target behaviors representative of problems of long duration that were unlikely to change without direct intervention?

2) A) Was the survey descriptive, cross-sectional, or longitudinal? How did this design feature influence the interpretation of the results? B) What was (were) the dependent variable(s)? How was (were) it (they) operationally defined? Was (were) the dependent variable(s) operationally defined in terms of measures of objective data that could be counted with a high degree of accuracy and reliability?

3) A) If the survey instrument was translated into another language, what type of translation process was used? What kind of assurance do you have that the two forms were conceptually equivalent and culturally appropriate? How was accommodation made for language differences based on country of origin, geographic region, and education level of the respondents? B) What sampling strategy was used? Was it appropriate to reach adequate numbers of underrepresented groups (such as ethnic minorities or low-incidence disability groups)?

4) A) If interviews were used, were interviewers trained? What method was used to record the answers? Was it possible or desirable to “blind” the interviewers to an “experimental” condition? B) How did the surveyors handle differences between themselves and respondents in terms of gender, race or ethnicity, socioeconomic status, or disability? What consideration was given to interviewer effects?

5) A) Were any other response-pattern biases evident, such as question-order effects, response-order effects, acquiescence, no-opinion filter effects, or status quo alternative effects? B) What was the response rate? Was a follow-up done with nonrespondents? How did the respondents compare with the nonrespondents? C) Who answered the questions? Was it the person who experienced the phenomenon in question? Was it a proxy? How adequate were the proxies?

6) A) What is the reliability of the criterion variable (compared with the test used to make the prediction)? Is there a restricted range for the criterion variable? B) Were the results cross-validated with a separate, independent sample? C) Examine the wording of the questions. Could the way questions are worded lead to bias because they are leading? D) Because surveys are based on self-reports, be aware that bias can result from omissions or distortions. This can occur because of a lack of sufficient information or because the questions are sensitive. Could self-report result in bias in this study?