EXSC 525 – Research Methods in Exercise Science (QUIZ META-ANALYSIS AND SURVEY RESEARCH) Liberty Uni

EXSC 525 – Research Methods in Exercise Science (QUIZ META-ANALYSIS AND SURVEY RESEARCH) Liberty University Question 1 5 / 5 pts In a meta-analysis, the ES for the experimental versus control groups was 0.68, which represents a percentile equivalent of 75. This means that

the control group's average performance was 68 out of 100 compared with 75 out of 100 for the experimental group

the average score of the experimental group was better than 75% of the control group's scores

the probability is 75% that the use of the experimental treatment will improve the average student's score from the 50th to the 68th percentile

the control group's mean was only 75% as high as that of the experimental group

Question 2 5 / 5 pts The fact that a meta-analysis quantifies findings from many studies is a frequently mentioned advantage.

Another strong advantage of the meta-analysis over the normal review paper is

the use of the computer in the literature search

the description of the coding of study characteristics and the criteria for excluding studies

the inclusion of theses and dissertations as well as journals

the use of the "scorecard" count of the number of studies that share common findings (such as those that found statistically significant differences)

Question 3 5 / 5 pts A researcher tests the knowledge that 10,000 school children from the southwestern United States have about nutrition, and the scores are transformed into percentiles by grade level. This type of research is a survey study.

normative

developmental

correlational

longitudinal

multiple-case

Question 4 5 / 5 pts Choose the correct sequence for developing a questionnaire.

determining objectives, delimiting the sample, writing items, pilot testing

pilot testing, determining objectives, writing cover letter, writing items

delimiting the sample, pilot testing, determining objectives, writing items

delimiting the sample, determining objectives, writing items, pilot testing

Question 5 5 / 5 pts It is common when looking at a distribution to encounter extreme or unusual scores that could have a misleading effect on the results. These extreme scores are termed

residuals

outliers

curve busters

deviants

IncorrectQuestion 6 0 / 5 pts To help ensure an acceptable return rate in a questionnaire study, the researcher should

make liberal use of open-ended questions

use follow-up letters or e-mails

enclose or attach another copy of the survey

b and c only

a, b, and c

Question 7 5 / 5 pts In a meta-analysis, the results of various studies on a topic are quantified using a standard measure (ES) that is called

error squared

estimate of significance

effect size

efficiency standard

Question 8 5 / 5 pts When a national poll reports that its survey has a margin of error of 3%, it is referring to error due to

sampling

respondents not understanding questions

misinterpreting the results

recording the response

Question 9 5 / 5 pts A major difference in the purpose of a meta-analysis and a review of literature for a research paper is that the meta-analysis uses the literature

for empirical and theoretical conclusions

to document a need for a particular study

to determine what methods to use to conduct the meta-analysis

to formulate the research hypothesis for the meta-analysis

Question 10 5 / 5 pts A survey technique that asks a jury of experts to respond to a series of questionnaires in order to reach a consensus about important issues is the

normative survey method

obtrusive survey method

roundtable survey method

Delphi survey method

Question 11 5 / 5 pts Consider the following questionnaire item (which uses a yes/no format): "Do you use objective test items or essay items?" What rule regarding item construction does it violate?

Avoid using negative items.

Do not lead the respondent to answer in a certain way.

Do not use items that have two or more separate ideas in the same item.

Short questions are easier to understand.

Question 12 5 / 5 pts The practice of selecting a small random sample of a survey's nonrespondents is primarily intended to

try to raise the percentage of returns to at least 50%

identify outliers

determine whether the nonrespondents are a different population from the respondents

ensure anonymity of responses

Question 13 5 / 5 pts In a meta-analysis, the researcher found that the mean for the experimental group in a study was 14, and the mean for the control group was 10. The standard deviation of the control group was 5. Based on these data, what is the ES?

5.0

4.0

0.80

0.50

0.20

Question 14 5 / 5 pts Which of the following are most difficult to analyze in a questionnaire study?

open-ended items

yes/no items

Likert-type items

semantic differential items

Question 15 5 / 5 pts The first step in conducting a questionnaire survey is to

select the sample

list specific objectives to be achieved

construct the questionnaire items

write the cover letter

Question 16 5 / 5 pts In calculating ES for a treatment effect between a pretest and a posttest, the text recommends the use of which standard deviation?

the pretest standard deviation

the posttest standard deviation

the pooled standard deviation

Question 17 5 / 5 pts The most frequent and severe criticism of meta-analysis is that

the number of studies involved is generally too small

the sources used in the literature search are not identified

meta-analysis does not allow the use of dissertations and theses

the studies represent wide differences in methodologies, designs, and measurements

Question 18 5 / 5 pts Scaled responses to questionnaire items such as strongly agree, agree, no opinion, and so on are referred to as scale items.

Gulick

Likert-type

semantic differential

Binet

Question 19 5 / 5 pts The inclusion criteria in a meta-analysis are very much like

delimitations

limitations

basic assumptions

research hypotheses

Question 20 5 / 5 pts

In a meta-analysis of 100 studies that compared boys' and girls' knowledge of performance enhancing substances, an average ES of 0.50 was found. This number represents

a correlation of 0.50

a mean square (variance) of 0.50

a t ratio of 0.50

a difference of 0.50 standard deviation units

Question 21 10 / 10 pts In a paragraph or two, explain the purpose and procedures of a meta-analysis to someone who has never heard of the research technique (10pts).

Your Answer: Meta-analysis is a technique developed by Glass, McGaw and Smith (1981) in an attempt to solve the issues associated with literature reviews. The issue was most literature reviews, was that the authors systematic method remained unknown to the reader, which impeded the readers ability to have an objective evaluation of the decision(s). Also, it allows the use of statistical techniques as a means of analysis, and a definitive methodology is reported concerning the decisions in a literature analysis, these are two steps that are lacking in the typical literature review.

The meta-analysis allows the reader to *Identify the problem *Perform a literature search by specified means *Review identified studies to determine inclusion or exclusion

*Carefully read and evaluate, to identify and code important study characteristics *Calculate effect size *Apply appropriate statistical techniques *Report all these steps and the outcomes in a review paper

Question 22 7 / 10 pts Contrast the electronic questionnaire with the personal interview in terms of advantages or disadvantages in sampling, validity of responses, and administrative considerations (time, expense, helpers) (10pts).

Your Answer: The electronic questionnaire samples are answered in writing, whereas interviews are oral. Electronic are generally for geographically dispersed samples, where as interviews the samples behavior can be observed. Electronic responses can get expensive with the initial mailing, ( if paper mailed postage can get expensive) where as interviews cost is much less