Psychology Questions

Researchers conducted two studies on the reliability of the Wisconsin Card Sorting Test (WCST) using adult psychiatric inpatients. In these studies, more than one person scored the WCST independently. What kind of reliability/precision were the researchers interested in establishing?-Test-retest reliability-Scorer reliability-Split-half reliability-Internal consistency

Which type of test would yield more reliable scores- a classroom test or a standardized achievement test?

When using the split-half method, an adjustment must be made to compensate for splitting the test into halves. Which one of the following would we use to make this adjustment?-Coefficient alpha-Pearson product-moment correlation-Spearman-Brown formula-KR-20

Katie and Kathy are roommates who share the same bathroom scale. Neither Katie nor Kathy is on a special diet to lose or gain weight. Each morning, they both weigh themselves. From day to day, it seems that each gains or loses two to three pounds. Some days Katie gains three pounds and Kathy loses two pounds. Other days Katie loses two pounds and Kathy gains three pounds. Every day their weights are different from their weights the previous day, and they cannot distinguish a pattern. Katie and Kathy decide to start weighing themselves on a scale at the wellness center. To their surprise, they neither gain nor lose weight from time to time when using the scale at the wellness center. Which one of the following best explains this situation?A. Their home scale has systematic error, and the wellness center scale is more accurate.B. Their home scale has random error, and the wellness center scale is more accurate.C. The scale at the wellness center has systematic error, and their home scale is accurate.D. The scale at the wellness center has random error, and their home scale is accurate.

When test reliability is high, the standard error of measurement is _______. As test reliability decreases, the standard error of measurement _________.•high; decreases•low; decreases•high; increases•low; increases

Which one of the following is the appropriate method for estimating reliability for tests with homogeneous questions that have more than two possible responses?-Coefficient alpha/ Cohens D-Pearson product-moment correlation-Spearman-Brown formula-KR-20

While ________ describes the degree to which questions on a test or subscale are interrelated, ________ refers to whether the questions measure the same trait or dimension.-homogeneity; coefficient alpha-coefficient alpha; homogeneity-heterogeneity; coefficient alpha-homogeneity; test-retest reliability

Marsha, a student teacher, wanted to check the reliability of a math test that she developed for her fourth graders. She gave the test to students on Monday morning and then again on Tuesday morning. On the first administration of her test, there was a wide variety of scores, but on the second administration, nearly all of the children made A's on the test. Marsha wondered, "Why did all the students make A's on Tuesday, but not on Monday?" Which one of the following would most likely account for this outcome?-Order effects-Practice effects-Measurement errorScorer error

What makes Item Response Theory different from classical theory?A : It is a family of theories of methods used to develop instruments.B : Traditional forms of calculating reliability are appropriate.C : The constructs being measured are observable.D : The focus of IRT is on error rates.

Jennifer took an aptitude test and is interested in whether the score on the verbal aptitude subscale is significantly higher than her mathematical aptitude subscale score. What statistic would you be interested in to answer her question?A : Standard error of differenceB : Standard error of estimateC : Standard error of measurementD : Standard deviation

When is name of the meta-analytic method, developed by Vacha-Haase (1998), that explores variability in reliability estimates across studies?A : Universal reliabilityB : Cross-validation reliabilityC : Generalizability estimationD : Reliability generalization

What is the most appropriate way to determine reliability with Likert scales, where different answers receive different weightings?A : Test-retestB : Spearman-BrownC : Kuder-Richardson 20D : Coefficient alpha (or Cronbachs Alpha)

If the reliability coefficient of an instrument is .91, and the standard deviation is 10, then a clients score of 59 could be interpreted that 95 percent of the time his/her true score will fall between _____ and _____ using standard error of measurementA : 56; 62B : 53; 65C : 49; 69D : -3.00; 3.00

As the reliability of an instrument increases, the standard error of measurement _______.A : decreasesB : increasesC : could either increase or decreaseD : is unaffected

The decision to use either the Kuder-Richardson 20 (KR 20) or the Kuder-Richardson 21 (KR 21) is based on whether:A : the method used to determine reliability is the test-retest or the alternate form method.B : correlation or regression is going to be used.C : the items measure a homogeneous or heterogeneous behavior domain.D : the item format is multiple-choice or true-false.

In evaluating an instruments reliability, a counselor should:A : always select the instrument with the highest reliability coefficients.B : select instruments where coefficient alphas have been calculated.C : consider how the instrument is going to be used.D : never use an instrument where the reliability coefficient is less than 0.92.

In generalizability or domain sampling theory, the focus is on:A : using measures of internal consistency.B : determining the standard error of measurement.C : identifying specific sources of variation under defined conditions.D : identifying where an individuals true score would fall.

When calculating correlations, the most common method used is the:A : Pearson-Product Moment Correlation Coefficient.B : Correlation Coefficient of Most Common Factors.C : Reliability Coefficient of Correlation.D : Reliability Correlation Coefficient.

According to the Standards for Educational and Psychological Testing, which statistic should be used for the interpretation of group test scores?A : Standard error of measurementB : Correlation coefficientC : Cronbachs alphaD : Standard error of the group means

Standard error of measurement is designed to:A : tell the clinician if an instrument is reliable.B : provide an estimate of the probable range of scores for an individual.C : indicate the percentage of error in the reliability coefficient.D : determine the statistical significance of the reliability coefficient.