All Exams Test series for 1 year @ ₹349 only
Question

Given below are two statements, one labelled as Assertion (A) and the other labelled as Reason (R). Read the statements and choose the correct answer using the code given below.

Assertion (A): Homogenous tests have low reliability.

Reason (R): The range of test scores affects reliability.

The correct answer is

Both (A) and (R) are true, but (R) is not the correct explanation of (A).

Understanding the Assertion and Reason on Test Reliability

This question asks us to analyze two statements regarding test reliability: an Assertion (A) about homogenous tests and a Reason (R) about the effect of the range of test scores.

We need to determine if each statement is true and if the Reason correctly explains the Assertion.

Analyzing Assertion (A): Homogeneous Tests and Reliability

Assertion (A) states: Homogenous tests have low reliability.

A homogeneous test is one where all items measure a single construct or trait. For example, a test measuring only mathematical computation skills is homogeneous if all items focus purely on computation.

Typically, if items in a test are highly homogeneous and measure the same construct consistently, they should correlate well with each other. This usually leads to high internal consistency reliability (e.g., high Cronbach's alpha). Therefore, the statement that homogeneous tests have low reliability appears counter to standard psychometric principles where homogeneity is often associated with *higher* internal consistency.

However, following the premise of the provided correct answer which indicates Assertion (A) is true, let's consider scenarios where a highly homogeneous test might exhibit lower reliability than expected:

  • If items are excessively redundant, participants might become fatigued or bored, leading to inconsistent effort and lower scores on later items, impacting reliability.
  • If the items are too easy or too difficult for the target population, reducing score variability, which can affect reliability estimation methods sensitive to variance (though Reason (R) addresses range/variance more directly).
  • Certain types of reliability, like test-retest reliability, could be affected if the specific, narrow skill measured by the homogeneous test is highly susceptible to temporary factors (like practice effects or mood) that vary over time, causing scores to fluctuate.

Accepting the premise that (A) is true for the purpose of answering this question, we proceed.

Analyzing Reason (R): Range of Test Scores Affecting Reliability

Reason (R) states: The range of test scores affects reliability.

This statement is a fundamental principle in psychometrics. Reliability estimates (like correlation coefficients used in test-retest, parallel forms, or split-half reliability) are influenced by the variability of scores in the sample taking the test.

  • A wider range of test scores (high variance) means individuals in the sample are more spread out along the measured trait. This allows for better discrimination between individuals and generally leads to higher correlation coefficients between test halves, parallel forms, or administrations, thus yielding a higher reliability estimate.
  • Conversely, a restricted range of test scores (low variance) means individuals are clustered closely together. It becomes harder to consistently differentiate between individuals, leading to lower correlation coefficients and consequently lower reliability estimates.

Statistically, reliability is often related to the ratio of true score variance to observed score variance. A restricted range limits the observed score variance ($\sigma^2_{observed}$), making the impact of error variance ($\sigma^2_{error}$) relatively larger, thus lowering the reliability coefficient ($reliability = 1 - \frac{\sigma^2_{error}}{\sigma^2_{observed}}$).

Therefore, Reason (R) is true; the range (or variance) of test scores significantly affects reliability estimates.

Connecting Assertion (A) and Reason (R)

We have analyzed Assertion (A) (assuming it is true per the question's context) and found Reason (R) to be true based on psychometric principles.

Now we consider if (R) is the correct explanation for (A). Assertion (A) claims homogeneous tests have low reliability (for reasons we explored, such as item redundancy effects or susceptibility to temporary states). Reason (R) explains that the range of scores impacts the *estimation* of reliability.

While both statements relate to test reliability, the range of scores is a statistical characteristic of the *sample's performance* on the test, affecting how reliably we can measure differences. The reason for a homogeneous test having potentially low reliability (as assumed in A) is generally attributed to aspects of the test's *internal structure* or how that structure interacts with administration conditions or test-taker characteristics (like fatigue from repetitive items).

The range of scores doesn't explain *why* a homogeneous test's structure or content leads to inconsistency; it explains how existing inconsistency (or consistency) is reflected in the reliability coefficient given the distribution of scores in the sample. Therefore, the range of scores affecting reliability (R) is not the reason *why* a homogeneous test might have low reliability (A).

Conclusion: Evaluating the Relationship

Based on the provided correct answer which indicates that both statements are true, but Reason (R) is not the correct explanation for Assertion (A):

  • Assertion (A): Homogenous tests have low reliability. (Accepted as true as per the question's premise)
  • Reason (R): The range of test scores affects reliability. (True)
  • Relationship: The effect of score range on reliability estimation (R) does not explain potential reasons for low reliability specifically in homogeneous tests (A).

Thus, both statements are true, but Reason (R) is not the correct explanation of Assertion (A).

Statement Truth Value (based on question's premise) Explanation
Assertion (A): Homogenous tests have low reliability. True Assuming this premise; potential reasons could include item redundancy leading to fatigue, or susceptibility to temporary factors affecting consistency.
Reason (R): The range of test scores affects reliability. True Wider score range (higher variance) leads to better reliability estimates; restricted range leads to lower estimates.
Is (R) the correct explanation of (A)? No (R) describes a statistical factor affecting reliability estimation, not the inherent reason why a homogeneous test might exhibit low reliability as asserted in (A).

Revision Table: Key Reliability Concepts

Concept Definition Factors Affecting It
Test Reliability The consistency of test scores over time, across different forms of the test, or across items within the test. Test length, homogeneity of items, test administration conditions, variability of scores in the sample, presence of error variance.
Homogeneous Test A test where all items measure a single, unified construct or trait. Item content, factor structure.
Score Range/Variance The spread or variability of scores in the distribution. Characteristics of the sample taking the test, difficulty level of the test relative to the sample's ability.

Additional Information on Psychometric Reliability Factors

Understanding test reliability involves considering various factors:

  • Test Length: Generally, longer tests with more items tend to be more reliable than shorter ones, assuming the added items are of similar quality and measure the same construct. The Spearman-Brown prophecy formula quantifies this.
  • Item Quality: Clear, well-written items that are neither too easy nor too difficult and effectively discriminate between individuals contribute to higher reliability.
  • Test Administration: Consistent and standardized administration procedures minimize error variance related to environmental factors, instructions, or timing.
  • Test-Taker Factors: Temporary states like fatigue, anxiety, motivation, or health can introduce random error, affecting the consistency of scores.
  • Scoring Objectivity: Objective scoring methods reduce error variance introduced by scorer judgment or bias.

The relationship between score range and reliability is particularly important when interpreting reliability coefficients from different samples. A test might be highly reliable for a diverse group but appear less reliable when administered to a very homogeneous group in terms of the trait being measured, even if the test itself hasn't changed.

Was this answer helpful?

Important Questions from Measurement and Analysis of Data - Teaching

  1. Given below are two statements

    Statement I: The qualitative data are powerful because they are collected from very sensitive social, historical and temporal context.

    Statement II: Context sensitivity cannot be completely removed from the qualitative data.

    In light of the above statements, choose the correct answer from the options given below

  2. Given below is a summary of ANOVA for four groups of students tested in a research project:

    Source of varianceSS (Sum of squares)df (Degree of freedom)MS (Mean sum of squares)
    Between groups76323.33
    Within groups122167.62

    What will be the value of 'F' for the above data?

  3. An investigator used ANOVA to compare four groups of students on numerical ability on the basis of a test. After analysis of raw scores, the following results were obtained:

    Source of variationdfSum of Squares
    Between Groups3625.00
    Within Groups362128.00

    The value of F-ratio would be approximate:

  4. In randomly constituted two groups-experimental and control, a researcher obtains the following results after using a parametric 't' test:

    Value of t = 3 for N = 300

    On the basis of this evidence which decision in respect of substantive research hypothesis and the null hypothesis will be justified?

  5. An investigator commits Type I error in testing hypothesis when he / she

Need Expert Advice?

Start Your Preparation with Prepp Mobile App

Download the app from Google Play & App Store
Download the app from Google Play & App Store
Prepp Mobile App