All Exams Test series for 1 year @ ₹349 only
Question

Let $b_1, b_2, \dots, b_{10} \sim i.i.d. N(0, \tau^2)$ and $\epsilon_{ij} \sim i.i.d. N(0, \sigma^2)$ for $i = 1, 2, \dots, 10; j = 1, 2, \dots, n$, independently of $b_1, b_2, \dots, b_{10}$. Define $X_{ij} = b_i + \epsilon_{ij}$. As an estimator of $\sigma^2$, the statistic 

$T_n = \frac{1}{10n} \sum_{i=1}^{10} \sum_{j=1}^n X_{ij}^2$ 

is

Analysis of the $T_n$ Estimator for $\sigma^2$

We are evaluating the statistic $T_n = \frac{1}{10n} \sum_{i=1}^{10} \sum_{j=1}^n X_{ij}^2$ as an estimator for $\sigma^2$. The model is given by $X_{ij} = b_i + \epsilon_{ij}$, where $b_i \sim i.i.d. N(0, \tau^2)$ and $\epsilon_{ij} \sim i.i.d. N(0, \sigma^2)$.

Unbiasedness of $T_n$

An estimator is unbiased if its expected value equals the parameter being estimated. We calculate $E[T_n]$.

First, let's find the expected value of $X_{ij}^2$:

  • Since $b_i \sim N(0, \tau^2)$, $E[b_i] = 0$ and $Var(b_i) = E[b_i^2] - (E[b_i])^2 = \tau^2$. Thus, $E[b_i^2] = \tau^2$.
  • Similarly, since $\epsilon_{ij} \sim N(0, \sigma^2)$, $E[\epsilon_{ij}] = 0$ and $Var(\epsilon_{ij}) = E[\epsilon_{ij}^2] - (E[\epsilon_{ij}])^2 = \sigma^2$. Thus, $E[\epsilon_{ij}^2] = \sigma^2$.
  • $X_{ij}^2 = (b_i + \epsilon_{ij})^2 = b_i^2 + 2b_i\epsilon_{ij} + \epsilon_{ij}^2$.
  • Because $b_i$ and $\epsilon_{ij}$ are independent and have zero mean, $E[2b_i\epsilon_{ij}] = 2E[b_i]E[\epsilon_{ij}] = 2(0)(0) = 0$.
  • Therefore, $E[X_{ij}^2] = E[b_i^2] + E[2b_i\epsilon_{ij}] + E[\epsilon_{ij}^2] = \tau^2 + 0 + \sigma^2 = \tau^2 + \sigma^2$.

Now, we compute the expected value of $T_n$:

$ E[T_n] = E\left[\frac{1}{10n} \sum_{i=1}^{10} \sum_{j=1}^n X_{ij}^2\right] $

By linearity of expectation:

$ E[T_n] = \frac{1}{10n} \sum_{i=1}^{10} \sum_{j=1}^n E[X_{ij}^2] = \frac{1}{10n} \sum_{i=1}^{10} \sum_{j=1}^n (\tau^2 + \sigma^2) $

The term $(\tau^2 + \sigma^2)$ is summed $10n$ times:

$ E[T_n] = \frac{1}{10n} (10n)(\tau^2 + \sigma^2) = \tau^2 + \sigma^2 $

For $T_n$ to be an unbiased estimator of $\sigma^2$, we need $E[T_n] = \sigma^2$. This requires $\tau^2 + \sigma^2 = \sigma^2$, which implies $\tau^2 = 0$. Thus, $T_n$ is unbiased only when $\tau^2 = 0$.

Consistency of $T_n$

An estimator is consistent if it converges in probability to the true parameter value as the sample size increases. We need to check if $T_n \xrightarrow{p} \sigma^2$ as $n \to \infty$.

We have established that $E[T_n] = \tau^2 + \sigma^2$. This expectation is constant with respect to $n$.

Using the Law of Large Numbers, the average of the $X_{ij}^2$ terms converges in probability to their mean. Since $T_n$ is the average of $10n$ such terms (appropriately weighted), it converges in probability to its expectation:

$ T_n \xrightarrow{p} E[T_n] = \tau^2 + \sigma^2 \quad \text{as } n \to \infty $

For $T_n$ to be a consistent estimator of $\sigma^2$, the limit must be $\sigma^2$. Therefore, we require $\tau^2 + \sigma^2 = \sigma^2$. This condition holds if and only if $\tau^2 = 0$. Thus, $T_n$ is consistent for $\sigma^2$ only when $\tau^2 = 0$.

Conclusion

The analysis shows that the estimator $T_n$ is unbiased for $\sigma^2$ if and only if $\tau^2 = 0$. Similarly, $T_n$ is consistent for $\sigma^2$ if and only if $\tau^2 = 0$. These findings match the conditions described in options C and D.

Was this answer helpful?

Important Questions from Best Linear Unbiased Estimators

  1. Consider the simple linear regression model $Y_i = \beta x_i + \epsilon_i, i = 1,2,..., n$, where $\beta > 0$, $\sum_{i=1}^n x_i^2 > 0$, and the uncorrelated errors $\epsilon_i, i = 1,2,..., n$, have zero mean and finite variance $\sigma^2 (> 0)$. Let $\tilde{\beta}_1 = \sum_{i=1}^n a_i^*Y_i$, where $a_i$'s minimize $E(\sum_{i=1}^n a_i Y_i - \beta)^2$ with respect to scalars $a_1, a_2,..., a_n$. Let $\tilde{\beta}_2$ be the ordinary least squares estimator of $\beta$. Which of the following statements are true?

  2. Consider the model $y_i = i\beta + \varepsilon_i, i = 1, 2, 3$ where $\varepsilon_1, \varepsilon_2, \varepsilon_3$ are independent with mean $0$ and variance $\sigma^2, 2\sigma^2, 3\sigma^2$ respectively. Which of the following is the best linear unbiased estimate of $\beta$?

  3. Consider the linear model $Y \sim N_n(X\beta, \sigma^2 I)$, where $X$ is a $n \times (k + 1)$ matrix of rank $k + 1 < n$. Let $\hat{\beta}$ and $\hat{\sigma}^2$ be the maximum likelihood estimators of $\beta$ and $\sigma^2$ respectively. Then which of the following statements are true?

  4. Let $X_1, X_2, \ldots, X_n$ be a random sample from $f_\theta(x)$, a probability density function or a probability mass function. Define $s_n^2 = \frac{1}{n-1} \sum_{i=1}^n (X_i - \bar{X}_n)^2$, where $\bar{X}_n = \frac{1}{n} \sum_{i=1}^n X_i$. Then $s_n^2$ is unbiased for $\theta$ if
  5. Let $\{X_n\}$ be a sequence of independent random variables where the distribution of $X_n$ is normal with mean $\mu$ and variance $n$ for $n = 1, 2, \ldots$ Define 

    $\bar{X}_n = \frac{\sum_{i=1}^n X_i}{n}$ and $S_n = \frac{\sum_{i=1}^n \frac{X_i}{i}}{\sum_{i=1}^n \frac{1}{i}}$. 

    Which of the following are true?

Need Expert Advice?

Start Your Preparation with Prepp Mobile App

Download the app from Google Play & App Store
Download the app from Google Play & App Store
Prepp Mobile App