Let $b_1, b_2, \dots, b_{10} \sim i.i.d. N(0, \tau^2)$ and $\epsilon_{ij} \sim i.i.d. N(0, \sigma^2)$ for $i = 1, 2, \dots, 10; j = 1, 2, \dots, n$, independently of $b_1, b_2, \dots, b_{10}$. Define $X_{ij} = b_i + \epsilon_{ij}$. As an estimator of $\sigma^2$, the statistic $T_n = \frac{1}{10n} \sum_{i=1}^{10} \sum_{j=1}^n X_{ij}^2$ is
We are evaluating the statistic $T_n = \frac{1}{10n} \sum_{i=1}^{10} \sum_{j=1}^n X_{ij}^2$ as an estimator for $\sigma^2$. The model is given by $X_{ij} = b_i + \epsilon_{ij}$, where $b_i \sim i.i.d. N(0, \tau^2)$ and $\epsilon_{ij} \sim i.i.d. N(0, \sigma^2)$.
An estimator is unbiased if its expected value equals the parameter being estimated. We calculate $E[T_n]$.
First, let's find the expected value of $X_{ij}^2$:
Now, we compute the expected value of $T_n$:
$ E[T_n] = E\left[\frac{1}{10n} \sum_{i=1}^{10} \sum_{j=1}^n X_{ij}^2\right] $
By linearity of expectation:
$ E[T_n] = \frac{1}{10n} \sum_{i=1}^{10} \sum_{j=1}^n E[X_{ij}^2] = \frac{1}{10n} \sum_{i=1}^{10} \sum_{j=1}^n (\tau^2 + \sigma^2) $
The term $(\tau^2 + \sigma^2)$ is summed $10n$ times:
$ E[T_n] = \frac{1}{10n} (10n)(\tau^2 + \sigma^2) = \tau^2 + \sigma^2 $
For $T_n$ to be an unbiased estimator of $\sigma^2$, we need $E[T_n] = \sigma^2$. This requires $\tau^2 + \sigma^2 = \sigma^2$, which implies $\tau^2 = 0$. Thus, $T_n$ is unbiased only when $\tau^2 = 0$.
An estimator is consistent if it converges in probability to the true parameter value as the sample size increases. We need to check if $T_n \xrightarrow{p} \sigma^2$ as $n \to \infty$.
We have established that $E[T_n] = \tau^2 + \sigma^2$. This expectation is constant with respect to $n$.
Using the Law of Large Numbers, the average of the $X_{ij}^2$ terms converges in probability to their mean. Since $T_n$ is the average of $10n$ such terms (appropriately weighted), it converges in probability to its expectation:
$ T_n \xrightarrow{p} E[T_n] = \tau^2 + \sigma^2 \quad \text{as } n \to \infty $
For $T_n$ to be a consistent estimator of $\sigma^2$, the limit must be $\sigma^2$. Therefore, we require $\tau^2 + \sigma^2 = \sigma^2$. This condition holds if and only if $\tau^2 = 0$. Thus, $T_n$ is consistent for $\sigma^2$ only when $\tau^2 = 0$.
The analysis shows that the estimator $T_n$ is unbiased for $\sigma^2$ if and only if $\tau^2 = 0$. Similarly, $T_n$ is consistent for $\sigma^2$ if and only if $\tau^2 = 0$. These findings match the conditions described in options C and D.
Consider the simple linear regression model $Y_i = \beta x_i + \epsilon_i, i = 1,2,..., n$, where $\beta > 0$, $\sum_{i=1}^n x_i^2 > 0$, and the uncorrelated errors $\epsilon_i, i = 1,2,..., n$, have zero mean and finite variance $\sigma^2 (> 0)$. Let $\tilde{\beta}_1 = \sum_{i=1}^n a_i^*Y_i$, where $a_i$'s minimize $E(\sum_{i=1}^n a_i Y_i - \beta)^2$ with respect to scalars $a_1, a_2,..., a_n$. Let $\tilde{\beta}_2$ be the ordinary least squares estimator of $\beta$. Which of the following statements are true?
Consider the model $y_i = i\beta + \varepsilon_i, i = 1, 2, 3$ where $\varepsilon_1, \varepsilon_2, \varepsilon_3$ are independent with mean $0$ and variance $\sigma^2, 2\sigma^2, 3\sigma^2$ respectively. Which of the following is the best linear unbiased estimate of $\beta$?
Consider the linear model $Y \sim N_n(X\beta, \sigma^2 I)$, where $X$ is a $n \times (k + 1)$ matrix of rank $k + 1 < n$. Let $\hat{\beta}$ and $\hat{\sigma}^2$ be the maximum likelihood estimators of $\beta$ and $\sigma^2$ respectively. Then which of the following statements are true?
Let $\{X_n\}$ be a sequence of independent random variables where the distribution of $X_n$ is normal with mean $\mu$ and variance $n$ for $n = 1, 2, \ldots$ Define
$\bar{X}_n = \frac{\sum_{i=1}^n X_i}{n}$ and $S_n = \frac{\sum_{i=1}^n \frac{X_i}{i}}{\sum_{i=1}^n \frac{1}{i}}$.
Which of the following are true?