All Exams Test series for 1 year @ ₹349 only
Question

Let $X_1, X_2, . . ., X_n$ be a random sample from $N(\theta, 1)$, $\theta \in R$. If $\hat{\theta}$ is the Bayes estimator of $\theta$ with respect to some prior $\pi(\theta)$ and loss function $L(\theta, d)$. Then, which of the following statements are true?

To solve this problem, we need to determine which of the provided statements are correct concerning the Bayes estimator of the parameter \(\theta\) from a normal distribution sample \(N(\theta, 1)\). Let's analyze each statement one by one.

  1. Statement 1: \(\hat{\theta} = \frac{\sum_{i=1}^n X_i}{n + \tau^2}\), if the prior is \(N(0, \frac{1}{\tau^2})\), \(\tau^2\) known and \(L(\theta, d) = (\theta – d)^2\)
    • This statement refers to the Bayes estimator under the squared error loss function. When we have a normal prior \(N(0, \frac{1}{\tau^2})\) and a sample from \(N(\theta, 1)\), the Bayes estimator is given by a weighted average of the sample mean and the prior mean. The formula is indeed correct because it considers the sample information and the prior information balanced by their variances.
    • Thus, Statement 1 is correct.
  2. Statement 2: \(\hat{\theta} = \frac{\sum_{i=1}^n X_i}{n + \tau^2}\), if the prior is \(N(0, \tau^2)\), \(\tau^2\) known and \(L(\theta, d) = |\theta – d|\)
    • This statement changes the loss function to an absolute deviation. However, the given estimator does not correspond to the minimizer of the expected absolute error loss in Bayesian analysis.
    • Therefore, Statement 2 is incorrect.
  3. Statement 3: \(\hat{\theta} = \frac{\sum_{i=1}^n X_i}{\,n + \frac{1}{\tau^{2}}}\), if the prior is \(N(0, \frac{1}{\tau^2})\), \(\tau^2\) known and \(L(\theta, d) = |\theta – d|\)
    • Similar to Statement 2, this also involves an absolute error loss function, which is not compatible with the stated estimator for this prior configuration. The correct form for an absolute error loss differs conceptually from the squared error loss.
    • Thus, Statement 3 is also incorrect.
  4. Statement 4: \(\hat{\theta} =\frac{\sum_{i=1}^n X_i}{n}\), if the prior is the Jeffreys prior and \(L(\theta, d) = (\theta – d)^2\)
    • Jeffreys prior is often used to represent non-informative priors. In this case, the Bayes estimator under the squared error loss function corresponds to the sample mean itself when the variance is known.
    • Hence, Statement 4 is indeed accurate under these conditions.

Based on the above analysis, the correct statements are:

  • \(\hat{\theta} = \frac{\sum_{i=1}^n X_i}{n + \tau^2}\), if the prior is \(N(0, \frac{1}{\tau^2})\), \(\tau^2\) known and \(L(\theta, d) = (\theta – d)^2\)
  • \(\hat{\theta} = \frac{\sum_{i=1}^n X_i}{n}\), if the prior is the Jeffreys prior and \(L(\theta, d) = (\theta – d)^2\)
Was this answer helpful?

Important Questions from Elementary Bayesian Inference

  1. Let $X|\theta \sim \text{Uniform}[0, \theta]$ and $\theta$ has an Exponential distribution with mean $\lambda$, where $\lambda > 3$ is known. If the realized value of $X$ is $2025$, then the posterior mode equals
  2. Let $X_1, X_2, \dots, X_7$ be a random sample from $N(\mu, \sigma^2)$ where $\mu$ and $\sigma^2$ are unknown. Consider the problem of testing $H_0: \mu = 2$ against $H_1: \mu > 2$. Suppose the observed values of $x_1, x_2, \dots, x_7$ are $1.2, 1.3, 1.7, 1.8, 2.1, 2.3, 2.7$. If we use the Uniformly Most Powerful test, which of the following is true?

  3. Suppose $X_i \mid \theta_i \sim N(\theta_i, \sigma^2), i = 1, 2$ are independently distributed. Under the prior distribution, $\theta_1$ and $\theta_2$ are i.i.d $N(\mu, \tau^2)$, where $\sigma^2, \mu$ and $\tau^2$ are known. Then which of the following is true about the marginal distributions of $X_1$ and $X_2$?

  4. Let $(X,Y)$ have the joint discrete distribution such that $X \mid Y=y \sim \text{Binomial} \quad (y, 0.5)$ and $Y \sim \text{Poisson}(\lambda), \lambda > 0$, where $\lambda$ is an unknown parameter. Let $T = T(X,Y)$ be any unbiased estimator of $\lambda$. Then

  5. Consider the pdf
    $f(x;\theta,\sigma) = \frac{0.9}{\sigma}\phi\left(\frac{x-\theta}{\sigma}\right) + 0.1\ \phi(x-\theta)$, where $-\infty < \theta < \infty$ and $\sigma > 0$ are unknown parameters and $\phi$ denotes the pdf of $N(0,1)$. Let $X_1, X_2, \cdots, X_n$ be a random sample from this probability distribution. Then which of the following is (are) correct?

Need Expert Advice?

Start Your Preparation with Prepp Mobile App

Download the app from Google Play & App Store
Download the app from Google Play & App Store
Prepp Mobile App