All Exams Test series for 1 year @ ₹349 only
Question

Let $(X,Y)$ have the joint discrete distribution such that $X \mid Y=y \sim \text{Binomial} \quad (y, 0.5)$ and $Y \sim \text{Poisson}(\lambda), \lambda > 0$, where $\lambda$ is an unknown parameter. Let $T = T(X,Y)$ be any unbiased estimator of $\lambda$. Then

Distribution Analysis

We are given a joint discrete distribution concerning random variables $(X,Y)$. The properties provided are:

  • The conditional distribution of $X$ given $Y=y$ follows a Binomial distribution: $X \mid Y=y \sim \text{Binomial} (y, 0.5)$.
  • The marginal distribution of $Y$ follows a Poisson distribution: $Y \sim \text{Poisson}(\lambda)$, where $\lambda > 0$.
  • $T = T(X,Y)$ represents any unbiased estimator of the parameter $\lambda$. An estimator $T$ is unbiased if its expected value equals the true parameter value, i.e., $E[T] = \lambda$.

Variance of Y

For a random variable $Y$ following a Poisson distribution with parameter $\lambda$, denoted as $Y \sim \text{Poisson}(\lambda)$, both its mean and variance are equal to $\lambda$.

Therefore, we have $Var(Y) = \lambda$.

Variance Bound for Unbiased Estimators

The question asks about the variance of an arbitrary unbiased estimator $T$ of $\lambda$. We can use the Cramér-Rao Lower Bound (CRLB) to establish a minimum possible variance for such estimators.

The CRLB depends on the Fisher Information, $I(\lambda)$, derived from the distribution of $Y$, as $Y$ is directly related to $\lambda$.

The probability mass function (PMF) of $Y \sim \text{Poisson}(\lambda)$ is $p(y; \lambda) = \frac{e^{-\lambda}\lambda^y}{y!}$ for $y = 0, 1, 2, \dots$.

The natural logarithm of the PMF (log-likelihood) is $\ln p(y; \lambda) = -\lambda + y \ln \lambda - \ln(y!)$.

To find the Fisher Information, we first compute the second derivative of the log-likelihood with respect to $\lambda$:

$ \frac{\partial^2}{\partial \lambda^2} \ln p(y; \lambda) = \frac{\partial}{\partial \lambda} \left( -1 + \frac{y}{\lambda} \right) = -\frac{y}{\lambda^2} $

The Fisher Information $I(\lambda)$ is the negative expectation of this second derivative:

$ I(\lambda) = -E\left[\frac{\partial^2}{\partial \lambda^2} \ln p(Y; \lambda)\right] = -E\left[-\frac{Y}{\lambda^2}\right] = \frac{1}{\lambda^2} E[Y] $

Since $E[Y] = \lambda$ for the Poisson distribution, we get:

$ I(\lambda) = \frac{1}{\lambda^2} (\lambda) = \frac{1}{\lambda} $

The CRLB states that the variance of any unbiased estimator $T$ of $\lambda$ must be greater than or equal to $1/I(\lambda)$:

$ Var(T) \ge \frac{1}{I(\lambda)} $

Substituting the calculated $I(\lambda)$:

$ Var(T) \ge \frac{1}{1/\lambda} $

$ Var(T) \ge \lambda $

Conclusion

From the CRLB, we have shown that $Var(T) \ge \lambda$ must hold true for any unbiased estimator $T$ of $\lambda$.

We also established earlier that $Var(Y) = \lambda$, because $Y \sim \text{Poisson}(\lambda)$.

Therefore, the inequality $Var(T) \ge \lambda$ is equivalent to $Var(T) \ge Var(Y)$.

This confirms that both statements are correct:

  • $Var(T) \ge Var(Y)$ for all $\lambda$.
  • $Var(T) \ge \lambda$ for all $\lambda$.
Was this answer helpful?

Important Questions from Elementary Bayesian Inference

  1. Let $X|\theta \sim \text{Uniform}[0, \theta]$ and $\theta$ has an Exponential distribution with mean $\lambda$, where $\lambda > 3$ is known. If the realized value of $X$ is $2025$, then the posterior mode equals
  2. Let $X_1, X_2, \dots, X_7$ be a random sample from $N(\mu, \sigma^2)$ where $\mu$ and $\sigma^2$ are unknown. Consider the problem of testing $H_0: \mu = 2$ against $H_1: \mu > 2$. Suppose the observed values of $x_1, x_2, \dots, x_7$ are $1.2, 1.3, 1.7, 1.8, 2.1, 2.3, 2.7$. If we use the Uniformly Most Powerful test, which of the following is true?

  3. Suppose $X_i \mid \theta_i \sim N(\theta_i, \sigma^2), i = 1, 2$ are independently distributed. Under the prior distribution, $\theta_1$ and $\theta_2$ are i.i.d $N(\mu, \tau^2)$, where $\sigma^2, \mu$ and $\tau^2$ are known. Then which of the following is true about the marginal distributions of $X_1$ and $X_2$?

  4. Consider the pdf
    $f(x;\theta,\sigma) = \frac{0.9}{\sigma}\phi\left(\frac{x-\theta}{\sigma}\right) + 0.1\ \phi(x-\theta)$, where $-\infty < \theta < \infty$ and $\sigma > 0$ are unknown parameters and $\phi$ denotes the pdf of $N(0,1)$. Let $X_1, X_2, \cdots, X_n$ be a random sample from this probability distribution. Then which of the following is (are) correct?

  5. Suppose $X$ has density $f(x|\theta)$ where $\theta$ is $0$ or $1$. Also,
    $f(x|0) = 1$ if $0 < x < 1$, and $0$ otherwise,
    $f(x|1) = \frac{1}{2\sqrt{x}}$ if $0 < x < 1$ and $0$ otherwise.
    To test $H_0: \theta = 0$ versus $H_1: \theta = 1$ at level $\alpha, 0 < \alpha < 1$, the Most Powerful test

Need Expert Advice?

Start Your Preparation with Prepp Mobile App

Download the app from Google Play & App Store
Download the app from Google Play & App Store
Prepp Mobile App