All Exams Test series for 1 year @ ₹349 only
Question

Two variates, x and y, are uncorrelated and have standard deviations σ xand σ yrespectively. What is the correlation coefficient between x + y and x – y?

The correct answer is \(\frac{{{\rm{\sigma }}_{\rm{x}}^2 - {\rm{\sigma }}_{\rm{y}}^2}}{{{\rm{\sigma }}_{\rm{x}}^2 + {\rm{\sigma }}_{\rm{y}}^2}}\)

Understanding the Problem: Correlation Between Linear Combinations

The question asks for the correlation coefficient between two new variates, $(x + y)$ and $(x - y)$, given that the original variates, $x$ and $y$, are uncorrelated. We are also given their standard deviations, $\sigma_x$ and $\sigma_y$. To solve this, we need to use the definition of the correlation coefficient and the properties of variance and covariance for uncorrelated variates.

Key Concepts for Uncorrelated Variates

When two variates $x$ and $y$ are uncorrelated, their covariance is zero. Mathematically, this means:

$\text{Cov}(x, y) = 0$

The standard deviation ($\sigma$) of a variate is the square root of its variance ($\sigma^2$ or Var). So, $\text{Var}(x) = \sigma_x^2$ and $\text{Var}(y) = \sigma_y^2$.

We also need the formulas for the variance and covariance of linear combinations of variates. For any variates $A$ and $B$, and constants $a, b, c, d$:

  • $\text{Var}(aA + bB) = a^2 \text{Var}(A) + b^2 \text{Var}(B) + 2ab \text{Cov}(A, B)$
  • $\text{Cov}(aA + bB, cA + dB) = ac \text{Var}(A) + bd \text{Var}(B) + (ad + bc) \text{Cov}(A, B)$

Since $x$ and $y$ are uncorrelated, $\text{Cov}(x, y) = 0$. The formulas simplify for uncorrelated variates:

  • $\text{Var}(ax + by) = a^2 \text{Var}(x) + b^2 \text{Var}(y) = a^2 \sigma_x^2 + b^2 \sigma_y^2$
  • $\text{Cov}(ax + by, cx + dy) = ac \text{Var}(x) + bd \text{Var}(y) = ac \sigma_x^2 + bd \sigma_y^2$

Calculating the Correlation Coefficient

The correlation coefficient between two variates $U$ and $V$ is defined as:

$\rho_{UV} = \frac{\text{Cov}(U, V)}{\sigma_U \sigma_V}$

Let $U = x + y$ and $V = x - y$. We need to calculate $\text{Cov}(U, V)$, $\sigma_U$, and $\sigma_V$.

Step 1: Calculate Covariance Between (x + y) and (x – y)

Using the simplified covariance formula for uncorrelated variates with $a=1, b=1, c=1, d=-1$:

$\text{Cov}(x + y, x - y) = (1)(1) \text{Var}(x) + (1)(-1) \text{Var}(y)$

$\text{Cov}(x + y, x - y) = \text{Var}(x) - \text{Var}(y)$

Since $\text{Var}(x) = \sigma_x^2$ and $\text{Var}(y) = \sigma_y^2$, we have:

$\text{Cov}(x + y, x - y) = \sigma_x^2 - \sigma_y^2$

Step 2: Calculate Variance and Standard Deviation of (x + y)

Using the simplified variance formula for uncorrelated variates with $a=1, b=1$:

$\text{Var}(x + y) = (1)^2 \text{Var}(x) + (1)^2 \text{Var}(y)$

$\text{Var}(x + y) = \text{Var}(x) + \text{Var}(y) = \sigma_x^2 + \sigma_y^2$

The standard deviation $\sigma_{x+y}$ is the square root of the variance:

$\sigma_{x+y} = \sqrt{\sigma_x^2 + \sigma_y^2}$

Step 3: Calculate Variance and Standard Deviation of (x – y)

Using the simplified variance formula for uncorrelated variates with $a=1, b=-1$:

$\text{Var}(x - y) = (1)^2 \text{Var}(x) + (-1)^2 \text{Var}(y)$

$\text{Var}(x - y) = \text{Var}(x) + \text{Var}(y) = \sigma_x^2 + \sigma_y^2$

The standard deviation $\sigma_{x-y}$ is the square root of the variance:

$\sigma_{x-y} = \sqrt{\sigma_x^2 + \sigma_y^2}$

Step 4: Calculate the Correlation Coefficient between (x + y) and (x – y)

Now we use the correlation coefficient formula:

$\rho_{(x+y), (x-y)} = \frac{\text{Cov}(x + y, x - y)}{\sigma_{x+y} \sigma_{x-y}}$

Substitute the results from Steps 1, 2, and 3:

$\rho_{(x+y), (x-y)} = \frac{\sigma_x^2 - \sigma_y^2}{\sqrt{\sigma_x^2 + \sigma_y^2} \cdot \sqrt{\sigma_x^2 + \sigma_y^2}}$

$\rho_{(x+y), (x-y)} = \frac{\sigma_x^2 - \sigma_y^2}{\sigma_x^2 + \sigma_y^2}$

Summary of Calculations

Quantity Calculation Result
Cov($x+y, x-y$) $\text{Cov}(x,x) - \text{Cov}(x,y) + \text{Cov}(y,x) - \text{Cov}(y,y)$
(since $x, y$ are uncorrelated, $\text{Cov}(x,y)=\text{Cov}(y,x)=0$)
$\text{Var}(x) - \text{Var}(y) = \sigma_x^2 - \sigma_y^2$
Var($x+y$) $\text{Var}(x) + \text{Var}(y) + 2\text{Cov}(x,y)$
(since $x, y$ are uncorrelated, $\text{Cov}(x,y)=0$)
$\text{Var}(x) + \text{Var}(y) = \sigma_x^2 + \sigma_y^2$
$\sigma_{x+y}$ $\sqrt{\text{Var}(x+y)}$ $\sqrt{\sigma_x^2 + \sigma_y^2}$
Var($x-y$) $\text{Var}(x) + \text{Var}(-y) + 2\text{Cov}(x,-y)$
or using $a=1, b=-1$ in $\text{Var}(ax+by)$ formula
$\text{Var}(x) + \text{Var}(y) = \sigma_x^2 + \sigma_y^2$
$\sigma_{x-y}$ $\sqrt{\text{Var}(x-y)}$ $\sqrt{\sigma_x^2 + \sigma_y^2}$
Correlation Coefficient $\rho_{(x+y), (x-y)}$ $\frac{\text{Cov}(x+y, x-y)}{\sigma_{x+y} \sigma_{x-y}}$ $\frac{\sigma_x^2 - \sigma_y^2}{\sigma_x^2 + \sigma_y^2}$

The calculated correlation coefficient between $(x + y)$ and $(x - y)$ is $\frac{\sigma_x^2 - \sigma_y^2}{\sigma_x^2 + \sigma_y^2}$.

Checking the Options

Let's compare our result with the given options:

  1. $\frac{{{{\rm{\sigma }}_{\rm{x}}}{{\rm{\sigma }}_{\rm{y}}}}}{{{\rm{\sigma }}_{\rm{x}}^2 + {\rm{\sigma }}_{\rm{y}}^2}}$
  2. $\frac{{{{\rm{\sigma }}_{\rm{x}}} + {{\rm{\sigma }}_{\rm{y}}}}}{{2{{\rm{\sigma }}_{\rm{x}}}{{\rm{\sigma }}_{\rm{y}}}}}$
  3. $\frac{{{\rm{\sigma }}_{\rm{x}}^2 - {\rm{\sigma }}_{\rm{y}}^2}}{{{\rm{\sigma }}_{\rm{x}}^2 + {\rm{\sigma }}_{\rm{y}}^2}}$
  4. $\frac{{{{\rm{\sigma }}_{\rm{y}}} - {{\rm{\sigma }}_{\rm{x}}}}}{{{{\rm{\sigma }}_{\rm{x}}}{{\rm{\sigma }}_{\rm{y}}}}}$

Our result matches option 3.

Revision Table: Key Formulas

Concept Formula Notes (for uncorrelated X, Y)
Covariance Cov(X, Y) $E[(X - E[X])(Y - E[Y])]$ If X, Y are uncorrelated, Cov(X, Y) = 0
Variance Var(X) or $\sigma_X^2$ $E[(X - E[X])^2]$ or $E[X^2] - (E[X])^2$ Related to standard deviation: $\sigma_X = \sqrt{\text{Var}(X)}$
Var(aX + bY) $a^2 \text{Var}(X) + b^2 \text{Var}(Y) + 2ab \text{Cov}(X, Y)$ If X, Y uncorrelated: $a^2 \text{Var}(X) + b^2 \text{Var}(Y)$
Cov(aX + bY, cZ + dW) $ac\text{Cov}(X,Z) + ad\text{Cov}(X,W) + bc\text{Cov}(Y,Z) + bd\text{Cov}(Y,W)$ For Cov(aX + bY, cX + dY) with X, Y uncorrelated: $ac\text{Var}(X) + bd\text{Var}(Y)$
Correlation Coefficient $\rho_{XY}$ $\frac{\text{Cov}(X, Y)}{\sigma_X \sigma_Y}$ Measures linear relationship strength and direction (-1 to +1)

Additional Information: Properties and Interpretation

The correlation coefficient measures the linear relationship between two variates. It ranges from -1 to +1.

  • A value of +1 indicates a perfect positive linear relationship.
  • A value of -1 indicates a perfect negative linear relationship.
  • A value of 0 indicates no linear relationship (the variates are uncorrelated).

In this problem, even though $x$ and $y$ are uncorrelated, the linear combinations $(x+y)$ and $(x-y)$ are generally correlated, unless $\sigma_x^2 = \sigma_y^2$.

  • If $\sigma_x^2 = \sigma_y^2$, the correlation coefficient becomes $\frac{\sigma_x^2 - \sigma_x^2}{\sigma_x^2 + \sigma_x^2} = \frac{0}{2\sigma_x^2} = 0$. This means if $x$ and $y$ have the same variance (and are uncorrelated), then $x+y$ and $x-y$ are also uncorrelated.
  • If $\sigma_x^2 > \sigma_y^2$, the numerator $\sigma_x^2 - \sigma_y^2$ is positive, and the correlation coefficient is positive.
  • If $\sigma_x^2 < \sigma_y^2$, the numerator $\sigma_x^2 - \sigma_y^2$ is negative, and the correlation coefficient is negative.

This makes intuitive sense: if $x$ varies more than $y$, then increasing $x$ has a larger effect on both $(x+y)$ and $(x-y)$, tending to make them move in the same direction, resulting in a positive correlation. If $y$ varies more than $x$, increasing $y$ increases $(x+y)$ but decreases $(x-y)$, tending to make them move in opposite directions, resulting in a negative correlation.

Was this answer helpful?

Important Questions from Correlation and Regression

  1. If two lines of regression are x + 4y + 1 = 0 and 4x + 9y + 7 = 0, then what is the value of x when y = -3 ?

  2. A bivariate data set contains only two points (-1, 1) and (3, 2). What will be the line of regression of y on x ?

  3. If the covariance between x and y is 30, variance of x is 25 and variance of y is 144, then what is the correlation coefficient?

  4. If, in a series. there are m items whose ranks are common, then which factor is added for correction for each repeating value in both the series?

  5. The rankings of ten students in two subjects, Mathematics and Statistics, are as follows.

    Mathematics

    Statistics

    3

    6

    5

    4

    8

    9

    4

    8

    7

    1

    10

    2

    2

    3

    1

    10

    6

    5

    9

    7


    The coefficient of rank correlation is:
Need Expert Advice?

Start Your Preparation with Prepp Mobile App

Download the app from Google Play & App Store
Download the app from Google Play & App Store
Prepp Mobile App