A source emits bit 0 with probability 1/3 and bit 1 with probability 2/3. The emitted bits are communicated to the receiver. The receiver decides for either 0 or 1 based on the received value R. It is given that the conditional density functions of R are as \({{\rm{f}}_{\left( {{\rm{R}}/0} \right)}}\left( {\rm{x}} \right) = \left\{ {\frac{1}{4}, - 3 \le {\rm{x}} \le 1} \right.{\rm{and\;}}{{\rm{f}}_{\left( {{\rm{R}}/1} \right)}}\left( {\rm{x}} \right) = \left\{ {\frac{1}{6}, - 1 \le {\rm{x}} \le 5} \right.\)
To determine the minimum decision error probability for a communication system, we need to apply the Maximum A Posteriori (MAP) decision rule. This rule helps the receiver make the most optimal decision about the transmitted bit (0 or 1) based on the received signal, thereby minimizing the overall probability of error. The decision is made by comparing the posterior probabilities of each bit given the received value, or equivalently, by comparing the product of the prior probability and the conditional probability density function (PDF).
First, we identify the prior probabilities of the source emitting each bit. These are given in the problem statement:
The problem provides the conditional probability density functions (PDFs) of the received value \(R\), given which bit was transmitted. These functions describe the distribution of the received signal for each possible transmitted bit:
\(f_{\left(R/0\right)}\left(x\right) = \begin{cases} \frac{1}{4}, & -3 \le x \le 1 \\ 0, & \text{otherwise} \end{cases}\)
This is a uniform distribution over the interval \([-3, 1]\).
\(f_{\left(R/1\right)}\left(x\right) = \begin{cases} \frac{1}{6}, & -1 \le x \le 5 \\ 0, & \text{otherwise} \end{cases}\)
This is a uniform distribution over the interval \([-1, 5]\).
According to the MAP decision rule, the receiver should choose the bit \(i\) that maximizes the product \(P(i) \cdot f_{(R/i)}(x)\) for a given received value \(x\). Let's calculate these products for both bits:
\(P(0) \cdot f_{(R/0)}(x) = \frac{1}{3} \times \frac{1}{4} = \frac{1}{12}\) for \(-3 \le x \le 1\), and \(0\) otherwise.
\(P(1) \cdot f_{(R/1)}(x) = \frac{2}{3} \times \frac{1}{6} = \frac{2}{18} = \frac{1}{9}\) for \(-1 \le x \le 5\), and \(0\) otherwise.
Now, we define the decision regions by comparing these weighted likelihoods across the possible range of \(x\):
In this range, only \(P(0) \cdot f_{(R/0)}(x) = \frac{1}{12}\) is non-zero, because \(f_{(R/1)}(x)\) is \(0\) for \(x < -1\). Therefore, for any \(x\) in this interval, the receiver decides 0.
In this overlapping range, both weighted likelihoods are non-zero. For bit 0, the value is \(\frac{1}{12}\), and for bit 1, the value is \(\frac{1}{9}\). Since \(\frac{1}{9} > \frac{1}{12}\), for any \(x\) in this interval, the receiver decides 1.
In this range, only \(P(1) \cdot f_{(R/1)}(x) = \frac{1}{9}\) is non-zero, because \(f_{(R/0)}(x)\) is \(0\) for \(x > 1\). Therefore, for any \(x\) in this interval, the receiver decides 1.
Based on this analysis, the optimal decision regions are:
The total minimum decision error probability, \(P_e\), is the sum of probabilities of making incorrect decisions:
\(P_e = P(\text{decide } 0 | \text{sent } 1) P(\text{sent } 1) + P(\text{decide } 1 | \text{sent } 0) P(\text{sent } 0)\)
Let's calculate each term:
This error occurs if the received value \(x\) falls into region \(R_0\) (decide 0) but bit 1 was actually transmitted. We calculate this as \(\int_{R_0} f_{(R/1)}(x) dx\).
For \(R_0 = [-3, -1)\), the conditional PDF \(f_{(R/1)}(x)\) is \(0\). Therefore, \(P(\text{decide } 0 | \text{sent } 1) = \int_{-3}^{-1} 0 \, dx = 0\).
The contribution of this error type to the total error probability is: \(0 \times P(1) = 0 \times \frac{2}{3} = 0\).
This error occurs if the received value \(x\) falls into region \(R_1\) (decide 1) but bit 0 was actually transmitted. We calculate this as \(\int_{R_1} f_{(R/0)}(x) dx\).
For \(R_1 = [-1, 5]\), the conditional PDF \(f_{(R/0)}(x)\) is non-zero only for \(x \in [-1, 1]\), where it is \(\frac{1}{4}\). Outside this range (i.e., for \(x \in (1, 5]\)), \(f_{(R/0)}(x)\) is \(0\).
So, \(P(\text{decide } 1 | \text{sent } 0) = \int_{-1}^{1} \frac{1}{4} dx = \frac{1}{4} [x]_{-1}^{1} = \frac{1}{4} (1 - (-1)) = \frac{1}{4} (2) = \frac{1}{2}\).
The contribution of this error type to the total error probability is: \(P(\text{decide } 1 | \text{sent } 0) \times P(0) = \frac{1}{2} \times \frac{1}{3} = \frac{1}{6}\).
The minimum decision error probability \(P_e\) is the sum of these contributions:
\(P_e = 0 + \frac{1}{6} = \frac{1}{6}\)
Thus, the minimum decision error probability for this communication system is \(\frac{1}{6}\).
_______ is defined as the rate of change of signal on transmission medium after encoding and modulation have occurred.
A source generates three symbols with probability 0.25, 0.25, 0.50 at a rate of 3000 symbols per second. Assuming independent generation of symbols, the most efficient source encoder would have average bit rate of
An analog signal is bandlimited to 4 KHz, sampled at Nyquist rate and the samples are quantized into 4 levels. The quantized levels are assumed to be independent and equally probable. If we transmit two quantized samples per sec, the information rate is