Arrange the following steps in a proper sequence for the process of training a neural network. (A) Weight initialization (B) Feed forward (C) Back Propagation (D) Loss Calculation (E) Weight Update Choose the correct answer from the options given below :
(A), (B), (D), (C), (E)
A neural network is trained by gradient descent: the error of the current prediction is propagated backwards to obtain gradients, which adjust the weights. The loop repeats for many epochs.
Step 1 — Weight initialization (A): weights and biases receive small random values.
Step 2 — Feed forward (B): inputs pass through the layers to produce an output.
Step 3 — Loss Calculation (D): the output is compared with the target using a loss such as mean squared error or cross-entropy.
Step 4 — Back Propagation (C): the chain rule gives \(\partial L / \partial w\) for every weight.
Step 5 — Weight Update (E): \(w \leftarrow w - \eta \, \partial L / \partial w\) with learning rate \(\eta\).
Loss cannot be computed before a forward pass, backpropagation needs the loss, and updates need the gradients, so sequences starting with the loss or the update, or running backpropagation before the forward pass, are invalid.
(A), (B), (D), (C), (E) option is correct.
Match the following learning modes w.r.t. characteristics of available information for learning :
| a. | Supervised | i. | Instructive information on desired responses, explicitly specified by a teacher. |
| b. | Recording | ii. | A priori design information for memory storing |
| c. | Reinforcement | iii. | Partial information about desired responses, or only “right” or “wrong” evaluative information |
| d. | Unsupervised | iv. | No information about desired responses |
Codes :
a b c d
Consider the following statements about a perception :
I. Feature detector can be any function of the input parameters.
II. Learning procedure only adjusts the connection weights to the output layer.
Identify the correct statement out of the following :
Consider the two class classification task that consists of the following points :
Class \(C_{1}\) : [-1, -1], [-1, 1], [1, -1]
Class \(C_{2}\) : [1, 1]
The decision boundary between the two classes \(C_{1}\) and \(C_{2}\) using single perceptron is given by :
Consider the two class classification task that consists of the following points :
Class \(C_{1}\) : [1 1.5] [1 -1.5]
Class \(C_{2}\) : [-2 2.5] [-2 -2.5]
The decision boundary between the two classes using single perceptron is given by :
Perceptron learning, Delta learning and LMS learning are learning methods which falls under the category of
Which of the following is/are the application area(s) of ANN ?
(A) Natural Language Processing
(B) Image Processing
(C) Pattern Recognition
(D) Speech Recognition
Choose the correct answer from the options given below :
What is the role of weights in an ANN ?
Which of the following layers may be more than one in number ?
Artificial Neural Networks (ANNs) are inspired by :
What is the role of Back Propagation Algorithm ?
In a multilayer perceptron, an error signal originates at an output neuron of the network and propagates ___________ through the network.
In a feed forward neural network with the following specifications:
Input layer has 4 neurons, hidden layer has 3 neurons and output layer has 2 neurons using the sigmoid activation function for given input values [0.5, 0.8, 0.2, 0.6] as well as the initial weights for the connections.
W1: [0.1, 0.3, 0.5, 0.2]
W2: [0.2, 0.4, 0.6, 0.2] Input layer to hidden layer weights
W3: [0.3, 0.5, 0.7, 0.2]
W4: [0.4, 0.1, 0.3]
W5: [0.5, 0.2, 0.4] Hidden layer to output layer weights
What is the output of the output layer when the given input values are passed through neural network? Round the answer to two decimal places :
Match the following learning modes w.r.t. characteristics of available information for learning :
| a. | Supervised | i. | Instructive information on desired responses, explicitly specified by a teacher. |
| b. | Recording | ii. | A priori design information for memory storing |
| c. | Reinforcement | iii. | Partial information about desired responses, or only “right” or “wrong” evaluative information |
| d. | Unsupervised | iv. | No information about desired responses |
Codes :
a b c d
Consider the following statements about a perception :
I. Feature detector can be any function of the input parameters.
II. Learning procedure only adjusts the connection weights to the output layer.
Identify the correct statement out of the following :