# Sequence Model Interview Questions and Answers 2022

Sequence Modeling is the task of predicting what word/letter comes next. Unlike the FNN and CNN, in sequence modeling, the current output is dependent on the previous input and the length of the input is not fixed.

Let’s look at the problem of auto-complete in the context of sequence modeling. In this problem, whenever we type a character (d) the system tries to predict the next possible character based on the previously typed character.

In other words, the network tries to predict the next character from the possible 26 English alphabets given that we have typed ‘d’. The neural network would have a softmax output of size 26 representing the probability of the next letter given the previous letters. Since the inputs to this network are characters we need to convert them to a one-hot encoded vector of size 26 and the element corresponding to the index of the alphabet would be set to 1, everything else is set to 0.

Q.1 The main drawback of basic RNN is __.

1. Exploding gradient problem
2. Vanishing gradient problem
3. Overfitting
4. Large training parameters

Correct Answer is – Vanishing gradient problem

Q.2 Feedforward network cannot be used on sequence data because __.

1. You cannot pass hidden states to next input
2. Dependencies on previous inputs will not be considered
3. Of the varying length of input data
4. All the options

Correct Answer is – All the options

Q.3 Which of the following are the applications of RNN?

1. Time series prediction
2. Machine translation
3. Intent extraction
4. All the options

Correct Answer is – Intent extraction

Q.4 Error function in RNN is computed as _____.

1. Summation of errors at individual time step
2. Sum of errors at the first few time steps
3. Weighted sum of error values at each time step
4. Error value only at the final time step

Correct Answer is – Summation of errors at individual time step

Q.5 Back propagation through time is computed as __.

1. Summation of derivatives of parameters on error function over the first few time steps
2. Summation of derivatives of parameters on error function across each time step
3. Product of derivatives of parameters on error function across each time step
4. Derivatives of parameters on error function at the final time step

Correct Answer is – Summation of derivatives of parameters on error function across each time step

Q.6 Which of the following holds the memory in RNNs?

1. Error function
2. Hidden state
3. Output state
4. Input state

Correct Answer is – Error function

Q.7 Which of the following is not an example of sequential data?

1. Time series data
2. Text data
3. Speech data
4. Image data

Correct Answer is – Image data

Q.8 The basic RNN fails when ___________.

1. Input sequence is too small
2. Input is of fixed length
3. Input sequence is very long
4. There is temporal dependencies in the data

Correct Answer is – Input sequence is very long

Q.9 In which of the following, the vanishing gradient problem is profound? —

1. GRU
2. Basic RNN
3. LSTM

Correct Answer is – Basic RNN

Q.10 In the case of LSTM, which of the following is used to compute the output of a cell?

1. Hidden state
2. Cell state
3. Input state
4. Reset state

Correct Answer is – Hidden state

Q.11 Which of the following gates (in LSTM) decides on keeping relevant features from the current input?

1. Input gate
2. Forget gate
3. Output gate
4. Update gate

Correct Answer is – Update gate

**done until here *

Q.12 Which of the following is an additional feature of LSTM when compared to basic RNN?

1. Hidden state
2. Cell state
3. Output state
4. Input State

Correct Answer is – Cell state

Q.13 Which of the following is not a feature of LSTM?

1. Hidden state
2. Reset gate
3. Update gate
4. Cell state

Correct Answer is – Hidden state

Q.14 GRU has more parameters to learn when compared to LSTM.

1. True
2. False

Correct Answer is – False

Q.15 LSTM has a large number of parameters to learn when compared to basic RNN.

1. True
2. False

Correct Answer is – True

Q.16 Which of the following is not the feature of GRU?

1. Hidden state
2. Reset gate
3. Update gate
4. Cell state

Correct Answer is – Cell state

Q.17 The reason feed forward network cannot be used on sequence data is _.

1. Dependencies on previous inputs will not be considered
2. Cannot pass hidden states to next input
3. Varying length of input data
4. All the options

Correct Answer is – Varying length of input data

Q.18 Which of the following is the component of GRU?

1. Forget gate
2. Reset gate
3. Input gate
4. Cell state

Correct Answer is – Reset gate

Q.19 In the case of LSTM, which of the following is used to compute the output of a cell?

1. Cell state
2. Hidden state
3. Input state
4. Reset state

Correct Answer is – Cell state

Q.20 Which of the following gates in LSTM decides on eliminating irrelevant features from previous information?

1. Input Gate
2. Update gate
3. Forget gate
4. Reset gate

Correct Answer is – Forget gate

Q.21 Which of the following gates in LSTM decides on keeping relevant features from the current input?

1. Output gate
2. Forget gate
3. Update gate
4. Input gate

Correct Answer is – Input gate

Q.22 Which of the following considers the information from previous timestep, current ones, as well as future timesteps?

1. GRU
2. LSTM
3. RNN
4. Bidirectional RNN

Correct Answer is – Bidirectional RNN

Q.23 What is meant by sequence data?

1. The data with a temporal relationship between them
2. The data with no relationship with other data
3. The data with a spacial relationship between them
4. Data arranged in a sequence

Correct Answer is – The data with a temporal relationship between them

Q.24 What is the entity that is carried from one timestep to next in RNN?

1. Concatenated inputs from previous timesteps
2. Final output
3. Previous timestep input
4. Hidden state

Correct Answer is – Hidden state

Q.25 De-noising and Contractive are examples of __

1. Shallow Neural Networks
2. Autoencoders
3. Convolution Neural Networks
4. Recurrent Neural Networks

Correct Answer is – Autoencoders

Q.26 How do RNTS interpret words?

1. One Hot Encoding
2. Lower Case Versions
3. Word Frequencies
4. Vector Representations

Correct Answer is – Vector Representations

Q.27 Autoencoders are trained using ___.

1. Feed Forward
2. Reconstruction
3. Back Propagation
4. They do not require Training

Correct Answer is – Back Propagation

Q.28 The rate at which cost changes with respect to weight or bias is called ______.

1. Derivative
3. Loss
4. Rate of Change

Q.29 A _____ matches or surpasses the output of an individual neuron to a visual stimuli.

1. Max Pooling
3. Cost
4. Convolution

Correct Answer is – Convolution

Q.30 Autoencoders cannot be used for Dimensionality Reduction.

1. True
2. False

Correct Answer is – False

Q.1 What is the difference between the actual output and generated output known as?

1. Output Modulus
2. Accuracy
3. Cost
4. Output Difference

Correct Answer is – Cost

Q.2 Prediction Accuracy of a Neural Network depends on ___ and __.

1. Input and Output
2. Weight and Bias
3. Linear and Logistic Function
4. Activation and Threshold

Correct Answer is – Weight and Bias

Q.3 GPU stands for __.

1. Graphics Processing Unit
2. Gradient Processing Unit
3. General Processing Unit
4. Good Processing Unit

Correct Answer is – Graphics Processing Unit

Q.4 Recurrent Neural Networks are best suited for Text Processing.

1. True
2. False

Correct Answer is – True

Q.5 Recurrent Networks work best for Speech Recognition.

1. True
2. False

Correct Answer is – True

Q.6 Gradient at a given layer is the product of all gradients at the previous layers.

1. True
2. False

Correct Answer is – True

Q.7 Neural Networks Algorithms are inspired from the structure and functioning of the Human Biological Neuron.

1. True
2. False

Correct Answer is – True

Q.8 In a Neural Network, all the edges and nodes have the same Weight and Bias values.

1. True
2. False

Correct Answer is – False

Q.9 __ is a Neural Nets way of classifying inputs.

1. Learning
2. Forward Propagation
3. Activation
4. Classification

Correct Answer is – Forward Propagation

Q.10 Name the component of a Neural Network where the true value of the input is not observed.

1. Hidden Layer
3. Activation Function
4. Output Layer

Correct Answer is – Hidden Layer

Q.11 __ works best for Image Data.

1. AutoEncoders
2. Single Layer Perceptrons
3. Convolution Networks
4. Random Forest

Correct Answer is – Convolution Networks

Q.12 _ is a recommended Model for Pattern Recognition in Unlabeled Data.

1. CNN
2. RNN
3. Autoencoders
4. Shallow Neural Networks

Correct Answer is – Autoencoders

Q.13 Process of improving the accuracy of a Neural Network is called ___.

1. Forward Propagation
2. Cross Validation
3. Random Walk
4. Training

Correct Answer is – Training

Q.14 Data Collected from Survey results is an example of __.

1. Data
2. Information
3. Structured Data
4. Unstructured Data

Correct Answer is – Structured Data

Q.15 Support Vector Machines, Naive Bayes and Logistic Regression are used for solving _ problems.

1. Clustering
2. Classification
3. Regression
4. Time Series

Correct Answer is – Classification

Q.16 The rate at which cost changes with respect to weight or bias is called __.

1. Derivative
3. Rate of Change
4. Loss

Q.17 What does LSTM stand for?

1. Long Short Term Memory
2. Least Squares Term Memory
3. Least Square Time Mean
4. Long Short Threshold Memory

Correct Answer is – Long Short Term Memory

Q.18 A Shallow Neural Network has only one hidden layer between Input and Output layers.

1. True
2. False

Correct Answer is – True

Q.19 All the Visible Layers in a Restricted Boltzmannn Machine are connected to each other.

1. True
2. False

Correct Answer is – False

Q.20 All the neurons in a convolution layer have different Weights and Biases.

1. True
2. False

Correct Answer is – False

Q.21 Recurrent Network can input Sequence of Data Points and Produce a Sequence of Output.

1. True
2. False

Correct Answer is – True

Q.22 A Deep Belief Network is a stack of Restricted Boltzmann Machines.

1. True
2. False

Correct Answer is – True

Q.23 Restricted Boltzmann Machine expects the data to be labeled for Training.

1. True
2. False

Correct Answer is – False

Q.24 What is the method to overcome the Decay of Information through time in RNN known as?

1. Back Propagation
3. Activation
4. Gating

Correct Answer is – Gating

Q.25 What is the best Neural Network Model for Temporal Data?

1. Recurrent Neural Network
2. Convolution Neural Networks
3. Temporal Neural Networks
4. Multi Layer Perceptrons

Correct Answer is – Recurrent Neural Network

Q.26 RELU stands for __.

1. Rectified Linear Unit
2. Rectified Lagrangian Unit
3. Regressive Linear Unit
4. Regressive Lagrangian Unit

Correct Answer is – Rectified Linear Unit

Q.27 Why is the Pooling Layer used in a Convolution Neural Network?

1. They are of no use in CNN
2. Dimension Reduction
3. Image Sensing
4. Object Recognition

Correct Answer is – Dimension Reduction

Q.28 What are the two layers of a Restricted Boltzmann Machine called?

1. Input and Output Layers
2. Recurrent and Convolution Layers
3. Activation and Threshold Layers
4. Hidden and Visible Layers

Correct Answer is – Hidden and Visible Layers

Q.29 The measure of Difference between two probability distributions is know as ____.

1. Probability Difference
2. Cost
3. KL Divergence
4. Error

Correct Answer is – KL Divergence 