What is the primary purpose of a learning rate decay in training deep neural networks?
A. To adjust the learning rate based on model performance
B. To increase the model's complexity
C. To optimize the loss function
D. To reduce the number of layers in the network
Answer: Option A

Join The Discussion