179 questions
No questions match those filters.
← All questions
LLM FoundationsMedium· Residual Connections· Gradient Propagation
Why is the residual connection important? What breaks w...
This is one of the questions in the full AI/ML interview bank. Pro unlocks all 1789 questions; Premium includes the same bank plus the highest daily Practice limit.
See plansWithout the additive skip connection, the gradient at a layer involves a product of many Jacobians that collapses to near-zero as the depth increases. The residual connection provides a direct gradient path of approximately ones from the top of the network to every earlier layer, ensuring stable training at depth.