179 questions
No questions match those filters.
← All questions
Retrieval & EmbeddingsMedium· Sparsity· Regularization· Optimization
Why can't you simply minimize the number of nonzeros in...
This is one of the questions in the full AI/ML interview bank. Pro unlocks all 1789 questions; Premium includes the same bank plus the highest daily Practice limit.
See plansMinimizing the L0 norm directly is impossible because it is piecewise constant. L1 serves as a convex relaxation of the count, while FLOPS acts as a relaxation of the retrieval cost using mean activation as a proxy for activation probability. It is important to note that the ReLU activation function is what actually supplies the exact zeros in the output vector.