Machine Learning Engineer Question:
What is the difference between L1 and L2 regularization?
Answer:
L2 regularization tends to spread error among all the terms, while L1 is more binary/sparse, with many variables either being assigned a 1 or 0 in weighting. L1 corresponds to setting a Laplacean prior on the terms, while L2 corresponds to a Gaussian prior.
| Previous Question | Next Question |
| Can you pick an algorithm. Write the psuedo-code for a parallel implementation? | Tell us where do you usually source datasets? |