This brief video talks about Layer Normalization, a popular normalization technique used in recent generative models like GPT: Why we need it, how it is done, how it is different from batch norm and how we can incorporate it in code.
What is Layer Normalization
Posted on
This brief video talks about Layer Normalization, a popular normalization technique used in recent generative models like GPT: Why we need it, how it is done, how it is different from batch norm and how we can incorporate it in code.