Welcome to Rish’s AI Notes 馃憢
Hi, this is Rishab. I’m currently a Predoctoral Research Fellow at IISc. I created this blog to share topics and ideas that I find fascinating in the fields of Machine Learning and Deep Learning.
Variational Autoencoders and Maximum Likelihood Estimation
In my previous blog, we explored maximum likelihood estimation (MLE) and how it can be used to derive commonly used loss functions. It also turns out that MLE is widely being used in generative models like Variational Autoencoders (VAE) and Diffusion models (DDPM). In this blog, we will explore how the loss function of Variational Autoencoders are derived. VAEs are latent variable generative models. They can solve a few tasks:...
Maximum Likelihood Estimation and Loss Functions
When I started learning about loss functions, I could always understand the intuition behind them. For example, the mean squared error (MSE) for regression seemed logical鈥攑enalizing large deviations from the ground-truth makes sense. But one thing always bothered me: I could never come up with those loss functions on my own. Where did they come from? Why do we use these specific formulas and not something else? This frustration led me to dig deeper into the mathematical and probabilistic foundations of loss functions....