Machine Learning Journey
Viole

Viole

This blog shares my journey in Machine Learning, focusing on hands-on learning through implementing core concepts from scratch and continuously improving along the way.

4. Gradient Descent: Discovering Adam Optimizer

Mar 10, 202510 min read6 views

🚀 Implementation of ADAM In earlier posts, we implemented a momentum-based optimizer, which offered several advantages: Momentum helps avoid getting...

4. Gradient Descent: Discovering Adam Optimizer

3. Gradient Descent: Exploring Momentum

Feb 27, 20253 min read6 views

Implementing Momentum-based Optimizer 🚀 Context Last time, we implemented a simple learning rate scheduler and identified a major flaw: over time, it...

3. Gradient Descent: Exploring Momentum

2. Gradient Descent: The First Step in Optimization

Feb 25, 20253 min read25 views

🚀 Learning Rate Scheduling: Fixing the Convergence Issue Context 📚 In my first post, I implemented simple Gradient Descent, and while it worked, we...

2. Gradient Descent: The First Step in Optimization

1. Gradient Descent: My First Implementation🚀

Feb 23, 20252 min read19 views

Exploring Derivatives in Practice Context 📚 After completing a Linear Algebra course, I transitioned to studying Calculus. Unexpectedly, at work, I...

1. Gradient Descent: My First Implementation🚀