🐍 Python
From zero to full-stack Python — practical, exam-oriented courses for every level
🧠 AI & Neural Networks
ANN foundations through deep learning, competitive programming, and a full capstone project
∫ Complex Analysis
Complex functions, Cauchy-Riemann equations, conformal mappings, and contour integration
📊 Probability & Statistics
Distributions, curve fitting, regression, and hypothesis testing — all exam-oriented
Supervised Learning in Neural Networks
LMS, backpropagation, and MNIST digit classification
Pricing (per student)
Prerequisites
- Completion of Introduction to ANN (or equivalent)
- Basic probability and statistics (mean, variance, MSE)
- Familiarity with NumPy and Pandas
Overview
Deep-dives into supervised learning techniques — the LMS algorithm, backpropagation, and their real-world applications. Students implement backpropagation from scratch and train a network to classify handwritten digits from the MNIST dataset.
Topics
| Hour | Topic | Details |
|---|---|---|
| 1 | Introduction to Supervised Learning | Supervised vs. unsupervised vs. reinforcement learning. |
| 2 | Perceptron Learning for Non-Separable Sets | Handle non-separable data using advanced techniques. |
| 3 | α-LMS (Least Mean Square) Algorithm | Derive and implement the LMS algorithm. |
| 4 | MSE Error Surface & Steepest Descent | Visualise and minimise the MSE error surface. |
| 5 | μ-LMS Approximation to Gradient Descent | Relationship between LMS and gradient descent. |
| 6 | LMS for Noise Cancelling | Implement a noise-cancelling system using LMS. |
| 7 | Multilayer Network Architecture | Design a multilayer feedforward network. |
| 8 | Backpropagation — Theory | Derive the backpropagation equations. |
| 9 | Backpropagation — Implementation | Code backpropagation for a multilayer network. |
| 10 | Practical Considerations | Optimise learning rate, batch size, and initialisation. |
| 11 | Case Study: MNIST Classification | Train a neural network to classify handwritten digits. |
| 12 | Debugging Neural Networks | Diagnose vanishing gradients and overfitting. |
Expected Outcomes
- Implement backpropagation from scratch.
- Understand LMS and gradient descent in neural networks.
- Apply neural networks to real-world problems like digit classification.