Welcome to Bayesian Linear Regression!

I first started this course series on Bayesian Machine Learning 5 years ago, with a course on A/B Testing. I had always intended to expand the series (there's a lot to cover!) but kept getting pulled in other directions.

Today, I am happy to announce that the Bayesian Machine Learning series is finally back on track!

In the first course, a lot of students asked, "but where is the 'machine learning'?", since they thought of machine learning from the typical supervised/unsupervised parametric model paradigm. The A/B Testing course was never meant to look at such models, but that is exactly what this course is for.

If you've studied machine learning before, then you know that linear regression is the first model everyone learns about. We will approach Bayesian Machine Learning the same way.

Bayesian Linear Regression has many nice properties (easy transition from non-Bayesian Linear Regression, closed-form solutions, etc.). It is best and most efficient "first step" into the world of Bayesian Machine Learning.

Also, let's not forget that Linear Regression (including the Bayesian variety) is simply very practical in the real-world. Bayesian Machine Learning can get very mathematical, so it's easy to lose sight of the big picture - the real-world applications. By exposing yourself to Bayesian ideas slowly, you won't be overwhelmed by the math. You'll always keep the application in mind.

It should be stated however: Bayesian Machine Learning really is very mathematical. If you're looking for a scikit-learn-like experience, Bayesian Machine Learning is definitely too high-level for you. Most of the "work" involves algebraic manipulation. At the same time, if you can tough it out to the end, you will find the results really satisfying, and you will be awed by its elegance.

Sidenote: If you made it through my Linear Regression and A/B Testing courses, then you'll do just fine.

Suggested Prerequisites:

I first started this course series on Bayesian Machine Learning 5 years ago, with a course on A/B Testing. I had always intended to expand the series (there's a lot to cover!) but kept getting pulled in other directions.

Today, I am happy to announce that the Bayesian Machine Learning series is finally back on track!

In the first course, a lot of students asked, "but where is the 'machine learning'?", since they thought of machine learning from the typical supervised/unsupervised parametric model paradigm. The A/B Testing course was never meant to look at such models, but that is exactly what this course is for.

If you've studied machine learning before, then you know that linear regression is the first model everyone learns about. We will approach Bayesian Machine Learning the same way.

Bayesian Linear Regression has many nice properties (easy transition from non-Bayesian Linear Regression, closed-form solutions, etc.). It is best and most efficient "first step" into the world of Bayesian Machine Learning.

Also, let's not forget that Linear Regression (including the Bayesian variety) is simply very practical in the real-world. Bayesian Machine Learning can get very mathematical, so it's easy to lose sight of the big picture - the real-world applications. By exposing yourself to Bayesian ideas slowly, you won't be overwhelmed by the math. You'll always keep the application in mind.

It should be stated however: Bayesian Machine Learning really is very mathematical. If you're looking for a scikit-learn-like experience, Bayesian Machine Learning is definitely too high-level for you. Most of the "work" involves algebraic manipulation. At the same time, if you can tough it out to the end, you will find the results really satisfying, and you will be awed by its elegance.

Sidenote: If you made it through my Linear Regression and A/B Testing courses, then you'll do just fine.

Suggested Prerequisites:

- Python coding: if/else, loops, lists, dicts, sets
- Numpy and Pandas coding: matrix and vector operations, loading a CSV file
- Basic math: calculus, linear algebra, probability
- Linear regression
- Bayesian Machine Learning: A/B Testing in Python (know about conjugate priors)

- Introduction (06:30) (FREE preview available)
- Outline (03:26)
- Where to get the code (00:29)
- The Big Picture (Optional) (09:05)

- Simple Linear Regression Review (05:24)
- Distribution of w Estimate (08:14)
- Linear Regression Review Dog Food (20:58)
- Relationship to Maximum Likelihood Estimation (04:15)
- MAP Estimation (10:09)
- MLE and MAP Dog Food (30:45)

- The Bayesian Approach (08:05)
- Review of Conjugate Priors (05:38)
- Training: Posterior w (06:51)
- Making Predictions (pt 1) (05:32)
- Making Predictions (pt 2) (04:42)
- Making Predictions (pt 3) (06:16)
- Training Dog Food (21:06)
- Prediction Dog Food (41:04)

- Multivariate Bayesian Linear Regression (Fitting) (08:15)
- Multivariate Bayesian Linear Regression (Predictions) (05:18)

- Code (14:50)

- Bayesian Linear Regression Code