This course will get you started in building your FIRST **artificial neural network** using **deep learning** techniques. Following my previous course on logistic regression, we take this basic building block, and build full-on non-linear neural networks right out of the gate using Python and Numpy. All the materials for this course are FREE.

We extend the previous binary classification model to multiple classes using the softmax function, and we derive the very important training method called "**backpropagation**" using first principles. I show you how to code backpropagation in Numpy, first "the slow way", and then "the fast way" using Numpy features.

Next, we implement a neural network using**Google**'s new **TensorFlow** library.

You should take this course if you are interested in starting your journey toward becoming a master at deep learning, or if you are interested in**machine learning** and **data science** in general. We go beyond basic models like logistic regression and linear regression and I show you something that **automatically learns features**.

This course provides you with many practical examples so that you can really see how deep learning can be used on anything. Throughout the course, we'll do a course project, which will show you how to predict user actions on a website given user data like whether or not that user is on a mobile device, the number of products they viewed, how long they stayed on your site, whether or not they are a returning visitor, and what time of day they visited.

Another project at the end of the course shows you how you can use deep learning for facial expression recognition. Imagine being able to predict someone's emotions just based on a picture!

After getting your feet wet with the fundamentals, I provide a brief overview of some of the newest developments in neural networks - slightly modified architectures and what they are used for.

NOTE:

If you already know about softmax and backpropagation, and you want to skip over the theory and speed things up using more advanced techniques along with GPU-optimization, check out my follow-up course on this topic,**Data Science: Practical Deep Learning Concepts in Theano and TensorFlow**.

I have other courses that cover more advanced topics, such as**Convolutional Neural Networks, Restricted Boltzmann Machines, Autoencoders**, and more! But you want to be very comfortable with the material in this course before moving on to more advanced subjects.

This course focuses on**"how to build and understand"**, not just "how to use". Anyone can learn to use an API in 15 minutes after reading some documentation. It's not about "remembering facts", it's about **"seeing for yourself" via experimentation**. It will teach you how to visualize what's happening in the model internally. If you want more than just a superficial look at machine learning models, this course is for you.

Suggested Prerequisites:

Tips for success:

We extend the previous binary classification model to multiple classes using the softmax function, and we derive the very important training method called "

Next, we implement a neural network using

You should take this course if you are interested in starting your journey toward becoming a master at deep learning, or if you are interested in

This course provides you with many practical examples so that you can really see how deep learning can be used on anything. Throughout the course, we'll do a course project, which will show you how to predict user actions on a website given user data like whether or not that user is on a mobile device, the number of products they viewed, how long they stayed on your site, whether or not they are a returning visitor, and what time of day they visited.

Another project at the end of the course shows you how you can use deep learning for facial expression recognition. Imagine being able to predict someone's emotions just based on a picture!

After getting your feet wet with the fundamentals, I provide a brief overview of some of the newest developments in neural networks - slightly modified architectures and what they are used for.

NOTE:

If you already know about softmax and backpropagation, and you want to skip over the theory and speed things up using more advanced techniques along with GPU-optimization, check out my follow-up course on this topic,

I have other courses that cover more advanced topics, such as

This course focuses on

Suggested Prerequisites:

- calculus
- matrix arithmetic (adding, multiplying)
- probability
- Python coding: if/else, loops, lists, dicts, sets
- Numpy coding: matrix and vector operations, loading a CSV file
- linear regression, logistic regression

Tips for success:

- Watch it at 2x.
- Take handwritten notes. This will drastically increase your ability to retain the information.
- Write down the equations. If you don't, I guarantee it will just look like gibberish.
- Ask lots of questions on the discussion board. The more the better!
- Realize that most exercises will take you days or weeks to complete.
- Write code yourself, don't just sit there and look at my code.

- Introduction and Outline (03:46) (FREE preview available)
- Where does this course fit into your deep learning studies? (10:43)
- Where to get the code (04:24)
- How to Succeed in this Course (03:13)

- Review Section Introduction (01:58)
- What does machine learning do? (05:29)
- Neuron Predictions (05:01)
- Neuron Training (08:47)
- Deep Learning Readiness Test (05:33)
- Review Section Summary (03:52)

- Neural Networks with No Math (04:21)
- Introduction to the E-Commerce Course Project (08:53)

- Prediction: Section Introduction and Outline (05:39)
- From Logistic Regression to Neural Networks (05:13)
- Interpreting the Weights of a Neural Network (08:06)
- Softmax (02:55)
- Sigmoid vs. Softmax (01:31)
- Feedforward in Slow-Mo (part 1) (19:42)
- Feedforward in Slow-Mo (part 2) (10:55)
- Where to get the code for this course (01:30)
- Softmax in Code (03:40)
- Building an entire feedforward neural network in Python (06:24)
- E-Commerce Course Project: Pre-Processing the Data (05:24)
- E-Commerce Course Project: Making Predictions (03:55)
- Prediction Quizzes (03:26)
- Prediction: Section Summary (01:45)

- Training: Section Introduction and Outline (02:50)
- What do all these symbols and letters mean? (09:46)
- What does it mean to 'train' a neural network? (06:45)
- How to Brace Yourself to Learn Backpropagation (07:39)
- Categorical Cross-Entropy Loss Function (11:01)
- Training Logistic Regression with Softmax (part 1) (14:41)
- Training Logistic Regression with Softmax (part 2) (05:42)
- Backpropagation (part 1) (05:14)
- Backpropagation (part 2) (10:50)
- Backpropagation in code (17:07)
- Backpropagation (part 3) (16:13)
- The WRONG Way to Learn Backpropagation (03:53)
- E-Commerce Course Project: Training Logistic Regression with Softmax (08:11)
- E-Commerce Course Project: Training a Neural Network (06:19)
- Training Quizzes (05:31)
- Training: Section Summary (02:41)

- Practical Issues: Section Introduction and Outline (01:44)
- Donut and XOR Review (01:06)
- Donut and XOR Revisited (04:21)
- Neural Networks for Regression (11:38)
- Common nonlinearities and their derivatives (01:26)
- Practical Considerations for Choosing Activation Functions (07:46)
- Hyperparameters and Cross-Validation (04:11)
- Manually Choosing Learning Rate and Regularization Penalty (04:08)
- Practical Issues: Section Summary (06:11)

- TensorFlow plug-and-play example (07:32)
- Visualizing what a neural network has learned using TensorFlow Playground (11:36)
- Where to go from here (03:42)
- You know more than you think you know (04:52)
- How to get good at deep learning + exercises (05:07)
- Deep neural networks in just 3 lines of code with Sci-Kit Learn (08:49)

- Facial Expression Recognition Problem Description (12:22)
- The class imbalance problem (06:01)
- Utilities walkthrough (05:45)
- Facial Expression Recognition in Code (Binary / Sigmoid) (12:14)
- Facial Expression Recognition in Code (Logistic Regression Softmax) (08:58)
- Facial Expression Recognition in Code (ANN Softmax) (10:45)

- What does it mean to 'train' a neural network? (06:15)
- Backpropagation Intro (11:54)
- Backpropagation - what does the weight update depend on? (04:47)
- Backpropagation - recursiveness (04:38)

- Backpropagation Supplementary Lectures Introduction (01:03)
- Why Learn the Ins and Outs of Backpropagation? (08:54)
- Gradient Descent Tutorial (04:30)
- Help with Softmax Derivative (04:10)
- Backpropagation with Softmax Troubleshooting (11:55)

- What is the Appendix? (02:48)
- What's the difference between "neural networks" and "deep learning"? (07:58)
- Windows-Focused Environment Setup 2018 (20:21)
- How to install Numpy, Scipy, Matplotlib, Pandas, IPython, Theano, and TensorFlow (17:33)
- How to Code Yourself (part 1) (15:55)
- How to Code Yourself (part 2) (09:23)
- Proof that using Jupyter Notebook is the same as not using it (12:29)
- How to Succeed in this Course (Long Version) (10:25)
- Is this for Beginners or Experts? Academic or Practical? Fast or slow-paced? (22:04)
- How to Uncompress a .tar.gz file (03:18)
- Python 2 vs Python 3 (04:38)
- What order should I take your courses in? (part 1) (11:19)
- What order should I take your courses in? (part 2) (16:07)
- Where to get discount coupons and FREE deep learning material (02:21)

- Calculus Cheatsheet
- Code for Neural Network with Arbitrary Number of Layers