Deep Learning 101: Getting Started with Neural Networks

Deep Learning 101: Getting Started with Neural Networks

Learn the fundamentals of deep neural networks, including selecting architecture and training algorithms.

⏰ 4 h 38 min | 11 lessons
Published: December 2023
Access our growing course library
$ 20 / month (billed annually)
After completing this course, you will...
be proficient in the use of PyTorch and Lightning for accelerated AI deployment.
be able to unpack the insides of a deep neural network.
understand architecture design and the building blocks of a neural network.
have deployed training algorithms to tune models to new datasets.

In this course we shall be taking some first steps in applying and understanding deep neural networks. We'll be asking:

  • What is deep learning and neural networks?

  • How can we use them, train them, build them?

And most importantly we'll give examples of deployment with industry standard python packages: 'PyTorch' and 'Lightning'.

But to warm us up...

A revolution in amongst us. Deep learning holds the keys to unlocking the reams of unstructured data which is constantly collected in the modern world. With applications in the fields of computer vision--object detection, classification--to natural language processing--knowledge from text and large language models--we have only recently started building the correct tools to approach and solve big problems in industry.

With vast reservoirs of data, the past champions in machine learning and statistics struggle to draw inference without manual engineering of the data. In deep learning, we develop models that can learn subtle patterns in vast datasets.

And the applications are numerous:

  • Reinforcement Learning
  • Computer Vision
  • Natural Language Processing (inc. Large Language Models)

to name but a few. To begin developing in these fields, you need to know the fundamentals. Bother theoretical and practical. And that's what we'll cover in this course.

In this course, you will get to grips with:

  • Neural network architecture and 'learning' algorithms.
  • Training and validation approaches: loss functions, hyperparameters, tips & tricks.
  • Using the frameworks built into both PyTorch and Lightning for smooth training and development.
  • Applying end-to-end models in applications in the wild. We have one example looking as optimisation in drug discovery and another in image classification.

This course a gentle introduction to the topic. It sits alongside The Kernel Trick and Tree-based algorithms. And you could warm up with Tim's intro course, Getting started in machine learning.

Once you've made it to the other side, Freddy has created a brilliant end-to-end MLOps course where you shall train a deep neural network and deploy it with React; it's called Using TensorFlow to Build a Production-Ready Neural Network-Powered Web App.

Section 1
1. An Introduction to Deep Learning
16:39 (Preview)
2. What are Deep Neural Networks?
3. Coding Neurons from Scratch πŸ“‚
4. Bonus Example on Backpropagation πŸ“‚
5. Introducing PyTorch πŸ“‚
6. Develop with Lightning πŸ“‚
7. Activations and Loss Functions πŸ“‚
8. The Training Loop πŸ“‚
9. DNNs in the Wild for Drug Discovery πŸ“‚
10. DNNs in the Wild for Classification πŸ“‚
11. Conclusion, Certificate, and What Next?
Dr Andy Corbett
Head of Research and Development, digiLab
Andy is most at home engaging in the mathematical rough & tumble of machine learning: brainstorming, coding, and designing deep learning models for explainable AI. He’s a keen cyclist and knows his way around a triathlon (even the wet bits). Andy likes strumming along to old blues tracks, cooking up new dishes, and if he could be anywhere he would be hiking with his family out on the Devon hills.
Using TensorFlow to Build a Production-Ready Neural Network-Powered Web App
Using TensorFlow to Build a Production-Ready Neural Network-Powered Web App
Build, Train and Deploy a Convolutional Neural Network Image Classifier.