Deep Learning with Yacine on MSN

Nesterov accelerated gradient (NAG) from scratch in Python – step-by-step tutorial

Dive deep into Nesterov Accelerated Gradient (NAG) and learn how to implement it from scratch in Python. Perfect for ...
IEEE

Robust Explainability: A tutorial on gradient-based attribution methods for deep neural networks

Abstract: The rise in deep neural networks (DNNs) has led to increased interest in explaining their predictions. While many methods for this exist, there is currently no consensus on how to evaluate ...
GitHub

Gradient Descent Visualiser (WIP)

Heyo there! This repository holds the code for our micro-lesson on gradient descent. The goal of this micro-lesson is twofold: firstly, to introduce the concept of gradient descent to students ...
IEEE

IEEE Communications Surveys and Tutorials

Abstract: I welcome you to the fourth issue of the IEEE Communications Surveys and Tutorials in 2021. This issue includes 23 papers covering different aspects of communication networks. In particular, ...
GitHub

Saving memory using gradient-checkpointing

Training very deep neural networks requires a lot of memory. Using the tools in this package, developed jointly by Tim Salimans and Yaroslav Bulatov, you can trade off some of this memory usage with ...