LSTM is dead. Long Live Transformers!

Seattle Applied Deep Learning201928:48540.5K views

Why it is in the catalog

Hacker News commenters linked this video 5 times between 2020 and 2023, from 4 different accounts. Its recommendation score is 5.

Open on YouTube Find the HN threads

Tags

transformers lstm self-attention positional encoding nlp

More from AI, Machine Learning & Data

The spelled-out intro to neural networks and backpropagation: building micrograd

The spelled-out intro to neural networks and backpropagation: building micrograd

Andrej Karpathy

2022AI, Machine Learning & Data20 HN mentions

A Better Default Colormap for Matplotlib | SciPy 2015 | Nathaniel Smith and Stéfan van der Walt

A Better Default Colormap for Matplotlib | SciPy 2015 | Nathaniel Smith and Stéfan van der Walt

Enthought

2015AI, Machine Learning & Data20 HN mentions

But what is a neural network? | Deep learning chapter 1

But what is a neural network? | Deep learning chapter 1

3Blue1Brown

2017AI, Machine Learning & Data19 HN mentions

Hans Rosling's 200 Countries, 200 Years, 4 Minutes - The Joy of Stats - BBC

Hans Rosling's 200 Countries, 200 Years, 4 Minutes - The Joy of Stats - BBC

BBC

2010AI, Machine Learning & Data20 HN mentions

Transformers, the tech behind LLMs | Deep Learning Chapter 5

Transformers, the tech behind LLMs | Deep Learning Chapter 5

3Blue1Brown

2024AI, Machine Learning & Data16 HN mentions

DON'T PANIC — Hans Rosling showing the facts about population

DON'T PANIC — Hans Rosling showing the facts about population

Gapminder Foundation

2014AI, Machine Learning & Data16 HN mentions

AlphaGo - The Movie | Full award-winning documentary

AlphaGo - The Movie | Full award-winning documentary

Google DeepMind

2020AI, Machine Learning & Data13 HN mentions

MarI/O - Machine Learning for Video Games

MarI/O - Machine Learning for Video Games

SethBling

2015AI, Machine Learning & Data20 HN mentions