Saurabh Nale

Saurabh Nale

Happy to collaborate—feel free to reach out!

Posts by Tags

Attention Mechanism

Demistifying the Confusing Dimensions in Attention Mechanism.

3 minute read

Published:

Many people understand the main ideas of how Transformers and attention work. But when it comes to the small details inside, like the size of the data and how each part changes it, they often get confused. This blog post will look at how the data really moves inside and what things actually happen in each part.

Deep Learning

Pytorch Tutorial

less than 1 minute read

Published:

Pytorch tutorial from Scratch.

Python

Pytorch Tutorial

less than 1 minute read

Published:

Pytorch tutorial from Scratch.

Pytorch

Demistifying the Confusing Dimensions in Attention Mechanism.

3 minute read

Published:

Many people understand the main ideas of how Transformers and attention work. But when it comes to the small details inside, like the size of the data and how each part changes it, they often get confused. This blog post will look at how the data really moves inside and what things actually happen in each part.

Pytorch Tutorial

less than 1 minute read

Published:

Pytorch tutorial from Scratch.

Statistics

Transformers

Demistifying the Confusing Dimensions in Attention Mechanism.

3 minute read

Published:

Many people understand the main ideas of how Transformers and attention work. But when it comes to the small details inside, like the size of the data and how each part changes it, they often get confused. This blog post will look at how the data really moves inside and what things actually happen in each part.