A Bird’s Eye View of Research on Attention
Attention is a concept that is scientifically studied across multiple disciplines, including psychology, neuroscience, and, more recently, machine learning. While all disciplines may have produced their own definitions for attention, one core quality they can all agree on is that attention is a mechanism for making both biological and artificial neural systems more flexible.
In this tutorial, you will discover an overview of the research advances on attention.
After completing this tutorial, you will know:
- The concept of attention that is of significance to different scientific disciplines
- How attention is revolutionizing machine learning, specifically in the domains of natural language processing and computer vision
Kick-start your project with my book Building Transformer