January 20, 2021 Advanced, Computer Vision, Deep Learning, Image, Image Analysis, NLP, Python, Technique, Unstructured Data Leave a comment

Implementation of Attention Mechanism for Caption Generation on Transformers using TensorFlow

Overview Learning about the state of the art model that is Transformers. Understand how we can implement Transformers on the already seen image captioning problem using Tensorflow Comparing the results of Transformers vs attention models. Introduction We have seen that Attention mechanisms (in the previous article) have become an integral part of compelling sequence modeling and transduction models in various tasks (such as image captioning), allowing modeling of dependencies without regard to their distance in the input or output […]

November 20, 2020 Advanced, Computer Vision, Deep Learning, Image, Image Analysis, NLP, Python, Technique, Unstructured Data Leave a comment

A Hands-on Tutorial to Learn Attention Mechanism For Image Caption Generation in Python

Overview Understand the attention mechanism for image caption generation Implement attention mechanism to generate caption in python Introduction The attention mechanism is a complex cognitive ability that human beings possess. When people receive information, they can consciously ignore some of the main information while ignoring other secondary information. This ability of self-selection is called attention. The attention mechanism allows the neural network to have the ability to focus on its subset of inputs to select specific features. In recent […]

October 31, 2020 Advanced, Algorithm, Computer Vision, Deep Learning, NLP, Python, Unstructured Data Leave a comment

A Comprehensive Guide to Attention Mechanism in Deep Learning for Everyone

Overview The attention mechanism has changed the way we work with deep learning algorithms Fields like Natural Language Processing (NLP) and even Computer Vision have been revolutionized by the attention mechanism We will learn how this attention mechanism works in deep learning, and even implement it in Python Introduction “Every once in a while, a revolutionary product comes along that changes everything.” – Steve Jobs What does one of the most famous quotes of the 21st century have to do with […]