October 17, 2020 Beginner, NLP, Technique, Text, Unstructured Data Leave a comment

Quick Introduction to Bag-of-Words (BoW) and TF-IDF for Creating Features from Text

The Challenge of Making Machines Understand Text “Language is a wonderful medium of communication” You and I would have understood that sentence in a fraction of a second. But machines simply cannot process text data in raw form. They need us to break down the text into a numerical format that’s easily readable by the machine (the idea behind Natural Language Processing!). This is where the concepts of Bag-of-Words (BoW) and TF-IDF come into play. Both BoW and TF-IDF are […]

October 17, 2020 Advanced, NLP, Python, Social Media, Technique, Text, Unsupervised Leave a comment

Elon Musk AI Text Generator with LSTMs in Tensorflow 2

Introduction Elon Musk has become an internet sensation over the past couple of years, with his views about the future, funny personality along with his passion for technology. By now everyone knows him, either as that electric car guy, or that guy who builds flamethrowers. He is mostly active on his Twitter, where he shares everything, Even memes! He inspires a lot of young people in the IT industry, and I wanted to do a fun little project, where I […]

October 14, 2020 Beginner, Business Analytics, Infographic, Infographics, NLP, Python, Technique, Text, Unstructured Data Leave a comment

Quick Guide: Steps To Perform Text Data Cleaning in Python

Introduction Twitter has become an inevitable channel for brand management. It has compelled brands to become more responsive to their customers. On the other hand, the damage it would cause can’t be undone. The 140 character tweets has now become a powerful tool for customers / users to directly convey messages to brands. For companies, these tweets carry a lot of information like sentiment, engagement, reviews and features of its products and what not. However, mining these tweets isn’t easy. Why? Because, before you mine this data, you need […]

October 14, 2020 Intermediate, Machine Learning, NLP, Programming, Python, Technique, Text, Unstructured Data Leave a comment

Introduction to Structuring Customer complaints explained with examples

Introduction In past, if you were not particularly happy with a service or a product, you would go to the service provider or the shop and lodge a complaint. With services-businesses going online and due to enormous scale, lodging complaints in-person may not be always possible. Electronic ways such as emails, social media and particularly websites like www.consumercomplaints.in focusing on such issues, are widely used platforms to vent out the anger as well as publicizing the issue in expectancy of […]

October 11, 2020 Deep Learning, Intermediate, Listicle, NLP, Python, Technique Leave a comment

The Essential NLP Guide for data scientists (with codes for top 10 common NLP tasks)

Introduction Organizations today deal with huge amount and wide variety of data – calls from customers, their emails, tweets, data from mobile applications and what not. It takes a lot of effort and time to make this data useful. One of the core skills in extracting information from text data is Natural Language Processing (NLP). Natural Language Processing (NLP) is the art and science which helps us extract information from text and use it in our computations and algorithms. Given […]

October 11, 2020 Classification, Machine Learning, NLP, Project, Python, Supervised, Technique, Telecom, Text, Unstructured Data Leave a comment

Predicting Movie Genres using NLP – An Awesome Introduction to Multi-Label Classification

Introduction I was intrigued going through this amazing article on building a multi-label image classification model last week. The data scientist in me started exploring possibilities of transforming this idea into a Natural Language Processing (NLP) problem. That article showcases computer vision techniques to predict a movie’s genre. So I had to find a way to convert that problem statement into text-based data. Now, most NLP tutorials look at solving single-label classification challenges (when there’s only one label per observation). […]

October 11, 2020 Beginner, Classification, Deep Learning, NLP, Project, Python, PyTorch, Supervised, Technique, Text, Unstructured Data Leave a comment

Build Your First Text Classification model using PyTorch

Overview Learn how to perform text classification using PyTorch Grasp the importance of Pack Padding feature Understand the key points involved while solving text classification Introduction I always turn to State of the Art architectures to make my first submission in data science hackathons. Implementing the State of the Art architectures has become quite easy thanks to deep learning frameworks such as PyTorch, Keras, and TensorFlow. These frameworks provide an easy way to implement complex model architectures and algorithms with […]

October 11, 2020 Beginner, Machine Learning, NLP, Python, Technique Leave a comment

Machine Learning in Cyber Security — Malicious Software Installation

Introduction Monitoring of user activities performed by local administrators is always a challenge for SOC analysts and security professionals. Most of the security framework will recommend the implementation of a whitelist mechanism. However, the real world is often not ideal. You will always have different developers or users having local administrator rights to bypass controls specified. Is there a way to monitor the local administrator activities?

September 29, 2020 Classification, Data Science, Intermediate, NLP, Project, Python, Supervised, Technique, Text, Unstructured Data Leave a comment

Sentiment Analysis of Twitter Posts on Chennai Floods using Python

Introduction The best way to learn data science is to do data science. No second thought about it! One of the ways, I do this is continuously look for interesting work done by other community members. Once I understand the project, I do / improve the project on my own. Honestly, I can’t think of a better way to learn data science. As part of my search, I came across a study on sentiment analysis of Chennai Floods on Analytics Vidhya. […]

September 29, 2020 Advanced, NLP, Project, Python, Ranking, Technique, Text, Unstructured Data, Word Embeddings Leave a comment

Information Retrieval using word2vec based Vector Space Model

Overview Learn about Information Retrieval (IR), Vector Space Models (VSM), and Mean Average Precision (MAP) Create a project on Information Retrieval using word2vec based Vector Space Model Introduction “Google it!”- Isn’t it something we say every day? Whenever we come across something that we don’t know about, we “Google it.” Google Search is a great tool that can be used for even finding a needle from a haystack. This generation absolutely relies on Google for answers to all kinds […]

« 1 … 5 6 7 8 »