Category: Data Cleaning

Data Cleaning

Helps you to clean flutter apps and lower their code size to free up some disk space

Helps you to clean flutter apps and lower their code size to free up some disk space. How to use This script is compatible with Python3. Clone the repo. Open the project in your favorite text editor or IDE. Change apps_dir to your flutter apps directory. Run terminal command python main.py. Disclaimer Cleaning the build won’t affect your app compiled (ex: IPA and AAB) size. Made with love in Alexandria, Egypt ♥️ Ahmed Mahmoud GitHub https://github.com/AhmedAbouelkher/clean_flutter_build    

Read more
Beginner, Data Cleaning, NLP, Python, Text, Unstructured Data, Word Embeddings

Part 6: Step by Step Guide to Master NLP – Word2Vec

This article was published as a part of the Data Science Blogathon Introduction This article is part of an ongoing blog series on Natural Language Processing (NLP). In the previous article of this series, we completed the statistical or frequency-based word embedding techniques, which are pre-word embedding era techniques. So, in this article, we will discuss the recent word-era embedding techniques. NOTE: In recent word-era embedding, there are many such techniques but in this article, we will discuss only the Word2Vec […]

Read more
Beginner, Data Cleaning, Machine Learning, NLP, Python, Text, Word Embeddings

Part 5: Step by Step Guide to Master NLP – Word Embedding and Text Vectorization

This article was published as a part of the Data Science Blogathon Introduction This article is part of an ongoing blog series on Natural Language Processing (NLP). Up to the previous part of this article series, we almost completed the necessary steps involved in text cleaning and normalization pre-processing. After that, we will convert the processed text to numeric feature vectors so that we can feed it to computers for Machine Learning applications. NOTE: Some concepts included in the pipeline of […]

Read more
Beginner, Data Cleaning, NLP, Python, Text

Part 4: Step by Step Guide to Master NLP – Text Cleaning Techniques

This article was published as a part of the Data Science Blogathon Introduction This article is part of an ongoing blog series on Natural Language Processing (NLP). In the previous part of this blog series, we complete the initial steps involved in text cleaning and preprocessing that are related to NLP. Now, in continuation of that part, in this article, we will cover the next techniques involved in the NLP pipeline of Text preprocessing. In this article, we will first discuss […]

Read more
Beginner, Data Cleaning, NLP, Python, Text, Unstructured Data, Word Embeddings

Part- 6: Step by Step Guide to Master Natural Language Processing (NLP) in Python

This article was published as a part of the Data Science Blogathon Introduction This article is part of an ongoing blog series on Natural Language Processing (NLP). In the previous article of this series, we completed the statistical or frequency-based word embedding techniques, which are pre-word embedding era techniques. So, in this article, we will discuss the recent word-era embedding techniques. NOTE: In recent word-era embedding, there are many such techniques but in this article, we will discuss only the Word2Vec […]

Read more
Beginner, Data Cleaning, NLP, Python, Text

Part- 4: Step by Step Guide to Master Natural Language Processing in Python

This article was published as a part of the Data Science Blogathon Introduction This article is part of an ongoing blog series on Natural Language Processing (NLP). In the previous part of this blog series, we complete the initial steps involved in text cleaning and preprocessing that are related to NLP. Now, in continuation of that part, in this article, we will cover the next techniques involved in the NLP pipeline of Text preprocessing. In this article, we will first discuss […]

Read more
Beginner, Data Cleaning, Libraries, NLP, Python, Text Leave a comment

A Quick Guide to Text Cleaning Using the nltk Library

This article was published as a part of the Data Science Blogathon. Introduction NLTK is a string processing library that takes strings as input. The output is in the form of either a string or lists of strings. This library provides a lot of algorithms that helps majorly in the learning purpose. One can compare among different variants of outputs. There are other libraries as well like spaCy, CoreNLP, PyNLPI, Polyglot. NLTK and spaCy are most widely used. Spacy works […]

Read more
Data Cleaning, NLP Leave a comment

Issue #2 – Data Cleaning for Neural MT

25 Jul18 Issue #2 – Data Cleaning for Neural MT Author: Dr. Patrik Lambert, Machine Translation Scientist @ Iconic “Garbage in, Garbage out” – noisy data is a big problem for all machine learning tasks, and MT is no different. By noisy data, we mean bad alignments, poor translations, misspellings, and other inconsistencies in the data used to train the systems. Statistical MT systems are more robust, and can cope with up to 10% noise in the training data without […]

Read more