OpenAI’s GPT-2: A Simple Guide to Build the World’s Most Advanced Text Generator in Python
Overview
- Learn how to build your own text generator in Python using OpenAI’s GPT-2 framework
- GPT-2 is a state-of-the-art NLP framework – a truly incredible breakthrough
- We will learn how it works and then implements our own text generator using GPT-2
Introduction
“The world’s best economies are directly linked to a culture of encouragement and positive feedback.”
Can you guess who said that? It wasn’t a President or Prime Minister. It certainly wasn’t a leading economist like Raghuram Rajan. All out of guesses?
This quote was generated by a machine! That’s right – a Natural Language Processing (NLP) model trained on OpenAI’s GPT-2 framework came up with that very real quote. The state of machine learning right now is on another level entirely, isn’t it?
In the midst of what is truly a golden era in NLP, OpenAI’s GPT-2 has remoulded the way we work with text data. Where ULMFiT and Google’s BERT eased open the door for NLP enthusiasts, GPT-2 has smashed it in and