Create a Text Generation Web App with 100% Python (NLP)

GPT-3 是 OpenAI 创建的最先进的文本生成自然语言处理 (NLP) 模型。您可以使用它来生成类似于人类生成的文本的文本。

本课程将介绍如何创建使用 GPT-3 开源版本 GPT-Neo 和 100% Python 的 Web 应用程序。没错，不需要 HTML、Javascript、CSS 或任何其他编程语言。只是 100% 的 Python！

你将学到如何：

使用 Happy Transformer 实现 GPT-Neo（和 GPT-2）

训练 GPT-Neo 为特定域生成唯一文本

使用 100% Python 和 Anvil 创建一个 Web 应用程序！

使用 Google Colab 和 Paperspace 托管您的语言模型

安装：

没有任何！！！我们在本教程中使用的所有工具都是基于 Web 的。它们包括 Google Colab、Anvil 和 Paperspace。因此，无论您使用的是 Mac、Windows 还是 Linux，您都不必担心下载任何软件。

技术：

模型：GPT-Neo——由 Eleuther AI 创建的 GPT-3 的开源版本

框架：Happy Transformer——一个开源的 Python 包，让我们只需几行代码就可以实现和训练 GPT-Neo

Web 技术：Anvil——一个允许我们使用 Python 开发 Web 应用程序的网站

后端技术：我们将介绍如何使用 Google Colab 和 Paperspace 来托管模型。Anvil 自动涵盖托管 Web 应用程序。

关于导师：

我叫 Eric Fillion，来自加拿大。我的使命是通过创建开源工具和创建教育内容，在 NLP 领域取得最先进的进步。2020 年初，我带领一个团队推出了一个名为 Happy Transformer 的开源 Python 包。Happy Transformer 允许程序员仅用几行代码来实现和训练最先进的 Transformer 模型。自发布以来，它屡获殊荣，下载量超过 13,000 次。

MP4 | Video: h264, 1280×720 | Audio: AAC, 44.1 KHz, 2 Ch
Genre: eLearning | Language: English + srt | Duration: 36 lectures (1h 57m) | Size: 841.4 MB

Harness GPT-Neo — a natural language processing (NLP) text generation model. Demonstrate it with a 100% Python web app

What you’ll learn:
How to implement state-of-the-art text generation AI models
Background information about GPT-Neo, a state-of-the-art text generation NLP model
How to use Happy Transformer — a Python library for implementing NLP Transformer models
How to train/implement GPT-2
How to implement different text generation algorithms
How to fetch data using Hugging Face’s Datasets library
How to train GPT-Neo using Happy Transformer
How to create a web app with 100% Python using Anvil
How to host a Transformer model on Paperspace

Requirements
A solid understanding of basic Python syntax
A Google account (for Google Colab)

Description
GPT-3 is a state-of-the-art text generation natural language processing (NLP) model created by OpenAI. You can use it to generate text that resembles text generated by a human.

This course will cover how to create a web app that uses an open-source version of GPT-3 called GPT-Neo with 100% Python. That’s right, no HTML, Javascript, CSS or any other programming language is required. Just 100% Python!

You will learn how to:

Implement GPT-Neo (and GPT-2) with Happy Transformer

Train GPT-Neo to generate unique text for a specific domain

Create a web app using 100% Python with Anvil!

Host your language model using Google Colab and Paperspace

Installations:

NONE!!! All of the tools we use in this tutorial are web-based. They include Google Colab, Anvil and Paperspace. So regardless of if you’re on Mac, Windows or Linux, you will not have to worry about downloading any software.

Technologies:

Model: GPT-Neo — an open-source version of GPT-3 created by Eleuther AI

Framework: Happy Transformer — an open-source Python package that allows us to implement and train GPT-Neo with just a few lines of code

Web technologies: Anvil — a website that allows us to develop web app using Python

Backend technologies: We’ll cover how to use both Google Colab and Paperspace to host the model. Anvil automatically covers hosting the web app.

About the instructor:

My name is Eric Fillion, and I’m from Canada. I’m on a mission to make state-of-the-art advances in the field of NLP through creating open-source tools and by creating educational content. In early 2020, I led a team that launched an open-source Python Package called Happy Transformer. Happy Transformer allows programmers to implement and train state-of-the-art Transformer models with just a few lines of code. Since its release, it has won awards and has been downloaded over 13k times.

Requirements:

A basic understanding of Python

A google account — for Google Colab

Who this course is for
Python developers interested in AI and NLP