Summarization API, with Generative AI

What is Summarization?

Text summarization simply is the process of summarizing a block of text in order to make it shorter.

Generative AI models like ChatGPT, GPT-3.5, GPT-4, LLaMA 3, Yi 34B, and Mixtral 8x7B, are very good at performing text summarization.

Let's say you have the following block of text:

This technical description is quite long and maybe not all these details are necessary for a common reader to grasp the general idea. So we now want to leverage machine learning in order to automatically summarize this piece of text.

A summarization model would return something like this:

Interesting isn't it? As you can see, the general idea is still there, but tons of details were stripped. It makes the text half its initial size!

There are several types of summarizations. For example "headline generation" is about generating a very short sentence, perfectly suited for a blog or news title. "Dialogue summarization" is about converting a whole dialogue into a condensed version. "Extraction summarization" means that the summary is only made of sentences from the original text, while "abstractive summarization" means that new content can be created in the summary.

NLP Cloud's Summarization API

NLP Cloud proposes a text summarization API that allows you to perform summarization out of the box, based on several advanced AI models like Meta's Bart Large CNN model and Google T5, and even generative AI models like LLaMA 3, Yi 34B, and Mixtral 8x7B. These models are very good alternatives to ChatGPT, GPT-3.5, and GPT-4. You can either use our pre-trained model, train your own models, or upload your own custom models!

For more details, see our documentation about text summarization here.

Testing text summarization locally is one thing, but using it reliably in production is another thing. With NLP Cloud you can just do both!