Keyword/Keyphrase Extraction API, With Generative Models

What is Keyword/Keyphrase Extraction and Why Use Generative AI?

Keyword extraction is about extracting one or several important words from a piece of text. These words must be core ideas from the text.

For example, imagine you have the following content:

Information Retrieval (IR) is the process of obtaining resources relevant to the information need. For instance, a search query on a web search engine can be an information need. The search engine can return web pages that represent relevant resources.

The important keywords in this example could be information, resources, search.

If keywords are too simple, you might want to extract keyphrases: a combination of several words. For example, in the above content, important keyphrases could be information retrieval, relevant resources, search query, search engine.

Performing keyword and keyphrase extraction is harder than it sounds. It takes an advanced AI model to understand the core ideas from a piece of text.

LLaMA 3, Dolphin, Yi 34B, and Mixtral 8x7B are advanced alternatives to GPT-4, GPT-3.5, and ChatGPT. These models are so complex that they can adapt to many situations, and perfectly sound like a human. For advanced use cases, it is possible to fine-tune your own models (train them with your own data), which is a great way to perform keyword and keyphrase extraction that is perfectly tailored to your company/product/industry.

Intent classification

Why Use Keyword/Keyphrase Extraction?

Keyword and keyphrase extractions are a great way to instantly have a good grasp on a piece of text, and potentially categorize the text for later use. Here are a couple of examples:

Social Media Analysis

Tons of ideas are written in social media and you might want to understand the main ideas behind this chaos. With keyword/keyphrase extraction you can instantly do this.

Customers' Feedbacks

Asking for customers' feedbacks is great practice, but it takes a lot of time to properly analyze the results. You can easily perform qualitative analysis thanks to keyword/keyphrase extraction.

Competition Monitoring

Do you want to monitor the brand of your competitors? You can easily do it by retrieving their content and get the most important ideas.


Finding the right keywords for your positioning can be tricky. A strategy could be to analyze your competitor's websites, and understand which keywords they are positioning on.

NLP Cloud's Keyword/Keyphrase Extraction API

NLP Cloud proposes a keyword/keyphrase extraction API based on generative models like LLaMA 3, Dolphin, Yi 34B, Mixtral 8x7B, and more, that give you the opportunity to perform extraction out of the box. These models are very good alternatives to ChatGPT, GPT-3.5, and GPT-4. If the base generative model is not enough, you can also fine-tune/train your own model on NLP Cloud and automatically deploy the new model to production with only one click.

For more details, see our documentation about keywords and keyphrases extraction with generative models here. For advanced usage, see the text generation API endpoint here. And easily test keywords and keyphrases extraction on our playground.

Frequently Asked Questions

What is keywords/keyphrases extraction?

Keywords/keyphrases extraction is the process of identifying and extracting the most relevant words or phrases from a text that best represent its content. This technique is crucial for enhancing search engine optimization (SEO), content summarization, and helping with content analysis.

Why is keywords/keyphrases extraction important for SEO?

Keywords/keyphrases extraction is crucial for SEO because it helps identify the terms and phrases most relevant to your content, guiding search engines in ranking your website more effectively. This process ensures that your content can be easily discovered by users searching for topics you cover, improving your site's visibility and traffic.

What’s the difference between keyword extraction and keyphrase extraction?

Keyword extraction involves identifying individual words that are significant within a text, while keyphrase extraction focuses on extracting phrases or groups of words that collectively provide meaningful insights or summaries of the text. Essentially, keywords are single terms, whereas keyphrases encompass more context by combining multiple words.

What are the supported languages or locales for this keywords extraction API?

Our keywords extraction API supports 200 languages

Can I try the keywords extraction API for free?

Yes, like all the API endpoints on NLP Cloud, the keywords extraction API can be tested for free.

How does your AI API handle data privacy and security during the keywords extraction process?

NLP Cloud is focused on data privacy by design: we do not log or store the content of the requests you make on our API. NLP Cloud is both HIPAA and GDPR compliant.