什么是总结?
文本摘要简单来说就是对一段文本进行总结,使其更加简短。
生成式人工智能模型,如 GPT-5、GPT-4、LLaMA 3、Yi 34B 和 Mixtral 8x7B,在执行文本摘要方面非常出色。
比方说,您有以下文本块:
The tower is 324 metres (1,063 ft) tall, about the same height as an 81-storey building, and
the tallest structure in Paris. Its base is square, measuring 125 metres (410 ft) on each side.
During its construction, the Eiffel Tower surpassed the Washington Monument to become the tallest
man-made structure in the world, a title it held for 41 years until the Chrysler Building in New
York City was finished in 1930. It was the first structure to reach a height of 300 metres. Due to
the addition of a broadcasting aerial at the top of the tower in 1957, it is now taller than the
Chrysler Building by 5.2 metres (17 ft). Excluding transmitters, the Eiffel Tower is the second
tallest free-standing structure in France after the Millau Viaduct.
这段技术描述相当冗长,对于普通读者来说,也许并不需要所有这些细节就能掌握大意。因此,我们现在希望利用机器学习来自动总结这段文字。
总结模型的返回值是这样的
The tower is 324 metres (1,063 ft) tall, about the same height as an 81-storey building. Its
base is square, measuring 125 metres (410 ft) on each side. During its construction, the Eiffel
Tower surpassed the Washington Monument to become the tallest man-made structure in the world.
有趣吧?正如你所看到的,总体思路依然存在,但大量细节被删除了。这使得文字只有最初的一半大小!
摘要有多种类型。例如,"标题生成 "就是生成非常适合博客或新闻标题的简短句子。"对话摘要 "是指将整段对话转换成浓缩版本。"提取式摘要 "是指摘要仅由原文中的句子构成,而 "抽象式摘要 "是指在摘要中可以创建新的内容。