{"id":137,"date":"2020-10-20T11:49:51","date_gmt":"2020-10-20T11:49:51","guid":{"rendered":"https:\/\/wordlift.io\/ng\/?p=137"},"modified":"2021-09-15T07:38:54","modified_gmt":"2021-09-15T07:38:54","slug":"text-summarization-in-seo","status":"publish","type":"post","link":"https:\/\/wordlift.io\/ng\/text-summarization-in-seo\/","title":{"rendered":"Text Summarization in SEO with the Help of AI"},"content":{"rendered":"\n

In the last two decades, text summarization has played an essential role in search engine optimization (SEO<\/a>). There are, indeed, a lot of different marketing techniques that require a summary of the content, and that can improve ranking in search engines. Meta descriptions<\/em> are probably among the most notable examples (here is a video tutorial that Andrea did on generating meta descriptions<\/a>).<\/p>\n\n\n\n

These text snippets provide search engines with a brief description of the page content and are still an important ranking factor and one of the most common use cases for text summarization.<\/p>\n\n\n\n

Thanks to the latest NLP technologies, SEO specialists can finally summarize the content of entire webpages using algorithms that craft easy-to-read summaries.<\/p>\n\n\n\n

In this article, we will discuss the importance of using text summarization in the context of SEO and digital marketing.<\/p>\n\n\n\n

Summaries help create and structure the metadata that describes web pages. Text summarization also comes in handy when we want to add descriptive text to category pages for magazines and eCommerce websites or when we need to prepare the copy for promoting our latest article to Facebook or Twitter. Much like search engines use meta descriptions, social networks rely on their meta descriptors like the Facebook Open Graph meta tag (a.k.a. OG tag) to distribute content to their users. Facebook for instance, uses the summary provided in OG tags to create the card that promotes a blog post on mobile and desktop devices.<\/p>\n\n\n\n

Extractive vs Abstractive<\/h2>\n\n\n\n

There are many different text summarization approaches, and they vary depending on the number of input documents, purpose, and output. But, they all fall into one of two categories: extractive<\/strong> or abstractive<\/strong>.<\/p>\n\n\n\n

Extractive<\/strong> summarization algorithms identify essential sections of a text and generate verbatim to produce a subset of the sentences from the original input. <\/p>\n\n\n\n

Extractive<\/strong> summaries are reliable because they will not change the meaning of any sentence. They are generally easier to program. It’s very logical, and in the most straightforward implementations, the most common words in the source text are the words that represent the main topic. Using today’s pre-trained Transformer models with their ground-breaking performance, we can achieve excellent results with the extractive approach.<\/p>\n\n\n\n

In WordLift, for instance, BERT is used to boost the performance of extractive summarization across different languages. Here is the summary that WordLift creates for me for this article that you are reading.<\/p>\n\n\n\n

In the last two decades, text summarization has played an essential role in search engine optimization (SEO). While our existing BERT-based summarization API performs well in German, we wanted to create unique content<\/strong> instead of only shrinking the existing text.<\/p><\/blockquote>\n\n\n\n

\"\"<\/figure>\n\n\n\n

It is quite useful in summarizing, using the most important sentences, the content that I am writing here, and it is formally correct (or at least as valid as my writing) but not unique.<\/p>\n\n\n\n

\"\"
Using Transformers in extractive text summarization.<\/figcaption><\/figure>\n\n\n\n

Abstractive Text Summarization<\/h3>\n\n\n\n

Abstractive<\/strong> methodologies summarize texts differently, using deep neural networks to interpret, examine, and generate new content (summary), including essential concepts from the source.<\/p>\n\n\n\n

Abstractive<\/strong> approaches are more complicated: you will need to train a neural network that understands the content and rewrites it.<\/p>\n\n\n\n

In general, training a language model to build abstract summaries is challenging and tends to be more complicated than using the extractive approach. Abstractive summarization might fail to preserve the meaning of the original text and generalizes less than extractive summarization.     <\/p>\n\n\n\n

As humans, when we try to summarize a lengthy document, we first read it entirely very carefully to develop a better understanding; secondly, we write highlights for its main points. As computers lack most of our human knowledge, they still struggle to generate summaries’ human-level quality. <\/p>\n\n\n\n

Moreover, using abstractive approaches also poses the challenge of supporting multilingualism. The model needs to be trained for each language separately.<\/p>\n\n\n\n

Training our new model for German using Google’s T5<\/h2>\n\n\n\n
\"\"
T5 text-to-text framework pre-trained on a multi-task mixture of NLP unsupervised and supervised tasks.<\/figcaption><\/figure>\n\n\n\n

As part of the WordLift NG project and, on behalf of one of our German-speaking clients, we ventured into creating a new pre-trained language model for automatic text summarization in German<\/strong>. While our existing BERT-based summarization API performs well in German, we wanted to create unique content<\/em> instead of only shrinking the existing text. <\/p>\n\n\n\n

T5 “the Text-To-Text Transfer Transformer Model<\/strong>” is Google’s state of the art LM, which was proposed earlier this year in the paper, “Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer<\/a>.”  <\/p>\n\n\n\n

This new language model is revolutionary as we can re-use the same model for different NLP tasks, including summarization. T5 is also language-agnostic<\/strong>, and we can use it with any language.<\/p>\n\n\n\n

We successfully trained the new summarizer on a dataset of 100,000 texts together with reference summaries extracted from the German Wikipedia. Here is a result where we see the input summary that was provided along with the full text of the Wikipedia page on Leopold Wilhelm<\/a> and the predicted summary generated by the model.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Conclusions and future work<\/h2>\n\n\n\n

We are very excited about this new line of work and we will continue experimenting new ways to help editors, SEOs and website owners improve their publishing workflows with the help of NLP<\/a>, knowledge graphs and deep learning!<\/p>\n\n\n\n

WordLift provides websites with all the AI you need to grow your traffic \u2014 whether you want to increase leads, accelerate sales on your e-commerce or build a powerful website. Let’s talk with our expert<\/a> to find out more!<\/p><\/blockquote>\n\n\n","protected":false},"excerpt":{"rendered":"

In the last two decades, text summarization has played an essential role in search engine optimization (SEO). There are, indeed, a lot of different marketing techniques that require a summary of the content, and that can improve ranking in search engines. Meta descriptions are probably among the most notable examples (here is a video tutorial that Andrea … Continued<\/a><\/p>\n","protected":false},"author":2827,"featured_media":145,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"wl_entities_gutenberg":"","_et_pb_use_builder":"off","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"categories":[2],"tags":[],"wl_entity_type":[33,26,25],"class_list":["post-137","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-the-project","wl_entity_type-article","wl_entity_type-creative-work","wl_entity_type-thing"],"acf":[],"yoast_head":"\nText Summarization in SEO with the Help of AI - WordLift New Generation<\/title>\n<meta name=\"description\" content=\"Thanks to NLP, SEO specialists can finally summarize the content of entire webpages using algorithms that craft easy-to-read summaries.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/wordlift.io\/blog\/en\/text-summarization-in-seo\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Text Summarization in SEO with the Help of AI - WordLift New Generation\" \/>\n<meta property=\"og:description\" content=\"Thanks to NLP, SEO specialists can finally summarize the content of entire webpages using algorithms that craft easy-to-read summaries.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/wordlift.io\/blog\/en\/text-summarization-in-seo\/\" \/>\n<meta property=\"og:site_name\" content=\"WordLift New Generation\" \/>\n<meta property=\"article:published_time\" content=\"2020-10-20T11:49:51+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-09-15T07:38:54+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/wordlift.io\/ng\/wp-content\/uploads\/sites\/2\/2020\/10\/nlp-text-summarization.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1080\" \/>\n\t<meta property=\"og:image:height\" content=\"675\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"raffal\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"raffal\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/wordlift.io\/ng\/text-summarization-in-seo\/\",\"url\":\"https:\/\/wordlift.io\/blog\/en\/text-summarization-in-seo\/\",\"name\":\"Text Summarization in SEO with the Help of AI - WordLift New Generation\",\"isPartOf\":{\"@id\":\"https:\/\/wordlift.io\/ng\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/wordlift.io\/blog\/en\/text-summarization-in-seo\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/wordlift.io\/blog\/en\/text-summarization-in-seo\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/wordlift.io\/ng\/wp-content\/uploads\/sites\/2\/2020\/10\/nlp-text-summarization.png\",\"datePublished\":\"2020-10-20T11:49:51+00:00\",\"dateModified\":\"2021-09-15T07:38:54+00:00\",\"author\":{\"@id\":\"https:\/\/wordlift.io\/ng\/#\/schema\/person\/b1b68f73a7df97ec8dd237ab0f4e9a4b\"},\"description\":\"Thanks to NLP, SEO specialists can finally summarize the content of entire webpages using algorithms that craft easy-to-read summaries.\",\"breadcrumb\":{\"@id\":\"https:\/\/wordlift.io\/blog\/en\/text-summarization-in-seo\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/wordlift.io\/blog\/en\/text-summarization-in-seo\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/wordlift.io\/blog\/en\/text-summarization-in-seo\/#primaryimage\",\"url\":\"https:\/\/wordlift.io\/ng\/wp-content\/uploads\/sites\/2\/2020\/10\/nlp-text-summarization.png\",\"contentUrl\":\"https:\/\/wordlift.io\/ng\/wp-content\/uploads\/sites\/2\/2020\/10\/nlp-text-summarization.png\",\"width\":1080,\"height\":675},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/wordlift.io\/blog\/en\/text-summarization-in-seo\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/wordlift.io\/ng\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Text Summarization in SEO with the Help of AI\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/wordlift.io\/ng\/#website\",\"url\":\"https:\/\/wordlift.io\/ng\/\",\"name\":\"WordLift New Generation\",\"description\":\"The Future of AI-Powered SEO\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/wordlift.io\/ng\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/wordlift.io\/ng\/#\/schema\/person\/b1b68f73a7df97ec8dd237ab0f4e9a4b\",\"name\":\"raffal\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/wordlift.io\/ng\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/78a1ee70fd249194558ac5b056627873?s=96&d=blank&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/78a1ee70fd249194558ac5b056627873?s=96&d=blank&r=g\",\"caption\":\"raffal\"},\"url\":\"https:\/\/wordlift.io\/ng\/author\/raffal\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Text Summarization in SEO with the Help of AI - WordLift New Generation","description":"Thanks to NLP, SEO specialists can finally summarize the content of entire webpages using algorithms that craft easy-to-read summaries.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/wordlift.io\/blog\/en\/text-summarization-in-seo\/","og_locale":"en_US","og_type":"article","og_title":"Text Summarization in SEO with the Help of AI - WordLift New Generation","og_description":"Thanks to NLP, SEO specialists can finally summarize the content of entire webpages using algorithms that craft easy-to-read summaries.","og_url":"https:\/\/wordlift.io\/blog\/en\/text-summarization-in-seo\/","og_site_name":"WordLift New Generation","article_published_time":"2020-10-20T11:49:51+00:00","article_modified_time":"2021-09-15T07:38:54+00:00","og_image":[{"width":1080,"height":675,"url":"https:\/\/wordlift.io\/ng\/wp-content\/uploads\/sites\/2\/2020\/10\/nlp-text-summarization.png","type":"image\/png"}],"author":"raffal","twitter_card":"summary_large_image","twitter_misc":{"Written by":"raffal","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/wordlift.io\/ng\/text-summarization-in-seo\/","url":"https:\/\/wordlift.io\/blog\/en\/text-summarization-in-seo\/","name":"Text Summarization in SEO with the Help of AI - WordLift New Generation","isPartOf":{"@id":"https:\/\/wordlift.io\/ng\/#website"},"primaryImageOfPage":{"@id":"https:\/\/wordlift.io\/blog\/en\/text-summarization-in-seo\/#primaryimage"},"image":{"@id":"https:\/\/wordlift.io\/blog\/en\/text-summarization-in-seo\/#primaryimage"},"thumbnailUrl":"https:\/\/wordlift.io\/ng\/wp-content\/uploads\/sites\/2\/2020\/10\/nlp-text-summarization.png","datePublished":"2020-10-20T11:49:51+00:00","dateModified":"2021-09-15T07:38:54+00:00","author":{"@id":"https:\/\/wordlift.io\/ng\/#\/schema\/person\/b1b68f73a7df97ec8dd237ab0f4e9a4b"},"description":"Thanks to NLP, SEO specialists can finally summarize the content of entire webpages using algorithms that craft easy-to-read summaries.","breadcrumb":{"@id":"https:\/\/wordlift.io\/blog\/en\/text-summarization-in-seo\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/wordlift.io\/blog\/en\/text-summarization-in-seo\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/wordlift.io\/blog\/en\/text-summarization-in-seo\/#primaryimage","url":"https:\/\/wordlift.io\/ng\/wp-content\/uploads\/sites\/2\/2020\/10\/nlp-text-summarization.png","contentUrl":"https:\/\/wordlift.io\/ng\/wp-content\/uploads\/sites\/2\/2020\/10\/nlp-text-summarization.png","width":1080,"height":675},{"@type":"BreadcrumbList","@id":"https:\/\/wordlift.io\/blog\/en\/text-summarization-in-seo\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/wordlift.io\/ng\/"},{"@type":"ListItem","position":2,"name":"Text Summarization in SEO with the Help of AI"}]},{"@type":"WebSite","@id":"https:\/\/wordlift.io\/ng\/#website","url":"https:\/\/wordlift.io\/ng\/","name":"WordLift New Generation","description":"The Future of AI-Powered SEO","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/wordlift.io\/ng\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/wordlift.io\/ng\/#\/schema\/person\/b1b68f73a7df97ec8dd237ab0f4e9a4b","name":"raffal","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/wordlift.io\/ng\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/78a1ee70fd249194558ac5b056627873?s=96&d=blank&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/78a1ee70fd249194558ac5b056627873?s=96&d=blank&r=g","caption":"raffal"},"url":"https:\/\/wordlift.io\/ng\/author\/raffal\/"}]}},"_wl_alt_label":["natural language processing","Natural Language Processing"],"wl:entity_url":"https:\/\/data.wordlift.io\/wl78784\/post\/text_summarization_in_seo_with_the_help_of_ai","_links":{"self":[{"href":"https:\/\/wordlift.io\/ng\/wp-json\/wp\/v2\/posts\/137"}],"collection":[{"href":"https:\/\/wordlift.io\/ng\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wordlift.io\/ng\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/wordlift.io\/ng\/wp-json\/wp\/v2\/users\/2827"}],"replies":[{"embeddable":true,"href":"https:\/\/wordlift.io\/ng\/wp-json\/wp\/v2\/comments?post=137"}],"version-history":[{"count":6,"href":"https:\/\/wordlift.io\/ng\/wp-json\/wp\/v2\/posts\/137\/revisions"}],"predecessor-version":[{"id":266,"href":"https:\/\/wordlift.io\/ng\/wp-json\/wp\/v2\/posts\/137\/revisions\/266"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/wordlift.io\/ng\/wp-json\/wp\/v2\/media\/145"}],"wp:attachment":[{"href":"https:\/\/wordlift.io\/ng\/wp-json\/wp\/v2\/media?parent=137"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wordlift.io\/ng\/wp-json\/wp\/v2\/categories?post=137"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wordlift.io\/ng\/wp-json\/wp\/v2\/tags?post=137"},{"taxonomy":"wl_entity_type","embeddable":true,"href":"https:\/\/wordlift.io\/ng\/wp-json\/wp\/v2\/wl_entity_type?post=137"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}