Wikipedia

Draft:IndexNow

  • Comment: You have two conflicting schemes of referencing. Which do we check. Please consolidate these into a single scheme
    Your section "Participating Content Management Systems (CMS) and Content Delivery Networks (CDN)" appears to be a linkfarm. Please deal with that. All inline links should be removed, please, and turned into references if appropriate, Wikilinks, or external links in a section so named. See Wikipedia:External links. There should be no links pointing to external sources until those in the 'References' section (with the exception of one optional link in any infobox).
    These two items hinder a positive review 🇺🇦 FiddleTimtrent FaddleTalk to me 🇺🇦 20:35, 18 July 2024 (UTC)
  • Comment: On Wikipedia, all stated facts should be supported by a citation to a reliable source. Currently, portions of this draft are unsourced - please add necessary citations before resubmitting. Thank you.
    On Wikipedia, external links should not be placed in the body of an article. Please remove these before resubmitting. If you want to convert these links to references, see Referencing for beginners for assistance. ~Liancetalk 22:47, 24 May 2024 (UTC)
  • Comment: Topic simply isn't notable. I did a check and found the only sources that could potentially be used are the SEO blogs which are already in the draft. These would not work to establish notability. CNMall41 (talk) 23:39, 27 April 2023 (UTC)
  • Comment: Wikipedia is not a "how to". Theroadislong (talk) 15:56, 27 April 2023 (UTC)
  • Comment: The IndexNow website is a primary source and blog sites (such as blogs.bing.com) are not acceptable or reliable sources either. Dan arndt (talk) 06:11, 27 April 2023 (UTC)

IndexNow

edit

IndexNow is a free open-source web indexing protocol introduced by Microsoft and Yandex[1] in October 2021 to address the inefficiencies of traditional web crawling. Traditional search engines rely on web crawlers to discover changes on the web, which can take few days or weeks to communicate and list content in search engine results pages (SERPs).  

IndexNow aims to streamline this process by enabling real-time content notifications from websites to search engines. The protocol allows website owners to communicate their content changes immediately to search engines when a web page's content is created, updated, or deleted, thereby facilitating faster and more efficient indexing.  [2]

Functionality

edit

IndexNow operates using a "push" mechanism, as opposed to the traditional "pull" method used by most search engines.[3] The pull method involves web crawlers visiting a website and gathering data, which can take up to several weeks to communicate and list content in search engines.  

With push mechanisms like IndexNow, whenever a URL is added, updated, or deleted, a notification is "pushed" to participating search engines, prompting them to change their index immediately. This technology significantly speeds up the time it takes for web content to be updated in search results, reducing time and resource intensive crawling.

Implementation

edit

IndexNow is accessible through various content management systems and platforms. Website owners can also generate an API key from the IndexNow protocol website and place it in their site's root directory. They can use this key to send HTTP requests to inform search engines about any changes made to a URL or a set of URLs, whether they have been added, updated, or deleted.[4]

For one URL: 

https://<searchengine>/indexnow?url=url-changed&key=your-key

For a set of URLs: 

POST /indexnow HTTP/1.1
Content-Type: application/json; charset=utf-8
Host: <searchengine>
{
  "host": "www.example.com",
  "key": "c0bc5d372dee4fd5b6cc80db430b007a",
  "urlList": [
      "https://www.example.com/url1",
      "https://www.example.com/folder/url2",
      "https://www.example.com/url3"
      ]
}

The key, UTF=8 text file, is managed and hosted by the web site at the root of their host.

The search engine endpoints are published on the protocol site[5].

Bing Webmaster Tools provides a method for website owners to view IndexNow's indexing performance, learn about errors and pull reports on URLs submitted, crawled, and indexed.

Supported Search Engines

edit

IndexNow is currently supported by Bing, Yandex, Naver, Seznam, and Yep. Search Engines supporting the IndexNow protocol agree to share all submitted key-validated URLs with all other IndexNow search engines.[6]

Participating Content Management Systems (CMS) and Content Delivery Networks (CDN)

edit

Several CMS and CDN providers have integrated support for the IndexNow push mechanism:

Content Management Systems:

  • WordPress
  • Wix
  • Duda
  • Xenforo

Cloud Delivery Networks

  • Cloudflare

Third-Party Plug-ins

  • WordPress
  • IndexNow plugin
  • Yoast
  • RankMath
  • AIOSEO
  • SEOPress
  • Shopify
  • InstaIndex
  • Joomla
  • Aimy Sitemap PRO
  • JSitemap
  • Bitrix24
  • ReIndex (Russian)
  • TurboIndex (Russian)
  • Drupal
  • PrestaShop
  • MODX
  • Shopware
  • Opencart
  • Typo3
  • Umbraco

History

edit

Microsoft, Yandex announced IndexNow in Oct 2021. Created by Microsoft Bing and Yandex as an open-source protocol allowing all search engines with a significant presence in at least one market to participate.[7]

CloudFlare announced IndexNow Support in Oct 2021.[8]

Duda Content Management System enabled IndexNow for all sites in Nov 2021[9]

IndexNow sharing between search engines began in Jan 2022[6]

Seznam.cz was the third search engine joining IndexNow in March 2022[10]

During spring 2022, major SEO plugins as Yoast SEO[11], AIOSEO[12], Rank Math[13], SEOPress[14] started to support IndexNow.

Microsoft announced in August 2022 than more than 16 million web sites are publishing over 1.2 billion URLs per day to the IndexNow API. In August 2022 IndexNow attributed to 7% of all new URLs clicked in their search results.[15]

Naver was the fourth search engine joining IndexNow in July 2023[16] [17]

September 2023 Wix announces automatic notifications to IndexNow for premium websites.[18]

October 2023 IndexNow reaches 1.4 billion URLs and 60 million websites submissions per day.[15]

March 2024 Ahref and its search engine Yep announce support for IndexNow.[19]

References

edit
  1. ^ Schwartz, Barry (2021-10-19). "IndexNow - Ping Search Engines With URLs For Instant Indexing". Search Engine Roundtable. Retrieved 2024-05-28.
  2. ^ Schwartz, Barry (2022-02-25). "IndexNow integrations grow as Bing says 'millions' of sites are using it". Search Engine Land. Retrieved 2024-05-28.
  3. ^ "Website Indexing For Search Engines: How Does It Work?". Search Engine Journal. 2023-01-17. Retrieved 2024-07-22.
  4. ^ Toonen, Edwin (2022-06-23). "IndexNow: What it is and how it benefits you". Yoast. Retrieved 2024-07-22.
  5. ^ "FAQ | IndexNow.org". www.indexnow.org. Retrieved 2024-07-22.
  6. ^ a b Southern, Matt G. (2022-01-13). "IndexNow Enables Data Sharing Between Search Engines". Search Engine Journal. Retrieved 2024-05-23.
  7. ^ Montti, Roger (2021-10-18). "IndexNow is a Major Change to Search Engine Indexing". Search Engine Journal. Retrieved 2023-04-25.
  8. ^ "Crawler Hints Update: Cloudflare Supports IndexNow and Announces General Availability". Cloudflare. 18 October 2021. Retrieved 18 October 2021.
  9. ^ "IndexNow: Enabled for All Duda Sites". duda. 10 November 2021. Retrieved 10 November 2021.
  10. ^ "Máte nový obsah? Dejte o něm hned všem vědět pomocí IndexNow". seznam (in Czech). 23 March 2022. Retrieved 23 March 2022.
  11. ^ Toonen, Edwin (28 June 2022). "We're launching an IndexNow integration in Yoast SEO". Yoast.com. Retrieved 28 June 2022.
  12. ^ "IndexNow : Get your pages indexed instantly by search engines". aioseo. 4 February 2022.
  13. ^ "How to Use IndexNow with Rank Math?". rankmath. 25 January 2022.
  14. ^ "Google & Bing Instant Indexing". seopress.
  15. ^ a b Hines, Kristi (2023-10-27). "IndexNow Celebrates Two Years With 1.4 Billion URLs Submitted Daily". Search Engine Journal. Retrieved 2024-05-23.
  16. ^ "네이버 검색에서 IndexNow 프로토콜을 지원합니다. [출처] 네이버 검색에서 IndexNow 프로토콜을 지원합니다". naver (in Kanuri). 27 July 2023. Retrieved 27 July 2023.
  17. ^ "Naver, Korean search engine, now supports IndexNow". Search Engine Land. 26 July 2023. Retrieved 26 July 2023.
  18. ^ Nguyen, George (2023-09-21). "Wix joins Bing and IndexNow for faster search indexing". Wix SEO Hub. Retrieved 2024-05-23.
  19. ^ Stox, Patrick (2024-03-05). "Yep & Ahrefs Support IndexNow. Fresher Data, Faster Indexing, & Announcing a Game-Changing Site Audit Feature". SEO Blog by Ahrefs. Retrieved 2024-05-23.
  1. Official Protocol Website
  2. Bing IndexNow Webpage
  3. https://www.msn.com/en-us/news/technology/niche-blogging-in-the-new-google-reality-5-strategies-to-thrive-or-die/ar-BB1mIx6n
  4. https://lazarinastoy.com/the-ultimate-guide-to-microsoft-indexnow-api-indexation-protocol-for-search-engines-with-python-code-examples/
  5. https://www.cjco.com.au/article/news/naver-embraces-indexnow-protocol-unpacking-implications-steps-and-gains-for-web-content-efficiency/
  6. https://www.searchenginejournal.com/indexnow-enables-data-sharing-between-search-engines/432951/
  7. https://searchengineland.com/indexnow-new-initiative-by-microsoft-and-yandex-to-push-content-to-search-engines-375247
  8. https://www.bluehost.com/blog/indexnow-latest-bing-initiative-crawling/#:~:text=How%20To%20Get%20Started%20With%20IndexNow%201%201.,URLs%20...%204%204.%20Monitor%20Your%20Site%20
  9. https://searchengineland.com/google-is-testing-the-indexnow-protocol-for-sustainability-375932
  10. https://www.searchenginejournal.com/indexnow/423791/
  11. https://yoast.com/what-is-indexnow/
  12. https://ziptie.dev/indexnow/
  13. https://www.kinexmedia.com/blog/google-decides-to-give-indexnow-protocol-a-try/
  14. https://www.drupal.org/project/index_now
  15. https://seo.london/indexnow-how-bings-new-indexing-protocol-works
  16. https://www.searchenginejournal.com/search-engines/website-indexing/
  17. https://searchengineland.com/google-is-testing-the-indexnow-protocol-for-sustainability-375932
Retrieved from "https://en.wikipedia.org/w/index.php?title=Draft:IndexNow&oldid=1249091814"