# Pulse ยท October 31, 2026 > Google and OpenAI back a shared robots.txt AI training signal, Bing splits training from grounding, and Shopify opens paid product placements to AI agents. Canonical: https://brandonlazovic.dev/pulse/2026-10-31/ Author: Brandon Lazovic Published: 2026-10-31 ## Google And OpenAI Commit To Honoring A Shared robots.txt Signal For AI Training Status: Confirmed | Topics: crawling-indexing-rendering, llm-models-agents On October 30, Google and OpenAI each announced plans to honor a shared robots.txt policy token for AI training, drawn from the IETF's AIPREF working group. Google says a site using the token to opt out, without naming Google-Extended, will be read as if it disallowed Google-Extended. Both say existing crawler-specific controls keep working. Google aims to support it in 2027, and OpenAI says in the coming months. In plain terms: Today a site that wants to opt out of AI training has to list each company's crawler by name; a shared policy token is one agreed phrase in robots.txt that every participating company promises to read the same way. Why it matters: One line in robots.txt could soon cover several AI providers' training opt-outs, but it governs training only and does not change whether a page is fetched for search or retrieval. Our take: I read the citation study as showing that publishers blocked the bots that collect training data and left the retrieval bot open, so the citations kept coming. A shared training signal makes the first half of that easier to do, and it leaves the second half exactly where it was. - [Google Search Central Blog: Supporting a shared AI training control for websites](https://developers.google.com/search/blog/2026/10/ai-training-control) - [OpenAI: Making it easier for websites to express AI training preferences](https://openai.com/index/helping-websites-express-ai-training-preferences) ## Bing Splits AI Training And Grounding Into Separate Publisher Controls, Retiring NoArchive And NoCache Status: Confirmed | Topics: crawling-indexing-rendering, ai-overviews-ai-mode Microsoft's October 30 post adds two independent preferences. Training uses the shared robots.txt signal, set with a __usage_ai-training user agent, a meta tag or a header. Grounding is page-level only, with Allow, DisallowExtended or Disallow. New settings take effect February 1, 2027. After March 1, 2027, NoArchive and NoCache no longer count as a training or grounding preference. Normal Bing search eligibility is unchanged. In plain terms: Training means a company uses your pages to build its model, while grounding means its assistant reads your page at answer time to support a response; Bing now lets a page say yes to one and no to the other. Why it matters: A site that relies on NoArchive or NoCache to limit Copilot and Bing AI answers has until March 1, 2027 to publish page-level grounding settings, and choosing Disallow reduces its visibility in those answers. Our take: Grounding is the control that decides whether a page can be cited in a Copilot answer, so it is the setting with a visibility cost. Page-level only means a large site will need a template-level decision, not a robots.txt line. - [Bing Blogs: Your content, your choice: clearer preferences for training and grounding](https://blogs.bing.com/search/2026/10/your-content-your-choice-clearer-preferences-for-training-and-grounding/) ## Discord To Publish Every Discoverable Server As A Public Web Page, With Chat Messages In Search From Mid-December Status: Confirmed | Topics: organic-search-core, ai-overviews-ai-mode Discord announced on October 27 that from November 16 every Discoverable Server, more than 63,000 of them, gets a public Server Web Page with automated channel summaries. From mid-December, some public-channel messages may also appear on those pages and in web search. Admins can change channel settings before November 16. The member message setting is on by default except in the EU, UK, Canada, Brazil, Australia and South Korea. In plain terms: Until now Discord chats lived behind the app; this makes the public ones readable by anyone with a link, which also means a search engine can read and list them. Why it matters: A large body of community conversation becomes indexable text on discord.com, which creates a new source of search results and AI answer citations for brand and product questions. Our take: Forum threads already earn visibility in AI answers because they read like first-hand experience, and Discord messages will now compete for the same slot. Brands with an active Discord community should read what it says about them before a search result does. - [Discord: Making content from Discoverable Servers easier to discover](https://discord.com/blog/making-content-from-discoverable-servers-easier-to-discover) ## Shopify's AI Agent Catalog Adds Promoted Placements That Pay Agent Developers A Commission Status: Confirmed | Topics: agentic-commerce, product-feeds-shopping Shopify's developer documentation describes promoted placements in its catalog for AI shopping agents, in invite-only Developer Preview. When a shopper buys a promoted product, the agent's developer earns a 0.3% base commission. A merchant's Shop Campaigns can add more, with 1.5% shown as an example, but only when the purchase completes in Shop or on shop.com. Shopify says details are not final. In plain terms: Think of paid shelf placement in a store, except the shopper is an AI agent, and the agent's maker, not the store, collects a cut when the promoted item sells. Why it matters: A merchant's catalog position in agent results may soon depend on a funded campaign, and the higher commission pays only on purchases that complete in Shop, not on the merchant's own site. Our take: I argued that syndicating through Shopify Catalog makes Shopify the data gatekeeper for a merchant's AI-driven sales. Promoted placements add a price to that gate, and the documentation does not say whether a higher commission ranks a product higher. - [Shopify Dev Docs: Promoted placements](https://shopify.dev/docs/agents/catalog/promoted-placement) ## Google Expands Ads In AI Mode To Ten More Countries And Launches Multiturn Ads In The U.S. Status: Confirmed | Topics: ai-overviews-ai-mode, ads-paid Google said on October 28 that ads in AI Mode are now scaling to Australia, Canada, India, Kenya, Malaysia, New Zealand, Nigeria, Pakistan, the Philippines and Singapore, with more locales planned for Q4 2026. In the U.S., multiturn ads let advertisers appear in follow-up queries. Google reports click-through rates are already similar between sponsored and organic product list items in AI Mode, citing internal U.S. data. In plain terms: AI Mode is Google's conversational search view; multiturn ads means an ad can appear again when a searcher asks a follow-up question, instead of only on the first answer. Why it matters: AI Mode is moving from a free experiment to an ad-supported surface in many markets, so teams tracking AI Mode visibility should expect paid units beside organic citations. Our take: Google's own figure that sponsored and organic product items draw similar clicks is vendor-reported and U.S.-only, so it says little about the other markets. Watch whether organic citations keep their position as the ad load grows. - [Google Ads & Commerce Blog: Ads in AI Mode, now in more countries](https://blog.google/products/ads-commerce/ads-in-ai-mode-global/)