[AI Search] add changelog

Author: Naapperas

src/content/changelog/ai-search/2026-04-08-ai-search-content-selectors.mdx

@@ -0,0 +1,40 @@
+---
+title: AI Search CSS content selectors for precise content extraction
+description: Control which parts of crawled pages are indexed using CSS selectors.
+products:
+  - ai-search
+date: 2026-04-08
+---
+
+[AI Search](/ai-search/) now supports [CSS content selectors](/ai-search/configuration/data-source/website/#content-selectors) for website data sources. You can now define which parts of a crawled page are extracted and indexed by specifying CSS selectors paired with URL glob patterns.
+
+Content selectors solve the problem of indexing only relevant content while ignoring navigation, sidebars, footers, and other boilerplate. When a page URL matches a glob pattern, only elements matching the corresponding CSS selector are extracted and converted to Markdown for indexing.
+
+Configure content selectors via the dashboard or API:
+
+```bash
+curl "https://api.cloudflare.com/client/v4/accounts/{account_id}/ai-search/instances" \
+  -H "Authorization: Bearer {api_token}" \
+  -H "Content-Type: application/json" \
+  -d '{
+    "id": "my-ai-search",
+    "source": "https://example.com",
+    "type": "web-crawler",
+    "source_params": {
+      "web_crawler": {
+        "parse_options": {
+          "content_selector": [
+            {
+              "path": "**/blog/**",
+              "selector": "article .post-body"
+            }
+          ]
+        }
+      }
+    }
+  }'
+```
+
+Selectors are evaluated in order, and the first matching pattern wins. You can define up to 10 content selector entries per instance.
+
+For configuration details and examples, refer to the [content selectors documentation](/ai-search/configuration/data-source/website/#content-selectors).

src/content/docs/ai-search/configuration/data-source/website.mdx

@@ -105,58 +105,58 @@ curl "https://api.cloudflare.com/client/v4/accounts/{account_id}/ai-search/insta
   }'
 ```
 
-| Field      | Type   | Description                                                                                                                                      |
-| ---------- | ------ | ------------------------------------------------------------------------------------------------------------------------------------------------ |
+| Field      | Type   | Description                                                                                                                                                                                                                |
+| ---------- | ------ | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
 | `path`     | string | Glob pattern to match against the full page URL. Uses the same glob syntax as [path filtering](/ai-search/configuration/path-filtering/) — `*` matches within a segment, `**` crosses directories. Maximum 200 characters. |
-| `selector` | string | CSS selector to extract content from pages matching the path pattern. Supports standard CSS selectors including element, class, ID, and attribute selectors. Maximum 200 characters.                                        |
+| `selector` | string | CSS selector to extract content from pages matching the path pattern. Supports standard CSS selectors including element, class, ID, and attribute selectors. Maximum 200 characters.                                       |
 
 ### Examples
 
 #### Extract main content from blog pages
 
 To index only the article body on blog pages and ignore navigation, sidebars, and footers:
 
-| Path           | Selector             |
-| -------------- | -------------------- |
-| `**/blog/**`   | `article .post-body` |
+| Path         | Selector             |
+| ------------ | -------------------- |
+| `**/blog/**` | `article .post-body` |
 
 #### Target documentation content
 
 To index the main content area of a documentation site:
 
-| Path           | Selector       |
-| -------------- | -------------- |
-| `**/docs/**`   | `main .content` |
+| Path         | Selector        |
+| ------------ | --------------- |
+| `**/docs/**` | `main .content` |
 
 #### Different selectors for different sections
 
 You can define multiple entries to apply different selectors to different parts of your site. The first matching path wins, so place more specific patterns first:
 
-| Path                   | Selector             |
-| ---------------------- | -------------------- |
-| `**/blog/releases/**`  | `.release-notes`     |
-| `**/blog/**`           | `article .post-body` |
-| `**/docs/**`           | `main .content`      |
+| Path                  | Selector             |
+| --------------------- | -------------------- |
+| `**/blog/releases/**` | `.release-notes`     |
+| `**/blog/**`          | `article .post-body` |
+| `**/docs/**`          | `main .content`      |
 
 In this example, a page at `https://example.com/blog/releases/v2` matches the first pattern and uses the `.release-notes` selector. A page at `https://example.com/blog/my-post` skips the first pattern and matches the second.
 
 :::caution
-If a CSS selector does not match any elements on a page, the page is indexed with empty content. Verify that your selectors match the expected elements before applying them to a broad set of pages.
+If a CSS selector does not match any elements on a page, the resulting Markdown is empty and AI Search marks the item as errored. Verify that your selectors match the expected elements before applying them to a broad set of pages.
 :::
 
 ### Interaction with other features
 
 - **Path filtering**: [Path filtering](/ai-search/configuration/path-filtering/) takes priority over content selectors. Pages excluded by path filters are never crawled, so content selectors do not apply to them.
 - **Browser Rendering**: Content selectors apply to the HTML that AI Search receives. For sites that render content with JavaScript, turn on [Browser Rendering](#rendering-mode) so that selectors can target the fully rendered DOM.
-- **Future crawls only**: Changes to content selectors apply to pages crawled after the change. To apply new selectors to already-indexed pages, trigger a new [sync job](/ai-search/configuration/indexing/).
+- **Automatic re-indexing**: Updating content selectors triggers a new [sync job](/ai-search/configuration/indexing/) immediately, so changes are applied to all indexed pages.
 
 ### Limits
 
-| Limit                             | Value          |
-| --------------------------------- | -------------- |
-| Maximum content selector entries  | 10             |
-| Maximum path pattern length       | 200 characters |
-| Maximum selector length           | 200 characters |
+| Limit                            | Value          |
+| -------------------------------- | -------------- |
+| Maximum content selector entries | 10             |
+| Maximum path pattern length      | 200 characters |
+| Maximum selector length          | 200 characters |
 
 ## Best practices for robots.txt and sitemap