Get all trained page links by knowledge base
GET/knowledge-bases/crawler
Lists discovered and trained website pages for a knowledge base, with pagination and optional URL filter. WHEN TO USE: use this when you need to inspect crawled pages; use discoverWebsite to find new pages; use deleteTrainedUrlsForKnowledgeBase to remove pages the AI should stop using. RETURNS: a paginated list of crawled URLs with status, title, and identifiers.
Request
Version stringrequired
API Version
Available options
v3knowledgeBaseId stringrequired
knowledge base ID as string
locationId stringrequired
location ID as string
page number
Page number
pageLength number
Records per page
query string
query to filter on url links
Trained page links retrieved successfully
- application/json
- Schema
- Example (auto)
Schema
countnumberrequired
Total count of URLs in the knowledge base
urlsobject[]required
Array of crawled URLs with their details
{
"count": 64,
"urls": [
{
"id": "688c73a25275c513f5f3a7de",
"url": "https://developer.mozilla.org/en-US/blog",
"title": "MDN Blog",
"status": "Successful",
"locationId": "qIyivCmsuEOSnyoFYEej",
"knowledgeBaseId": "Arc9QRauPKkSuMJO8D0m",
"content": "https://storage.googleapis.com/example.txt",
"contentEditedByUser": false,
"updatedAt": "2025-08-01T07:58:29.858Z"
}
]
}