This helps you decide how much of your website your AI agent should learn from.
Choosing the right option affects how broad or focused your agent’s answers will be.
Option 1: Entire site #
When to use #
- You want full website coverage
- Example: product + pricing + support pages
What happens #
- Crawls all accessible pages from your domain

Option 2: This page only #
When to use #
- You want answers from a specific page
- Example: pricing, product, or FAQ page
What happens #
- Only the entered URL is used
- No other pages are included

Option 3: Entire sitemap #
When to use #
- Your site has a structured sitemap
- You want cleaner and more complete coverage
What happens #
- Uses your sitemap to fetch all listed URLs
- More structured than a full crawl

Key difference #
- Single page → Focused and controlled
- Entire site / sitemap → Broad and comprehensive
Important Notes #
- All crawled URLs appear under New
- You must click Refresh Agent to train them
- Large crawls may take more time
Quick recommendation #
- Start with This page only for testing
- Move to Entire site once you’re confident
Next, add your URLs and click Refresh Agent to train your agent.
If you have any questions, concerns, or need further clarification, please contact support@highengage.com for assistance.