User-Agent: GPTBot
User-Agent: ClaudeBot
User-Agent: Claude-Web
User-Agent: CCBot
User-Agent: Bytespider
User-Agent: Amazonbot
User-Agent: Meta-ExternalAgent
User-Agent: Meta-ExternalFetcher
User-Agent: cohere-ai
User-Agent: Diffbot
User-Agent: PetalBot
User-Agent: Applebot-Extended
User-Agent: SemrushBot
User-Agent: AhrefsBot
User-Agent: MJ12bot
User-Agent: DotBot
Allow: /
Allow: /about/
Allow: /contacts/
Disallow: /lot/
Disallow: /auctions/
Disallow: /archive/
Disallow: /buy-now/
Disallow: /render-filtered/
Disallow: /api/

User-Agent: *
Allow: /
Disallow: /api/
Disallow: /render-filtered/

Sitemap: https://cars24.com.ua/sitemap.xml