User-agent: *
Disallow:

# ---------------------------------------------------------------------------
# 2026-09-08. Crawlers that cost bandwidth and return nothing to this site.
# These are also refused with 403 at the web-server level; the block here is so
# the polite ones stop before they ever get there.
# Search and AI assistants are deliberately NOT in this list: Google (every
# service), Bing, Apple, OpenAI/ChatGPT, Anthropic/Claude, Gemini, Perplexity,
# Yandex and DuckDuckGo all keep full access. ExaSearchBot (a retrieval
# source ChatGPT uses) and CCBot (Common Crawl) removed from this list
# 2026-09-20 so the promise above is actually true.
# ---------------------------------------------------------------------------
User-agent: AhrefsBot
User-agent: AhrefsSiteAudit
User-agent: SemrushBot
User-agent: SemrushBot-BA
User-agent: SemrushBot-BM
User-agent: SemrushBot-CT
User-agent: SemrushBot-FT
User-agent: SemrushBot-OCOB
User-agent: SemrushBot-SI
User-agent: SemrushBot-SWA
User-agent: SiteAuditBot
User-agent: SplitSignalBot
User-agent: DotBot
User-agent: AwarioBot
User-agent: AwarioRssBot
User-agent: AwarioSmartBot
User-agent: MJ12bot
User-agent: SERankingBot
User-agent: SERankingBacklinksBot
User-agent: DataForSeoBot
User-agent: Bytespider
User-agent: TikTokSpider
User-agent: Turnitin
User-agent: TurnitinBot
User-agent: Amazonbot
User-agent: Amzn-SearchBot
User-agent: meta-externalagent
User-agent: FacebookBot
User-agent: PetalBot
User-agent: BLEXBot
User-agent: Barkrowler
User-agent: serpstatbot
User-agent: ZoominfoBot
User-agent: Sogou web spider
User-agent: MegaIndex.ru
User-agent: SeekportBot
User-agent: ImagesiftBot
User-agent: Diffbot
User-agent: VelenPublicWebCrawler
User-agent: cohere-ai
User-agent: Timpibot
User-agent: omgili
User-agent: omgilibot
User-agent: LinkupBot
User-agent: SleepBot
Disallow: /

Sitemap: https://www.antonovych-home.kz/sitemap.xml
EntityMap: https://www.antonovych-home.kz/entitymap.json
Agentmap: https://www.antonovych-home.kz/.well-known/ai-catalog.json
Llms: https://www.antonovych-home.kz/llms.txt
Llms-Query: https://www.antonovych-home.kz/llms?query=