# Everything here is public and every crawler is welcome, search and AI alike.
#
# This file used to name GPTBot, PerplexityBot, ClaudeBot and OAI-SearchBot in
# their own groups, each with "Allow: /". That was not an invitation — it was a
# no-op that quietly disabled the rule above for exactly those four crawlers.
# RFC 9309 §2.2.1: a crawler obeys the ONE most-specific group that matches its
# token, and groups are never merged. So a named group inherits nothing from *.
#
# The consequence only shows up later. Add "Disallow: /something" to * and every
# ordinary crawler respects it while the four named ones keep crawling, because
# their own group never mentioned it. This site shipped a "Disallow: /staging/"
# until 2026-07-25, so that was one edit away from happening for real.
#
# One group, no exceptions, nothing to keep in step. If a Disallow is ever added
# below and a crawler genuinely needs different rules, give it its own group AND
# repeat every rule it should still obey.

User-agent: *
Allow: /

Sitemap: https://instantclips.ai/sitemap.xml

# Structured context for AI assistants: https://instantclips.ai/llms.txt