AI companies and AI search services use automated programs to read public website content. These programs are called AI bots. You can choose which known AI bots are allowed to read your site, or block them.
This is an "active settings" article; if you only want to know which AI bots have visited, read "AI Bot Visit Logs".
Different AI bots have different purposes:
Blocking training bots usually doesn't affect Google's general search results; however, blocking retrieval bots might cause your site to no longer appear in answers from ChatGPT, Perplexity, Gemini, Grok, or other AIs.
By default, there are no blocking rules, meaning all currently recognized AI bots are allowed to access your public website.
If you don't want any known training bots to read your content, you can turn off the training category. If you turn off the retrieval category, the system will remind you again that this might reduce your AI search visibility.
If you have concerns about a specific service, you can keep the category enabled and instead disable individual bots. For example, you can block only GPTBot or Google-Extended.
Googlebot, Bingbot, and Applebot do not have a block switch. This is to prevent you from accidentally making traditional search engines unable to index your site. If your site should not appear in search results, you should use the noindex setting in "Pages → SEO" instead, understanding that this will affect search visibility.
Kanorio handles blocking in two layers:
If you switch to a fully custom Robots.txt, the automatic Robots rules will not be appended, but the edge layer blocking will still function.
Kanorio automatically provides LLMs.txt and LLMs-full.txt. These act as a website directory and a full content summary for AI tools to read, helping tools that can access your site understand your brand and the topics of each page.
These files do not force any AI to use or cite your website, nor do they bypass your configured bot blocking. You can preview or switch to custom content in the "Technical SEO" settings.
No, it will not directly affect Google's general search crawlers. Google Search uses Googlebot, while training or extended AI uses might employ different bots, such as Google-Extended.
No. The settings will block bots that Kanorio has identified and can block, but unknown programs, those disguised as regular browsers, or those that don't adhere to rules may still attempt to access public content.
Historical logs are not deleted. Please check the new logs after applying settings to confirm that the latest requests are shown as blocked.
