AnswerkinBot

Section 01Crawler behaviour

1. What AnswerkinBot is

AnswerkinBot is the web crawler run by Answerkin, an SEO and AI visibility tracker operated by MVPKraft. If you see it in your server logs, someone has added your website to their Answerkin account to check its SEO health.

It is not a search engine and it doesn't build an index of the web. It only visits websites that an Answerkin customer has added, and only to produce that customer's weekly site audit.

Plain-language summary: AnswerkinBot is the crawler that checks a website for SEO problems after its owner (or someone they authorised) adds it to Answerkin. It reads public pages only, obeys robots.txt, goes slowly and identifies itself in every request.

Section 02Schedule

2. When and how often it visits

Once a week per website. Each weekly audit reads up to the page limit of the customer's plan (50, 150 or 500 pages), then stops until the next week.

A new website is also audited once when it is first added.

Section 03Requests

3. What it fetches

On each audit AnswerkinBot may request:

• /robots.txt, to learn which pages it may visit, and to report which AI and search bots your rules allow.
• /sitemap.xml and any sitemaps listed in robots.txt (up to 5 child sitemaps), to find your pages.
• /llms.txt, to report whether you have one.
• Your public HTML pages, starting from the home page and the sitemap and following ordinary internal links (links marked rel="nofollow" are skipped).
• A light check (a HEAD request, or a small GET if HEAD isn't supported) of up to 60 outbound links per audit, only to report broken links to the website owner.

Section 04User agent

4. How to recognise it

Every request sends this user agent. The robots.txt token is AnswerkinBot.

AnswerkinBot/1.0 (SEO audit; +https://answerkin.com/bot)

Section 05Politeness

5. Speed and limits

AnswerkinBot is built to be gentle on your server:

• At most 3 requests at the same time, in batches of about 10 pages a minute.
• Each request gives up after 10 seconds and reads at most 2 MB.
• It follows at most 5 redirects per URL.
• It doesn't run JavaScript, download images, video or other files, or fill in forms.

Section 06Hard limits

6. What it won't do

• Ignore robots.txt: pages disallowed for AnswerkinBot (or for all bots with *) are skipped.
• Log in, submit forms, or read anything behind a password or paywall.
• Visit private, internal or cloud-metadata addresses, or anything other than http and https.
• Fetch more pages than the website owner's plan allows each week.
• Use your content to train AI models, sell it, or publish it. Results are shown only to the account that added the website.

Section 07Opt out

7. How to block it

Add these lines to your robots.txt to stop AnswerkinBot crawling your whole site. It reads robots.txt at the start of every audit, so the change applies from the next run. You can also disallow only some paths.

User-agent: AnswerkinBot
Disallow: /

Section 08Contact

8. Questions or problems

If AnswerkinBot is causing problems, or you think it's crawling your site by mistake, email info@mvpkraft.com with your domain and roughly when you saw it. We'll look into it and can stop all crawling of your domain.