For website owners

About the Studio crawler

Toolyconvert Studio fetches web pages when a person asks it to check a site, for example to trace redirects, read meta tags, test robots.txt or validate a sitemap. It does not crawl the web on its own.

How it identifies itself

Requests carry this User-Agent:

Mozilla/5.0 (compatible; ToolyConvertStudio/0.1; +https://www.studio.toolyconvert.com/bot)

What it does and does not do

• Makes a small number of requests per check, one site at a time, with strict time and size limits.
• Sends no cookies or credentials and does not run JavaScript or submit forms.
• Only contacts public web addresses on ports 80 and 443.
• Stores only the facts needed for the report (status codes, tag values, short excerpts), not full page copies.

Controlling access

The single-page tools act on behalf of the person who requested them, like a browser. Multi-page site checks (the website health check and the broken link checker) respect robots.txt rules for the ToolyConvertStudio user-agent token, falling back to the rules for all crawlers. If you believe the crawler is misbehaving on your site, email toolyconvert@gmail.com.