Free crawler
See whether search engines and answer engines can reach, index and understand a website—without treating model-training access as a ranking requirement.
Run the check to inspect search bots, answer-engine bots, training bots and user-triggered fetchers separately.
The score combines public reachability, sampled indexability, search/answer bot policy, sitemap discovery, structured data, canonical identity and answer extractability. Training bots are visible but unscored: allowing training is a publisher choice, not a search-quality requirement.
A successful neutral fetch proves the page is publicly reachable from Assetzaar's crawler. It cannot prove that a firewall accepts every official bot because reliable verification also needs the provider's current IP list and your server logs. Never whitelist a request from its User-Agent string alone.
Bot tokens and behavior change. The checker is maintained against provider documentation, but these sources remain authoritative.
FAQ
No. OpenAI documents GPTBot for model training and OAI-SearchBot for ChatGPT search. Publishers can set those policies independently.
No. Google states that Google-Extended controls certain Gemini training and grounding uses and does not affect inclusion or ranking in Google Search.
No. It provides a neutral public-fetch baseline. Reliable bot verification also requires current provider IP ranges, reverse-DNS or provider-specific verification, and server logs.
No. It is an emerging optional convention with no confirmed ranking benefit. Crawlable canonical content, structured data and clear answers matter first.
No report URL is created. Results stay in the current browser session unless you explicitly save them to local browser storage or export JSON.