TS05 · CRAWLING, INDEXING, PROTECTION
The right method
for the right goal.
Check that your plan does not confuse blocking a crawler, staying out of Google and protecting private content.
1 · Your goal
What TS05 checks here
TS05-A01 checks a supplied policy model: crawling, indexing, protection and claimed guarantees. The engine visits no URL. Mechanisms are your declarations, not independently observed configuration.
The method is qualified on synthetic cases. C means only that the supplied model is consistent; NC identifies a contradiction; NT leaves something unresolved. None establishes deindexing or site confidentiality.
Robots.txt governs crawling. For a public page, noindex must be readable by the crawler; for private content, access must be controlled server-side. Robots.txt · Noindex · Content access
Engine · 0.3.0-draft.9 · TS05-A01
Import a dossier in expert mode