VerdictMoves the needle (on bloated sites)
CategoryCrawling
Last reviewedNovember 7, 2026
The problem
Low-value URLs fill the index reports.
Steps
- Review which URLs fill “Crawled, currently not indexed”.
- Noindex or block tag pages, internal search results, filtered categories and similar URLs that serve no searcher.
- Keep the pages that people actually land on.
Evidence
On most sites, the report of crawled but not indexed pages is full of tag pages, internal search results, filtered categories, paginated lists, feeds and archives.
Verdict
Moves the needle on bloated sites.