Crawling

Plays that decide whether Google can find, render and index your pages.

CardsListTablerepoSEO

Use the Indexing API for blog posts

Crawling

New posts take time to be indexed.
Request indexing again and again

Crawling

Pages show as “Crawled, currently not indexed” in Search Console.
Merge near-identical pages that are not indexed

Crawling

Many similar pages stay out of the index.
Add internal links to pages that are not indexed

Crawling

Pages you want indexed are hard for Google to reach or seem unimportant.
Submit a temporary sitemap of unindexed URLs

Crawling

Google is slow to revisit pages you have improved.
Obsess over Core Web Vitals

Crawling

Speed scores are treated as a main ranking lever.
Noindex the clutter

Crawling

Low-value URLs fill the index reports.
Optimize crawl budget on a small site

Crawling

Small sites are told that crawl budget limits their rankings.
Analyze server logs

Crawling

You do not know which pages Googlebot actually visits.
Clean up redirect chains

Crawling

URLs redirect through several steps before reaching the final page.
Map redirects one to one before a migration

Crawling

Migrations and redesigns lose traffic.
Use canonicals for duplicates and parameters

Crawling

The same content is reachable at several URLs.
Check that content loads without JavaScript

Crawling

Content that depends on JavaScript may not be seen or indexed in time.