Tutorial

Getting Indexed by Google

From discovery to crawl to index: how Google finds new pages, realistic timelines, and how to diagnose indexing problems.

Search box indexing pages illustration

A page that isn’t indexed can’t rank and can’t get search traffic — it’s invisible. Getting indexed is therefore the first gate every new site and every new page must pass. The process has three stages: discovery → crawl → index, and each stage has its own failure modes.

Discovery: how the crawler finds you

Google discovers new pages through links. The sitemap you submitted in Search Console helps, but links are the primary discovery mechanism — including links from other sites.

This is the first job of backlinks, before they ever pass ranking weight: they lead the crawler to you. A link from a page Google already crawls regularly is a signpost saying “there’s something new over here.” That’s why experienced builders get their first external links early — not for authority, which they don’t have yet, but for discovery.

Realistic timelines

For a new site, things can move faster than people expect — if the basics are right:

  • A page linked from an active community post can be discovered and crawled within about an hour.
  • For genuinely new, low-competition keywords, first clicks from search can arrive within 48 hours of indexing.

These are best cases, not promises. A brand-new domain with no links and no history will be crawled less frequently at first. Timelines stretch when the site has technical problems (see the diagnostics below). The point is that indexing is not inherently slow — when it’s slow, something is usually wrong.

Use “Request indexing” sparingly

Google Search Console’s URL Inspection tool has a “Request indexing” button. Use it for key pages only — your homepage, your main tool page, important new sections.

Don’t submit every page manually. It’s a limited resource (there are quotas), and a site that needs manual submission for every page has a structural problem: its internal linking and sitemap aren’t doing their job. Manual requests are a supplement, not a strategy.

One more practical habit: keep your sitemap honest. If you know some pages are low quality or not ready for prime time, leave them out of the sitemap. A sitemap full of thin pages teaches the crawler to take your submissions less seriously.

When pages won’t get indexed: the diagnostic checklist

If a page isn’t getting indexed after a reasonable wait, work through these in order:

  1. Client-side rendering? View the page source. If the content isn’t in the HTML (the rule from the build article), the crawler may fetch the page and find nothing worth indexing. Server-side render or statically generate the page.
  2. robots.txt or noindex blocking? Check that robots.txt allows the URL and that the page doesn’t carry a noindex tag. These are embarrassingly common after staging-to-production migrations.
  3. Wrong canonical? If the canonical points somewhere else — especially at the homepage — Google will treat the page as a duplicate and skip it. Canonical must be self-referencing.
  4. Duplicate or near-duplicate URLs? Multiple URLs serving the same content (trailing slashes, parameters, www vs bare) split crawl attention. Unify with redirects and canonicals.
  5. Thin content? In GSC’s coverage report, a growing count of “Crawled — currently not indexed” is a strategy-level warning: Google is looking at your pages and deciding they’re not worth indexing. That usually means the content is too thin, too similar to existing pages, or the site is publishing faster than its quality justifies.

That last one deserves emphasis. If Google crawls your pages and declines to index them at scale, the answer is never “publish more.” It’s “publish better” — or fix whatever technical issue is making good pages look bad.

When traffic falls off a cliff

A sudden traffic drop needs a different diagnostic, worked through quickly:

  1. Manual action? Check GSC’s Manual Actions report first. A penalty changes everything about the response.
  2. Recent deploy? Did anything change in the last release — redirects, canonicals, robots.txt, the rendering pipeline? Most cliffs are self-inflicted.
  3. UGC pollution? If the site accepts user-generated content (comments, submissions, profiles), check whether spam or low-quality UGC got indexed at scale and dragged the site’s quality assessment down.
  4. Bulk low-quality pages? Programmatic pages published too fast, too thin, can trigger exactly this. The fix is pruning and improving, not publishing more.

When indexing or ranking stalls, the temptation is to buy a “10,000 backlinks” package or join a PBN (private blog network) scheme. Don’t. These are the fastest way to earn a manual action, and recovering from one takes far longer than building links properly would have. The backlink article later in this series covers legitimate methods — they’re slower, but they compound instead of exploding.

Indexing is a gate, not a goal. Once pages are consistently getting indexed, the next question is whether they rank — and that page-level competition is the subject of the next article.


Series: Build Overseas Websites with GeFei | Previous: On-Page SEO: Pages That Earn Rankings | Next: Ranking and Getting Traffic

Based on GeFei’s methodology (哥飞): https://github.com/qiayue/opengefei

Back to articles