ToolForge

Technical SEO: get crawled, indexed and fast

Last reviewed and updated

Technical SEO decides whether your content ever gets a chance to rank. This guide runs the checks in dependency order — crawlability, indexation, redirects, speed, mobile and HTTPS — then sets up monitoring so regressions do not go unnoticed.

Every stage links to the free tool that performs the check, and to the live dashboard audit when you want a single score for a URL.

1Make sure crawlers can reach every page

Start with what the bot sees, not what your browser renders. A blocked directory in robots.txt, a nav built entirely in client-side JavaScript, or a login wall will hide pages that look fine to you.

Publish an XML sitemap listing only canonical, indexable, 200-status URLs, and reference it from robots.txt so every crawler finds it without configuration.

Go deeper

2Confirm the pages are actually indexed

Crawled is not indexed. A page can be fetched and then dropped because it duplicates another URL, carries a stray noindex, or offers too little unique value.

Check your important URLs individually, and keep a short list of pages that should never be indexed — internal search results, thin tag archives, staging copies.

Tools for this check

These checks need a data provider connected. For a live measurement right now, run the SEO dashboard audit against the same URL.

4Speed and Core Web Vitals

Largest Contentful Paint, Interaction to Next Paint and Cumulative Layout Shift are measured on real visits, so lab scores are only a proxy. Still, the usual culprits are consistent: oversized images, blocking third-party scripts and fonts that reflow the page.

Fix the heaviest asset first. On most sites that is a single hero image, and compressing it moves the score more than any amount of code tuning.

Go deeper

5Mobile rendering, HTTPS and headers

Google indexes the mobile rendering of your site. If content, headings or links are hidden on small screens, treat them as missing entirely.

A valid certificate covering every hostname, HTTP redirecting to HTTPS once, and sane cache and security headers round out the hygiene list.

Tools for this check

These checks need a data provider connected. For a live measurement right now, run the SEO dashboard audit against the same URL.

6Monitor so regressions surface early

Technical SEO decays with every deployment. Re-run the same checks on a schedule and after each release, and keep the results so you can see a trend rather than a single number.

Uptime and DNS belong in the same routine: a site that is unreachable when the crawler visits loses rankings without any content changing.

Tools for this check

These checks need a data provider connected. For a live measurement right now, run the SEO dashboard audit against the same URL.

Go deeper

  • SEO dashboardAudit a URL live, track keyword positions and verify backlinks.
  • SEO checklistThe pre-publish version of these checks.

Related tools

The technical toolkit, in the order a first audit usually needs them.

Frequently asked questions

From the blog

New SEO trend analysis and tool reviews are published every month.

All blog posts

Keep going