A complete guide to technical SEO: crawling, indexing, site speed, Core Web Vitals, structured data, and the fixes that actually move rankings.
Great content ranks nothing if Google cannot crawl it, render it, and trust it. That is the whole job of technical SEO.
Technical SEO is the layer beneath keywords and copy. It decides whether search engines can reach your pages, understand them, and serve them fast enough to compete. Get it wrong and every other effort leaks value. Get it right and everything else you do compounds. This guide walks through the parts that matter, in the order they matter, with concrete checks you can run today.
Crawling: let bots reach your pages
Search starts with a crawler. If Googlebot cannot fetch a URL, that URL does not exist as far as rankings go. Your first job is to remove the roadblocks.
- Check your robots.txt. One stray Disallow line can hide an entire section of your site. Test it in Google Search Console before you trust it.
- Submit a clean XML sitemap. List only canonical, indexable, 200-status URLs. Drop redirects, 404s, and noindex pages from it.
- Watch your crawl budget on large sites. Endless faceted-filter URLs, session IDs, and calendar pages waste crawler time that should go to real content.
- Keep internal paths shallow. Pages buried five clicks deep get crawled rarely. Strong internal linking pulls them closer to the surface and spreads authority.
Run a crawl with any site auditor and look for orphan pages, broken links, and redirect chains. These are the quiet killers.
Indexing: control what gets stored
Crawling is not indexing. Google can fetch a page and still choose not to store it. Your goal is to make the right pages indexable and keep the wrong ones out.
- Use canonical tags to point duplicate or near-duplicate URLs at one master version. Product variants, tracking parameters, and print pages all need this.
- Apply noindex deliberately to thin pages: internal search results, tag archives, thank-you pages. Never noindex a page you also block in robots.txt, because the crawler then cannot read the noindex.
- Open the Page Indexing report in Search Console. It tells you exactly why URLs are excluded: crawled but not indexed, duplicate without canonical, soft 404. Each label is a to-do.
The pattern to avoid is thousands of low-value URLs competing for the same intent. Consolidate, canonicalize, or remove.
Site speed and Core Web Vitals
Speed is a ranking factor and a conversion factor at once. Google measures real-user experience through Core Web Vitals, and you should treat those three metrics as your scorecard.
- Largest Contentful Paint (LCP): how fast the main content loads. Compress images, serve modern formats, and preload the hero asset.
- Interaction to Next Paint (INP): how responsive the page feels to clicks and taps. Trim heavy JavaScript and defer what is not needed on first load.
- Cumulative Layout Shift (CLS): how much the layout jumps. Set explicit width and height on images and reserve space for ads and embeds.
Measure with field data, not just lab scores. A perfect Lighthouse run on your laptop means little if real users on mid-range phones wait four seconds. Fix the slowest real-world pages first.
Mobile and rendering
Google indexes the mobile version of your site. If your mobile pages hide content, strip structured data, or block resources, that is the version that gets ranked.
- Confirm content parity. The same headings, text, and links should exist on mobile and desktop.
- Watch JavaScript rendering. If key content only appears after a client-side fetch, Google may index an empty shell. Server-side rendering or static generation removes that risk.
- Test with the URL Inspection tool. View the rendered HTML Google actually sees, not the source you wrote.
The same rendering discipline now matters for AI answers. Machines that cannot parse your page will not cite it, which ties technical SEO directly to generative engine optimization.
Structured data and site architecture
Structured data tells search engines what your content means, not just what it says. Schema markup can earn rich results: star ratings, FAQs, breadcrumbs, product info.
- Add JSON-LD for the templates that fit your content: Article, Product, FAQ, Organization, Breadcrumb.
- Validate every template with the Rich Results Test. Invalid markup earns nothing and can look sloppy to Google.
- Keep architecture flat and logical. Group related content into topic clusters, then connect them so authority flows to your money pages.
Architecture and structured data reinforce each other. A clean hierarchy plus accurate markup gives search engines a map of your site and the meaning of each stop on it.
HTTPS, security, and hygiene
Trust signals are technical too. A few basics keep you out of trouble.
- Serve every page over HTTPS with a valid certificate. Mixed content warnings undermine trust.
- Enforce one canonical domain. Redirect www to non-www (or the reverse) and http to https, with a single 301 hop.
- Handle status codes correctly. Real 404s for dead pages, 301s for moved ones, and no soft 404s returning 200 on empty pages.
- Set hreflang if you serve multiple languages or regions, so the right version reaches the right audience.
None of this is glamorous. All of it protects the rankings your content earns. Technical debt here quietly caps your ceiling. Strong fundamentals here amplify solid keyword research instead of wasting it.
Getting started
Do not try to fix everything at once. Start with a full crawl and the Search Console indexing report. Those two sources will surface your biggest leaks in an afternoon. Fix crawl blocks and indexing errors first, then speed, then structured data. Re-crawl, confirm, repeat.
Technical SEO is not a one-time project. It is a maintenance habit that keeps your site fast, crawlable, and trusted while your content does its work. If you want a second set of eyes on your site or help turning this checklist into a plan, come talk to us in the Neurounit Club bot.