Technical SEO Services That Fix What Google Can't See

How Google Crawls a Website

Google finds pages with a program called Googlebot. It starts from pages it already knows, follows every link it finds and reads your XML sitemap for new addresses. Each time it visits, it notes what changed and decides how often to come back.

For a small business site, this usually works well, as long as nothing gets in the way. Problems start when important pages have no links pointing to them, when links are broken, or when the site sends Googlebot through long chains of redirects. In those cases, Google may visit less often, or miss pages completely.

• Internal links are the main road Googlebot travels. A page with no links to it is an "orphan" and is easy to miss.
• Server errors (5xx) tell Google your site is unreliable, so it slows down its visits.
• Crawl budget is the number of pages Google is willing to crawl in a given time. Small sites rarely run out, but wasted crawls on junk URLs still delay the pages that matter.

Robots.txt and XML Sitemaps Explained

Two small files guide Google around your site. Robots.txt tells crawlers which areas they may not visit. The XML sitemap lists the pages you do want found. Together, they act like a "staff only" sign and a map at the entrance.

Both are simple, but small errors cause big problems. One wrong line in robots.txt can block your entire site. Similarly, a sitemap full of redirected, deleted or noindexed pages sends Google mixed signals and wastes its time.

• Robots.txt should block admin areas, internal search results and filter pages, not your content.
• The sitemap should only list pages that load correctly, are indexable and are the main version of each page.
• Submit the sitemap in Google Search Console, so you can see how many listed pages are actually indexed.

Indexing: Why Some Pages Never Appear

Crawling and indexing are not the same thing. After Google reads a page, it decides whether the page is worth storing in its index. Only indexed pages can appear in search results.

Search Console's Pages report shows exactly why pages were left out. The most common reasons on small business sites are:

• "Excluded by noindex tag": a setting in your SEO plugin or theme tells Google to skip the page.
• "Duplicate without user-selected canonical": Google found several near-identical pages and picked another one.
• "Crawled, currently not indexed": Google read the page but didn't think it was useful enough. This usually means thin or repeated content.
• "Discovered, currently not indexed": Google knows the page exists but hasn't visited it yet, often because of weak internal links.

Each reason has a different fix. Therefore, I treat the report as a to-do list rather than a warning sign, and work through it by impact.

Canonical Tags and Duplicate Content

Many websites show the same content at several addresses without anyone noticing. For example, a page might load with and without "www", with and without a trailing slash, or with tracking codes added to the end. To Google, each of those can look like a separate page.

A canonical tag tells Google which address is the main one. As a result, ranking signals collect on a single URL instead of being split across copies.

• Every indexable page should have a canonical tag pointing to itself.
• Copies, print versions and filtered pages should point to the main page.
• The whole site should use one version of the domain, with permanent (301) redirects from all the others.

Site Speed and Core Web Vitals in Detail

Speed matters for two reasons. First, visitors leave slow pages, especially on phones. Second, Google uses page experience signals, including Core Web Vitals, as part of how it ranks pages.

The three Core Web Vitals measure real visitors' experience:

• LCP (Largest Contentful Paint) measures how quickly the main content appears. Large hero images, slow hosting and render-blocking files are the usual causes of a poor score.
• INP (Interaction to Next Paint) measures how quickly the page reacts to taps and clicks. Heavy JavaScript from sliders, chat widgets and tracking scripts is the common problem.
• CLS (Cumulative Layout Shift) measures how much the layout jumps while loading. Images without set sizes, late-loading ads and web fonts often cause it.

Most speed problems on small business sites come from the same few sources: uncompressed images, too many plugins, no caching and cheap shared hosting. Fixing those usually gives the biggest gain for the least work.

Mobile-First Indexing

Google now looks at the mobile version of your site first. If something is missing or broken on mobile, Google treats it as missing, even if the desktop version is perfect.

So, I check the mobile version of every key page for the same content, headings, images and internal links as desktop. I also check practical things that affect visitors: text size, buttons that are easy to tap, menus that work, and no sideways scrolling.

• Hidden mobile content, such as collapsed tabs, is fine, but content removed entirely on mobile is not seen.
• Pop-ups that cover the page on mobile can hurt both visitors and rankings.
• Structured data and meta tags must be present on the mobile version too.

HTTPS, Redirects and Site Migrations

A secure site (HTTPS) is now the standard, and browsers warn visitors when a site isn't secure. Beyond the certificate itself, every image, script and link should load over HTTPS. Otherwise, browsers flag "mixed content".

Redirects are the other half of this topic. A 301 redirect permanently sends visitors and Google from an old address to a new one, and passes most ranking value with it. Problems start when redirects chain together (A to B to C) or loop back on themselves.

The riskiest moment for any website is a redesign, a move to a new domain or a change of URL structure. Without a full redirect plan, years of rankings can disappear within weeks.

Structured Data (Schema) for Small Businesses

Structured data is extra code that describes your page in a format Google understands directly. Instead of guessing, Google can read that a page is about a local business, with these opening hours, this address and these services.

For small businesses, the most useful types are:

• LocalBusiness (or a more specific type, such as Plumber or Dentist) for your name, address, phone and hours.
• Service for the services you offer.
• FAQPage for question-and-answer sections.
• BreadcrumbList to show your site structure in search results.

Schema doesn't guarantee special search features. However, it removes guesswork and helps Google connect your website with your business information elsewhere online. I test every piece of markup with Google's Rich Results Test before it goes live.