TL;DR

AI crawlers scan your website in under 30 seconds. Most don't execute JavaScript. 96.9% of small business websites fail at least one Core Web Vital. If you can't pass a 30-second technical audit, you're invisible to AI search, AI sales tools, and PE buyers conducting digital due diligence. This article gives you the checklist.

Key Takeaways

  • 69% of AI crawlers cannot execute JavaScript. Your fancy React architecture? Crawlers see it as a blank page.
  • 96.9% of North American B2B websites fail at least one Core Web Vital on mobile. Only 3.1% pass all three.
  • AI citation patterns vary by engine. Gemini weights Google-indexed E-E-A-T, ChatGPT weights recency, Perplexity prioritizes answer-first content.
  • PE due diligence focuses on technical infrastructure first. Website speed, conversion setup, analytics integrity—more than half of PE deals fail because the website infrastructure can't scale or verify.
  • The 30-second audit predicts revenue readiness. Readiness beats rankings.

The 30-Second Audit: What AI Crawlers Actually Check

I spent 13 years in submarines. One thing never changed: a 30-second walkthrough of a compartment told you everything about that crew's operational readiness. The way equipment was secured, cable management, the condition of the engineering logs—everything communicated discipline or chaos.

Your website is the same. In 30 seconds, an AI crawler assesses your entire business infrastructure.

Here's what happens in that half-minute window:

Second 1-5: Can I access your content? The crawler hits robots.txt. It checks for proper HTTP/HTTPS setup, valid SSL certificates, and whether you're blocking it. 404 errors, redirect chains, and inconsistent HTTP status codes all trigger red flags. One redirect loop and the crawler moves on. Your site failed the basic readiness check.

Second 5-15: Do you have structure? The crawler scans for schema.org markup: JSON-LD for organization, product, article, FAQ, breadcrumbs. It reads Open Graph tags, meta descriptions, heading hierarchy. It checks whether your site architecture makes semantic sense. No schema markup? You're asking AI to guess what you do. AI guesses wrong.

Second 15-25: Are you credible? The crawler checks authorship signals, publication dates, backlink authority, domain age, SSL certificate issuer reputation. It looks for E-E-A-T signals (Experience, Expertise, Authorship, Trust). It counts internal links to establish information hierarchy. It reads your trust badges, privacy policy, contact information, business registration data.

Second 25-30: Can I actually use this? Core Web Vitals. Largest Contentful Paint (LCP). First Input Delay (FID). Cumulative Layout Shift (CLS). Mobile responsiveness. Image optimization. JavaScript execution: and whether the crawler bothers to execute it at all. (It doesn't, 69% of the time.)

That's it. In 30 seconds, you're either ready or you're not.

The 7-Point Checklist: The 30-Second Audit in Practice

Use this checklist right now. It maps directly to what crawlers assess.

1. Access

  • [ ] robots.txt is clean and permissive (not blocking all bots)
  • [ ] SSL certificate is valid and current
  • [ ] No redirect chains (maximum 2 redirects)
  • [ ] All critical pages return 200 status codes, not 404s or 5xx errors
  • [ ] Sitemap.xml is properly formatted and referenced in robots.txt

2. Schema Markup

  • [ ] Organization schema present (name, logo, contact, social profiles)
  • [ ] Article/BlogPosting schema on all major content
  • [ ] Breadcrumb schema for site structure
  • [ ] FAQ schema where applicable
  • [ ] Product schema (if applicable)

3. E-E-A-T Signals

  • [ ] Author bylines with author bios and credentials
  • [ ] Publication and last-updated dates on all content
  • [ ] Links to credible external sources
  • [ ] References to internal authority pages
  • [ ] Privacy policy, terms of service, contact page all present

4. Technical Core Web Vitals (Mobile)

  • [ ] LCP under 2.5 seconds
  • [ ] FID under 100 milliseconds
  • [ ] CLS under 0.1
  • [ ] Mobile viewport configured
  • [ ] All critical images optimized (WebP format tested)

5. JavaScript Rendering

  • [ ] Critical content loads without JavaScript
  • [ ] Navigation works without JavaScript
  • [ ] Forms submit without JavaScript
  • [ ] At-risk: fancy hero animations, modal content, infinite scroll

6. Conversion Infrastructure

  • [ ] Forms are functional and trackable
  • [ ] CTA buttons lead to defined conversion points
  • [ ] Analytics or tracking pixels fire properly
  • [ ] Phone numbers are clickable (tel: protocol)
  • [ ] No conversion bottlenecks in the checkout or inquiry flow

7. Content Authority

  • [ ] Domain is aged (at least 6 months, ideally 2+ years)
  • [ ] Backlinks from relevant, authoritative domains
  • [ ] Content is unique, not AI-generated filler
  • [ ] Internal linking supports topic clusters
  • [ ] Topical depth on target keywords (1000+ word content for competitive terms)

Why 96.9% of Small Businesses Fail the 30-Second Audit

The data is brutal. A 2026 study of 292 North American B2B websites found that 96.9% fail at least one Core Web Vital on mobile. Only 3.1% pass all three metrics.

Why do they fail?

Reason 1: Technical Debt Most websites run on platforms that weren't optimized for Core Web Vitals when they were built. WordPress installations bloated with plugins. Shopify themes with 40+ JavaScript frameworks. Legacy systems running on servers in data centers designed for 2015 speeds. Fixing this requires code rewrites. Most companies never do.

Reason 2: Image Optimization A single unoptimized hero image kills Core Web Vitals. The average B2B homepage loads 5+ hero images, product images, and background graphics. None are in WebP format. None are resized for mobile. Each one adds 500ms to 2 seconds to load time. This is the single easiest fix and nobody does it.

Reason 3: Third-Party Scripts Chat widgets, analytics, heat mapping tools, A/B testing platforms, ad pixels: all synchronous. Each one blocks page rendering. A site with 12 third-party scripts will fail LCP 100% of the time. Most small business websites have 15+.

Reason 4: Mobile-Second Thinking Websites are still designed for desktop first. Mobile CSS is an afterthought. Forms have tiny input fields. CTAs are hard to hit on a phone. Typography scales poorly. The crawlers test mobile first. If it fails there, you fail period.

Reason 5: No Schema, No Authority 69% of small business websites have zero structured data. No schema.org markup. AI crawlers literally cannot determine what the business does, who wrote the content, or whether it's credible. Without schema, you're invisible.

What PE Buyers Actually See: Digital Due Diligence

When a PE firm runs digital due diligence on an acquisition target, they're assessing one thing: revenue infrastructure. Can this digital property scale? Can it survive a transition? Will it generate predictable revenue?

They start with what we call the "30-second audit."

Website Readiness Does the site pass Core Web Vitals? Is the code clean or is it a rats' nest of legacy systems? Can you migrate it to a new CMS without losing ranking authority? One bad Core Web Vitals score and the PE firm assumes serious technical debt. That's a red flag on valuation.

Conversion Infrastructure Are conversion points tracked? Are forms functioning? Do you know your actual conversion rates or are you guessing? More than half of PE deals fail because the acquiring firm can't verify revenue attribution. The website infrastructure doesn't support the claimed revenue multiples.

Martech Governance How many marketing tools are running? Are they integrated or siloed? Are you running duplicate campaigns? Can you consolidate and actually improve efficiency, or is it chaos? Bad governance kills margins.

Analytics Integrity Can you prove where customers come from? Is your attribution model reliable? Are you actually measuring organic vs. paid vs. direct correctly? If the deal thesis depends on organic traffic performance and your analytics are broken, the deal breaks.

The 30-second audit tells the PE firm whether the digital infrastructure is a revenue engine or a liability. Most small businesses fail this audit. They're marked down accordingly.

The Free Tool Stack: What to Use Right Now

You don't need expensive platforms. Start with these tools. They're free and they work.

Google Lighthouse Built into Chrome DevTools. Audits performance, accessibility, best practices, and SEO. Run it on your homepage and your top 3 conversion pages. If Lighthouse score is under 90, you have technical work to do.

Screaming Frog (Free Tier) Crawls your entire website like Googlebot does. Identifies broken links, missing titles, missing meta descriptions, duplicate content, redirect chains. 500 URL crawl limit on free version but that covers most small sites.

Ahrefs Site Audit 170+ technical checks. Identifies crawlability issues, indexation problems, backlink errors, and priority fixes. Free tier shows the top issues.

Google Search Console Invalids from Google's own crawlers. Shows Core Web Vitals data. Shows actual search queries driving traffic. Free and authoritative.

GTmetrix Your Core Web Vitals dashboard. Run before-and-after tests on optimization changes. Free version tracks 3 sites.

That's your stack. $0 investment. Run each tool on your site. Document the findings. You now have your 30-second audit.

FAQ: The Questions We Get

Q: Does a 30-second audit really matter if my domain ranks well in Google? A: Today, yes: Google is forgiving because Google wrote the rules. Tomorrow, no. ChatGPT, Perplexity, Gemini, and Claude all weight fresh content, fast load times, and clear authorship. Google's algorithm is shifting toward AI evaluation criteria. A site that ranks but fails the 30-second audit will lose visibility in AI search. You're optimizing for yesterday's game.

Q: If I fix Core Web Vitals, do I rank better? A: Not directly. Ranking depends on content quality and backlinks. But fixing Core Web Vitals prevents ranking penalties, makes your content accessible to crawlers that do execute JavaScript, and improves conversion rates. Speed fixes traffic: not through ranking, but through user behavior.

Q: Should I rebuild my website on a faster platform? A: Not necessarily. Most speed issues come from images, scripts, and code bloat: not the platform itself. Audit first. Low-hanging fruit (image optimization, third-party script management, lazy loading) will solve 80% of problems. Only rebuild if you're still failing after cleanup.

Q: What is the ROI on fixing the 30-second audit? A: For an average small business site, a 1-second improvement in load time improves conversion rates by 2-7%. If you're doing $500K in annual revenue from your site and your conversion rate is 2%, a 3-second improvement could add $30K-$100K annually. That's why PE firms care about this so much.

Doctrine Connection: Due Diligence Is Non-Negotiable

In the Navy, we had a doctrine: readiness audits were non-negotiable. You could not deploy a submarine until every system passed inspection. Not because inspections were fun: they were tedious. But because poor readiness kills in the field. That doctrine saved lives.

Your website is your forward operating base in the digital economy. A 30-second audit isn't about vanity metrics. It's about operational readiness. Can you handle traffic spikes? Can you track revenue? Can you prove your value to PE buyers if you ever need capital?

Readiness beats rankings. Always.

Use the framework. Use the tools. Run the audit. Fix what breaks. That's due diligence. It's not optional.

Owner's Exit Engine principle: a business that can prove its digital infrastructure is clean, scalable, and revenue-generative exits at higher multiples. The 30-second audit is your proof.

Disclosure

This article references the GEOReady framework developed by teams in the generative engine optimization space, research from Yext analyzing 17.2M AI citations across Gemini, ChatGPT, Perplexity, and Claude, SearchViu 2025 research on JavaScript execution, Vercel analysis of Googlebot behavior, Bain data on PE deal performance, and a 2026 CoderLegion study of 292 North American B2B websites. All data is cited to source. No tools mentioned (Ahrefs, Google Lighthouse, Screaming Frog, GTmetrix) are affiliated with this publication.

Sources

*Jeff Barnes, MBA has no personal position in any company, fund, or platform named in this article. demg.ai has no current commercial relationship with any party mentioned. This content provides marketing and business education, not professional advice.*