A/B testing marketing page copy and layout will improve waitlist conversion rate

Hypothesis

A/B testing marketing page copy and layout will improve waitlist conversion rate

Changelog

Date	Summary
2026-04-06	Audited: added Changelog, domain tags, stamped last_audited
2026-03-28	Initial creation

---

Hypothesis

A/B testing marketing page copy and layout will improve waitlist conversion rate. The SaaS landing page currently has a single static version with no measurement of which elements drive signups. By deploying controlled A/B experiments on copy, CTAs, and page structure, conversion rate can be systematically optimized using the same ratchet methodology applied to the submission pipeline.

Method

Funnel architecture (10 pages):

Three stages: ToFu (/about, /changelog, /security), MoFu (/how-it-works, /demo, /contact), BoFu (/, /pricing, /auth/signin). 10th slot reserved for /case-studies or /testimonials.

Experiment: hero-copy-v1

• Type: A/B split test
• Traffic split: 50% control / 50% variant-a
• Metric: waitlist_conversion_rate (signups / unique visitors)
• Duration: Minimum 2 weeks or 500 unique visitors per variant (whichever comes first)
• Pages affected: Homepage (/) hero section only

Control: original headline, “Join the Waitlist” CTA, standard hero. Variant-A: benefit-focused headline (time saved), “Get Early Access” CTA, social proof counter (applications submitted) above the fold.

Instrumentation status (as of 2026-03-28):

Page	Instrumented	Tracking
/	Yes	Pageview, CTA click, scroll depth
/pricing	Yes	Pageview, plan hover, CTA click
/auth/signin	Yes	Pageview, form submit (conversion)
/about	No	:
/changelog	No	:
/security	No	:
/how-it-works	No	:
/demo	No	:
/contact	No	:

3 of 10 pages (30%) instrumented. The three instrumented pages cover the critical BoFu conversion path (homepage to pricing to signup), but ToFu and MoFu pages have no tracking, making it impossible to measure drop-off rates in the upper funnel.

Planned iteration roadmap (10 iterations):

Iter	Focus	Description
1	hero-copy-v1	Current experiment (control vs benefit-focused headline)
2	CTA variants	Test 3 CTA button texts and colors
3	Full-funnel instrumentation	Instrument remaining 7 pages
4	Flow tracking	Implement cross-page session tracking
5	/demo conversion	Optimize demo page for engagement
6	/pricing emphasis	Test pricing page layouts (feature matrix vs. simple cards)
7	Multi-page experiments	Test different page orderings and navigation flows
8	Social proof variants	Test testimonial placement and format
9	Ratchet analysis	Declare winners/losers, lock in best variants
10	Personalization	Segment-based content (by referral source or geography)

Results

Pending. The hero-copy-v1 experiment is live as of 2026-03-28 but has not yet accumulated sufficient data for statistical significance. Early traffic numbers are low (pre-launch SaaS), so the 500-visitor-per-variant threshold may take several weeks to reach.

Preliminary observations (insufficient for conclusions):

• Both variants are serving correctly (50/50 split verified)
• No JavaScript errors in tracking code
• Conversion events are firing on /auth/signin form submissions
• Scroll depth tracking is working on homepage

Findings

1. 30% instrumentation coverage is a blocker. No tracking on ToFu/MoFu means the funnel is a black box above the homepage. Iteration 3 (full-funnel instrumentation) should be prioritized ahead of more A/B variants.

2. Low traffic makes A/B testing slow. Pre-launch SaaS has minimal organic traffic. The 500-visitor threshold may require reducing to 200 with a higher significance bar, or running sequential tests instead of parallel splits.

3. CTA wording is a high-signal test. Industry benchmarks put CTA wording at 10-30% lift potential. “Get Early Access” vs. “Join the Waitlist” is the right first variable.

4. Social proof counter is a double-edged sword. Small application counts can undermine confidence rather than build it. The counter should only display above a meaningful threshold (e.g., >1,000 applications).

5. BoFu completeness first. BoFu optimizations (homepage, pricing, signup) are closest to the decision point and have the highest conversion impact. ToFu/MoFu affect volume, not rate.

Next Steps

Immediate priority: complete iteration 3 (full-funnel instrumentation) to get visibility into the entire visitor journey. The hero-copy-v1 experiment continues running in parallel. Once traffic volume supports statistical significance, declare a winner and lock it in before proceeding to iteration 2 (CTA variants). The 10-iteration roadmap will be adjusted based on early results: if the headline variant shows no lift, the focus may shift earlier to pricing page optimization (iteration 6) which has higher expected impact for B2B SaaS.