{"slug":"split-test-cold-outreach-offers","title":"Split Testing Cold Outreach Offers (Pay-Per-Result vs Free Website)","tags":["split-testing","outreach","offers","optimization"],"agent_summary":"Method for A/B testing different cold outreach offers to optimize for reply rate and cost per appointment.","trigger_phrases":["split test cold email","test outreach offers","AB test SMS campaigns","compare offer performance","optimize cold outreach"],"runnable":false,"markdown":"## Split Testing Cold Outreach Offers\n\n### Current Test Setup\n**Offer A**: Pay-on-results for more jobs\n**Offer B**: Free website offer\n\n### Metrics to Track\n1. **Reply rate** - immediate feedback on offer appeal\n2. **Booking rate** - conversions from reply to appointment\n3. **Cost per appointment** - total spend / appointments booked\n\n### Testing Methodology\n\n#### Volume Per Segment\n- Minimum: 500 leads per split test segment\n- Allows statistical significance\n- Run simultaneously to control for timing\n\n#### What to Hold Constant\n- Same target audience/niche\n- Same time of day sending\n- Same follow-up sequence timing\n\n#### What to Vary\n- The offer/hook only\n- Keep other copy elements similar\n\n### Analysis Approach\n1. Compare reply rates first (quick feedback)\n2. Let campaigns run longer for booking rate data\n3. Calculate cost per appointment for each\n4. Winner = lower cost per appointment (not just higher reply rate)\n\n### Key Insight\n\"Even though the reply rate might be higher on one, I didn't actually test if the booking rate would be higher. I didn't let it run long enough.\"\n\nDon't kill tests too early based on reply rate alone.\n","html":"<h2>Split Testing Cold Outreach Offers</h2>\n<h3>Current Test Setup</h3>\n<p><strong>Offer A</strong>: Pay-on-results for more jobs\n<strong>Offer B</strong>: Free website offer</p>\n<h3>Metrics to Track</h3>\n<ol>\n<li><strong>Reply rate</strong> - immediate feedback on offer appeal</li>\n<li><strong>Booking rate</strong> - conversions from reply to appointment</li>\n<li><strong>Cost per appointment</strong> - total spend / appointments booked</li>\n</ol>\n<h3>Testing Methodology</h3>\n<h4>Volume Per Segment</h4>\n<ul>\n<li>Minimum: 500 leads per split test segment</li>\n<li>Allows statistical significance</li>\n<li>Run simultaneously to control for timing</li>\n</ul>\n<h4>What to Hold Constant</h4>\n<ul>\n<li>Same target audience/niche</li>\n<li>Same time of day sending</li>\n<li>Same follow-up sequence timing</li>\n</ul>\n<h4>What to Vary</h4>\n<ul>\n<li>The offer/hook only</li>\n<li>Keep other copy elements similar</li>\n</ul>\n<h3>Analysis Approach</h3>\n<ol>\n<li>Compare reply rates first (quick feedback)</li>\n<li>Let campaigns run longer for booking rate data</li>\n<li>Calculate cost per appointment for each</li>\n<li>Winner = lower cost per appointment (not just higher reply rate)</li>\n</ol>\n<h3>Key Insight</h3>\n<p>\"Even though the reply rate might be higher on one, I didn't actually test if the booking rate would be higher. I didn't let it run long enough.\"</p>\n<p>Don't kill tests too early based on reply rate alone.</p>\n"}