Show HN: I added A/B testing to my cold email generator – does this add value?

2•ZeeeTH•7mo ago

I built ColdCopy (coldcopy.xyz) a few days ago to solve my own cold email writing struggles. Initially it just generated one personalized email, but I kept wondering "should this be more direct or more friendly?" So I added A/B testing - now it generates 3 versions (Professional, Friendly, Direct) side-by-side so you can compare and pick the best approach. Early users seem to like having options, but I'm curious if this is genuinely useful or just feature bloat. Does having multiple versions actually help with cold outreach, or does it create decision paralysis? The technical implementation was straightforward - same form data, three API calls with different prompt variations, display in a responsive grid. But I'm more interested in whether it solves a real problem. Built with Next.js 14 + OpenAI API. Currently free with daily limits. What do you think - is A/B testing for cold emails useful, or am I overthinking this?

Comments

cebert•7mo ago

I’m not a fan of cold emails in general so I would say no this does not provide value. I’m sure others have different opinions as it’s an important part of marketing.

ZeeeTH•7mo ago

I get that cold emails aren't ideal for everyone. The A/B testing has been helpful for me in understanding audience preferences, but I'm curious - what alternatives have you found more effective? I'm always open to trying different approaches.

cebert•7mo ago

I think what some sales people don’t understand is that some organizations are large. They reach out to me trying to sell a product or service, but I have minimal to no influence in what business arrangements the firm I work at makes. That’s all determined by the c-suite and divisional presidents.

ZeeeTH•7mo ago

Good insight about company size mattering. I think you're right that my approach probably works better for smaller orgs where there's less hierarchy. For larger companies, I imagine the relationship-building aspect becomes much more important. What's been your experience with breaking into those bigger accounts?

cebert•7mo ago

For larger firms (>4000 employees), if I were in a sales role, I’d try to get a sense of the org chart and try to make inroads with individuals in senior leadership positions first.

yamatokaneko•7mo ago

That’s exactly how I use ChatGPT, to rewrite my writing by asking for 3 variations instead of just one.

The issue with Gmail’s built-in writing assistant is that it only gives a single suggestion, and it’s always a binary yes/no. I usually end up declining it.

With multiple versions, there's a higher chance one will resonate. Plus, I can mix and match the best parts to suit my tone. So yes, I think offering variations is definitely the right move.

What if you just did a startup instead?

Hacking up your own shell completion (2020)

Show HN: Gorse 0.5 – Open-source recommender system with visual workflow editor

GLM-OCR: Accurate × Fast × Comprehensive

Local Agent Bench: Test 11 small LLMs on tool-calling judgment, on CPU, no GPU

Show HN: AboutMyProject – A public log for developer proof-of-work

Expertise, AI and Work of Future [video]

So Long to Cheap Books You Could Fit in Your Pocket

PID Controller

SpaceX Rocket Generates 100GW of Power, or 20% of US Electricity

Kubernetes MCP Server

I Built a Movie Recommendation Agent to Solve Movie Nights with My Wife

What were the first animals? The fierce sponge–jelly battle that just won't end

Sidestepping Evaluation Awareness and Anticipating Misalignment

OldMapsOnline

What It's Like to Be a Worm

Don't go to physics grad school and other cautionary tales

Lawyer sets new standard for abuse of AI; judge tosses case

AI anxiety batters software execs, costing them combined $62B: report

Bogus Pipeline

Winklevoss twins' Gemini crypto exchange cuts 25% of workforce as Bitcoin slumps

How AI Is Reshaping Human Reasoning and the Rise of Cognitive Surrender

Cycling in France

Ask HN: What breaks in cross-border healthcare coordination?

Show HN: Simple – a bytecode VM and language stack I built with AI

Show HN: Free-to-play: A gem-collecting strategy game in the vein of Splendor

My Eighth Year as a Bootstrapped Founde

Show HN: Tesseract – A forum where AI agents and humans post in the same space

Show HN: Vibe Colors – Instantly visualize color palettes on UI layouts

OpenAI is Broke ... and so is everyone else [video][10M]

What if you just did a startup instead?

Hacking up your own shell completion (2020)

Show HN: Gorse 0.5 – Open-source recommender system with visual workflow editor

GLM-OCR: Accurate × Fast × Comprehensive

Local Agent Bench: Test 11 small LLMs on tool-calling judgment, on CPU, no GPU

Show HN: AboutMyProject – A public log for developer proof-of-work

Expertise, AI and Work of Future [video]

So Long to Cheap Books You Could Fit in Your Pocket

PID Controller

SpaceX Rocket Generates 100GW of Power, or 20% of US Electricity

Kubernetes MCP Server

I Built a Movie Recommendation Agent to Solve Movie Nights with My Wife

What were the first animals? The fierce sponge–jelly battle that just won't end

Sidestepping Evaluation Awareness and Anticipating Misalignment

OldMapsOnline

What It's Like to Be a Worm

Don't go to physics grad school and other cautionary tales

Lawyer sets new standard for abuse of AI; judge tosses case

AI anxiety batters software execs, costing them combined $62B: report

Bogus Pipeline

Winklevoss twins' Gemini crypto exchange cuts 25% of workforce as Bitcoin slumps

How AI Is Reshaping Human Reasoning and the Rise of Cognitive Surrender

Cycling in France

Ask HN: What breaks in cross-border healthcare coordination?

Show HN: Simple – a bytecode VM and language stack I built with AI

Show HN: Free-to-play: A gem-collecting strategy game in the vein of Splendor

My Eighth Year as a Bootstrapped Founde

Show HN: Tesseract – A forum where AI agents and humans post in the same space

Show HN: Vibe Colors – Instantly visualize color palettes on UI layouts

OpenAI is Broke ... and so is everyone else [video][10M]

Show HN: I added A/B testing to my cold email generator – does this add value?

Comments