Show HN: I added A/B testing to my cold email generator – does this add value?

2•ZeeeTH•7mo ago

I built ColdCopy (coldcopy.xyz) a few days ago to solve my own cold email writing struggles. Initially it just generated one personalized email, but I kept wondering "should this be more direct or more friendly?" So I added A/B testing - now it generates 3 versions (Professional, Friendly, Direct) side-by-side so you can compare and pick the best approach. Early users seem to like having options, but I'm curious if this is genuinely useful or just feature bloat. Does having multiple versions actually help with cold outreach, or does it create decision paralysis? The technical implementation was straightforward - same form data, three API calls with different prompt variations, display in a responsive grid. But I'm more interested in whether it solves a real problem. Built with Next.js 14 + OpenAI API. Currently free with daily limits. What do you think - is A/B testing for cold emails useful, or am I overthinking this?

Comments

cebert•7mo ago

I’m not a fan of cold emails in general so I would say no this does not provide value. I’m sure others have different opinions as it’s an important part of marketing.

ZeeeTH•7mo ago

I get that cold emails aren't ideal for everyone. The A/B testing has been helpful for me in understanding audience preferences, but I'm curious - what alternatives have you found more effective? I'm always open to trying different approaches.

cebert•7mo ago

I think what some sales people don’t understand is that some organizations are large. They reach out to me trying to sell a product or service, but I have minimal to no influence in what business arrangements the firm I work at makes. That’s all determined by the c-suite and divisional presidents.

ZeeeTH•7mo ago

Good insight about company size mattering. I think you're right that my approach probably works better for smaller orgs where there's less hierarchy. For larger companies, I imagine the relationship-building aspect becomes much more important. What's been your experience with breaking into those bigger accounts?

cebert•7mo ago

For larger firms (>4000 employees), if I were in a sales role, I’d try to get a sense of the org chart and try to make inroads with individuals in senior leadership positions first.

yamatokaneko•7mo ago

That’s exactly how I use ChatGPT, to rewrite my writing by asking for 3 variations instead of just one.

The issue with Gmail’s built-in writing assistant is that it only gives a single suggestion, and it’s always a binary yes/no. I usually end up declining it.

With multiple versions, there's a higher chance one will resonate. Plus, I can mix and match the best parts to suit my tone. So yes, I think offering variations is definitely the right move.

The Greater Copenhagen Region could be your friend's next career move

Do Not Confirm – Fiction by OpenClaw

The Analytical Profile of Peas

Hallucinations in GPT5 – Can models say "I don't know" (June 2025)

What AI is good for, according to developers

OpenAI might pivot to the "most addictive digital friend" or face extinction

Show HN: Know how your SaaS is doing in 30 seconds

ClawdBot Ordered Me Lunch

What the News media thinks about your Indian stock investments

Running Lua on a tiny console from 2001

Google and Microsoft Paying Creators $500K+ to Promote AI Tools

New filtration technology could be game-changer in removal of PFAS

Show HN: I saw this cool navigation reveal, so I made a simple HTML+CSS version

Kinda Surprised by Seadance2's Moderation

I Write Games in C (yes, C)

Django scales. Stop blaming the framework (part 1 of 3)

Malwarebytes Is Now in ChatGPT

Thoughts on the job market in the age of LLMs

Show HN: Stacky – certain block game clone

AIII: A public benchmark for AI narrative and political independence

SectorC: A C Compiler in 512 bytes

The API Is a Dead End; Machines Need a Labor Economy

Digital Iris [video]

New wave of GLP-1 drugs is coming–and they're stronger than Wegovy and Zepbound

Convert tempo (BPM) to millisecond durations for musical note subdivisions

Show HN: Tasty A.F.

The Contagious Taste of Cancer

U.S. Jobs Disappear at Fastest January Pace Since Great Recession

Bithumb mistakenly hands out $195M in Bitcoin to users in 'Random Box' giveaway

Beyond Agentic Coding

The Greater Copenhagen Region could be your friend's next career move

Do Not Confirm – Fiction by OpenClaw

The Analytical Profile of Peas

Hallucinations in GPT5 – Can models say "I don't know" (June 2025)

What AI is good for, according to developers

OpenAI might pivot to the "most addictive digital friend" or face extinction

Show HN: Know how your SaaS is doing in 30 seconds

ClawdBot Ordered Me Lunch

What the News media thinks about your Indian stock investments

Running Lua on a tiny console from 2001

Google and Microsoft Paying Creators $500K+ to Promote AI Tools

New filtration technology could be game-changer in removal of PFAS

Show HN: I saw this cool navigation reveal, so I made a simple HTML+CSS version

Kinda Surprised by Seadance2's Moderation

I Write Games in C (yes, C)

Django scales. Stop blaming the framework (part 1 of 3)

Malwarebytes Is Now in ChatGPT

Thoughts on the job market in the age of LLMs

Show HN: Stacky – certain block game clone

AIII: A public benchmark for AI narrative and political independence

SectorC: A C Compiler in 512 bytes

The API Is a Dead End; Machines Need a Labor Economy

Digital Iris [video]

New wave of GLP-1 drugs is coming–and they're stronger than Wegovy and Zepbound

Convert tempo (BPM) to millisecond durations for musical note subdivisions

Show HN: Tasty A.F.

The Contagious Taste of Cancer

U.S. Jobs Disappear at Fastest January Pace Since Great Recession

Bithumb mistakenly hands out $195M in Bitcoin to users in 'Random Box' giveaway

Beyond Agentic Coding

Show HN: I added A/B testing to my cold email generator – does this add value?

Comments