Hey there all, I'm a solo founder and this is my first project, so be gentle with it.
So, for the past year I did build some of my ideas I had in the past but never had enough time and today's AI helps accelerate projects's development like never before. My Major is SWE so like many of you in here maybe I did pursue some ideas just to realise that the product has been already built by a random company 2 days before, it could be killed by another update coming form the big LLM vendors or it's just not feasible.I know it sounds dumb but just getting really excited by building an idea you've had for a long time can just make you blind.
Based on my past 4 failed projects that were killed right before launch, I did create initially a system that goes all over the internet to look at people's pain points to see if my products would be targeting people's needs or will it be another product that will never see the light of the day. It got iterated a few times to actually give pain scores on every idea that came in from my ideas notebook and I did test it and refine it to actually be as merciless as possible and seek valid reason why an idea should be build or not, this has been done on a daily basis for the past months to not create a roleplay ideas roaster that can be vibe coded in less than a month.
This based truth detector led me to launch today Skeptral:
- it consists of independent LLMs from different vendors and each scores an idea 0-100
- it returns Scale, Pivot, or Kill, with a sourced reason for the verdict that you can click through.
I fed it 205 of my own ideas. 41 came back killed outright, 162 wounded, and 2 survived intact. That's the dataset this post links to. You can sort it, read the kill-shots, and find the cases where the models split, which are the interesting ones.
To check it isn't just cynical, I ran a calibration set:
- five deliberately absurd ideas (it killed all five) and five companies that later got huge, each worded the way it sounded before it worked
- It killed Uber, Dropbox, Twitter and Stripe.
- Only Airbnb survived, to Pivot.
So yes, it would have told me not to build Stripe.
I'd rather show that than hide it:
- it's calibrated against absurdity, not clairvoyant about the future and the kill-shot is a checkable argument not a verdict from God.
How a split resolves:
- I don't average the scores, that launders the signal.
- A kill is sticky. If any model lands a sourced, obvious kill, the verdict trends Kill unless the others can rebut the source because a real reason to die beats two vibes to live.
Pasted ideas aren't stored, pooled or trained on.
There are zero testimonials, on purpose, because the whole point is no flattery.
The dataset is the proof instead.
Paste your own idea in the free box no login and try to make it survive.
If a kill-shot is wrong, reply and tell me exactly where it fails, that would be really useful!
Thank you for taking the time to read it and I hope it will help you as it did me!
mdiske•52m ago
So, for the past year I did build some of my ideas I had in the past but never had enough time and today's AI helps accelerate projects's development like never before. My Major is SWE so like many of you in here maybe I did pursue some ideas just to realise that the product has been already built by a random company 2 days before, it could be killed by another update coming form the big LLM vendors or it's just not feasible.I know it sounds dumb but just getting really excited by building an idea you've had for a long time can just make you blind.
Based on my past 4 failed projects that were killed right before launch, I did create initially a system that goes all over the internet to look at people's pain points to see if my products would be targeting people's needs or will it be another product that will never see the light of the day. It got iterated a few times to actually give pain scores on every idea that came in from my ideas notebook and I did test it and refine it to actually be as merciless as possible and seek valid reason why an idea should be build or not, this has been done on a daily basis for the past months to not create a roleplay ideas roaster that can be vibe coded in less than a month.
This based truth detector led me to launch today Skeptral: - it consists of independent LLMs from different vendors and each scores an idea 0-100 - it returns Scale, Pivot, or Kill, with a sourced reason for the verdict that you can click through.
I fed it 205 of my own ideas. 41 came back killed outright, 162 wounded, and 2 survived intact. That's the dataset this post links to. You can sort it, read the kill-shots, and find the cases where the models split, which are the interesting ones.
To check it isn't just cynical, I ran a calibration set: - five deliberately absurd ideas (it killed all five) and five companies that later got huge, each worded the way it sounded before it worked - It killed Uber, Dropbox, Twitter and Stripe. - Only Airbnb survived, to Pivot.
So yes, it would have told me not to build Stripe.
I'd rather show that than hide it: - it's calibrated against absurdity, not clairvoyant about the future and the kill-shot is a checkable argument not a verdict from God.
How a split resolves: - I don't average the scores, that launders the signal. - A kill is sticky. If any model lands a sourced, obvious kill, the verdict trends Kill unless the others can rebut the source because a real reason to die beats two vibes to live.
Pasted ideas aren't stored, pooled or trained on.
There are zero testimonials, on purpose, because the whole point is no flattery.
The dataset is the proof instead.
Paste your own idea in the free box no login and try to make it survive.
If a kill-shot is wrong, reply and tell me exactly where it fails, that would be really useful!
Thank you for taking the time to read it and I hope it will help you as it did me!