frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Ask HN: What are other "uncrackable benchmarks"?

3•Nail2680•4h ago
I have my own benchmark for AI just based off my Doctoral Thesis, which isn't public(university constraints). I am wondering if other people have other "hidden" benchmarks? I have a few I have made, and one wonder if talking about them devalues them, and two can a good test set be made that can't be leaked?

Comments

retrac•3h ago
Effective natural language processing of sign languages. Current LLMs are almost completely incapable. And it's a steep hill to climb. No text corpus. Must be learned from video. I do not believe current LLM approaches are capable of this with the amount of training material available, regardless of compute. Though I'm eager to be shown wrong.

Ask HN: How do you manage skills files?

79•imadtaieber•11h ago•63 comments

Ask HN: Fable hacked my piano, can I release the results?

99•jmpman•1d ago•55 comments

Ask HN: Would you read a statistics textbook?

59•usernametaken29•1d ago•27 comments

Ask HN: Show your micro-SaaS

11•genekrapivin•10h ago•3 comments

Tell HN: Anthropic should make Claude the Author and me the Co-Author

4•xeonax•2h ago•3 comments

Ask HN: UK Rescue Rocket Sheds/Houses Information

22•burnt-resistor•11h ago•6 comments

Ask HN: Looking for an old submission about sneering culture

3•annex-winged-cr•3h ago•0 comments

Ask HN: Connecting Kubernetes dependencies to application telemetry

4•chipfixer•14h ago•0 comments

Ask HN: What are other "uncrackable benchmarks"?

3•Nail2680•4h ago•1 comments

Ask HN: Any Software Engineers here who enjoy their AI-native dev workflow?

5•pkos98•17h ago•5 comments

Ask HN: (Why) Was the LLM breakthrough useful for images, audio, etc.?

3•rogerrogerr•14h ago•2 comments

Ask HN: Perplexity Pro vs. Claude – what are you paying for?

2•daytonflyers•5h ago•1 comments

Ask HN: Who is using MCP in production?

190•sukit•3d ago•196 comments

Ask HN: Resources to get good at soldering?

271•tosmatos•4d ago•164 comments

Ask HN: Why were OpenAI, Claude, and Grok simultaneously down?

402•halcdev•3d ago•703 comments

Ask HN: How safe are our password managers in face of LLM cyber attacks?

3•muddi900•13h ago•0 comments

Ask HN: What is your biggest struggle while learning?

2•Cursed666•7h ago•1 comments

Ask HN: Why don't we bring back old school OkCupid?

34•firefax•1d ago•58 comments

Ask HN: What are you working on?

5•meerita•13h ago•8 comments

Tell HN: I want to see the same moon as you

15•UnderABlueMoon•2d ago•13 comments

Ask HN: Model sycophancy benchmarks?

4•gradus_ad•13h ago•2 comments

Tell HN: Both recent GCP outages caused by fiber optic maintenance

19•fastest963•3d ago•1 comments

Ask HN: Are we normalizing surveillance in the name of safety?

3•dennysora-main•18h ago•2 comments

Astra still fails at creating acceptable Rotational Ambigram

3•das_vicky•19h ago•3 comments

Ask HN: Are others seeing Google's reCAPTCHA rejecting Firefox users?

71•Animats•3d ago•24 comments

Ask HN: 30, burnt out, with 6-10 months of runway. What would you do?

31•throwaway_30yo•4d ago•26 comments

Ask HN: Do you route only certain websites through a VPN?

2•dennysora-main•1d ago•4 comments

APAC Alpha – Zero-lag Intel terminal for Asian markets

2•apacalpha•1d ago•0 comments

Ask HN: What's the best place to learn about skills and AI for coding in general

4•rrmdp•11h ago•4 comments

Ask HN: Any Alternatives to Archive.ph & co?

7•hebelehubele•1d ago•4 comments