frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

GPT‑6.2 Astra and Sol

https://openai.com/index/introducing-gpt-6-2-astra-sol/
698•jasondavies•2h ago•418 comments

Apple Services Down

https://developer.apple.com/system-status/
392•willy_k•2h ago•220 comments

MAI Code 2 and Code 2 Flash

https://microsoft.ai/news/introducing-mai-code-2-and-mai-code-2-flash/
123•lemonish97•1h ago•57 comments

jQuery 4.1.0

https://github.com/jquery/jquery/releases/tag/4.1.0
30•petecooper•24m ago•17 comments

350 years ago, this man discovered that light has a finite speed

https://www.sciencenorway.no/culture-history-history-of-science/350-years-ago-this-man-discovered...
46•dxs•49m ago•4 comments

Phrack 73 Released

https://phrack.org/issues/73/introduction_md
79•notmine1337•1h ago•3 comments

Israel vs. Wikipedia

https://techforpalestine.org/wikipedia-report
31•srvo•5m ago•0 comments

Solid 2.0

https://www.solidjs.com/blog/solid-2-0-the-long-hold/
68•pier25•1h ago•18 comments

What is the best harness for each model?

https://runta.com/blog/introducing-frontierharness-eval-v1-1/
269•Edward40•5h ago•97 comments

Web Browser Engineering

https://browser.engineering/
7•ibobev•13m ago•0 comments

Launch HN: StarSling (YC P25) – Self-improving CI for agent-volume repos

https://starsling.dev
22•yonasb•1h ago•5 comments

YC wrote software to run our internship expo – and an 8-bit SIM to show it off

1•ryankicks•3h ago

Who Builds the Machines That Build the Machines?

https://read.corematter.com/p/section-232-us-machine-tools
44•gmays•2h ago•6 comments

Purism Launches Librem 5 v2, a RISC-V Phone to Empower People

https://puri.sm/posts/purism-launches-librem-5-v2-a-risc-v-phone-to-empower-people/
30•gnufx•1h ago•24 comments

Show HN: Alloy CSS, dialogs, menus and tabs that work with JavaScript off

https://alloyhtml.com/example.html
142•prafandy•5h ago•23 comments

New Evidence Shows School Phone Bans Are Gradually Improving Test Scores

https://www.nytimes.com/2026/11/17/upshot/school-phone-bans-study-scores.html
1009•donohoe•8h ago•500 comments

Israel Is Attacking Wikipedia

https://techforpalestine.org/wikipedia-report-2026
8•pauldelany•3m ago•1 comments

NSA Internal Network Down

https://www.reuters.com/technology/highly-classified-us-national-security-communications-network-...
310•nodoodles•4h ago•179 comments

Mouse Party

https://aboard.com/lets-have-a-mouse-party/
10•bookofjoe•3d ago•0 comments

How the Claude Code team thinks about verification

https://claude.dev/blog/how-the-claude-code-team-thinks-about-verification/
210•craigmart•9h ago•162 comments

First Photos of the Poles of a Rod-Shaped Bacterium

https://nautil.us/check-out-the-first-photos-of-the-poles-of-a-rod-shaped-bacterium-1286664
94•dustfinger•1d ago•20 comments

Advancing computer-use agents for healthcare teams

https://openai.com/index/advancing-computer-use-for-healthcare-teams/
14•gmays•1h ago•8 comments

Nvidia stopped disclosing Singapore sales as revenues hit $104B

https://www.ft.com/content/dbde7a30-548c-4f9d-a4be-7898a0c24dcf
131•louiereederson•3h ago•66 comments

Elephant-Goldfish Model

https://egm.dev/
43•_tk_•1d ago•18 comments

Optimizely compromised, served malware on Zoom, GitLab

https://blog.report-uri.com/worlds-largest-brands-infected-with-malware-via-optimizely/
642•kristjansson•21h ago•254 comments

VisualBasic.World: A gallery of Planet Source Code programs from 1997 to 2012

https://visualbasic.world/
191•broast•1d ago•73 comments

Exploiting Replay Protected Monotonic Counters to Brute-Force Windows Hello PINs

https://arxiv.org/abs/2611.18126
37•cwerling•1d ago•3 comments

iCloud, App Store, and other Apple services hit by ongoing outage

https://9to5mac.com/2026/11/17/icloud-app-store-and-other-apple-services-hit-by-ongoing-outage/
60•srameshc•2h ago•22 comments

Show HN: TrnRT – An open-source LLM inference engine for AWS Trainium

https://github.com/RunanywhereAI/trnrt
27•sanchitmonga22•4h ago•5 comments

Carnegie Mellon is putting computer science courses on YouTube for free

https://www.cs.cmu.edu/learn/
2217•pcompeau•23h ago•299 comments
Open in hackernews

Production tests: a guidebook for better systems and more sleep

https://martincapodici.com/2025/05/13/production-tests-a-guidebook-for-better-systems-and-more-sleep/
78•mcapodici•1y ago

Comments

ashishb•1y ago
Here's a general rule that I follow along with this and that is "write tests along the axis of minimum change"[1]. Such tests are more valuable and require less maintenance over time.

1 - https://ashishb.net/programming/bad-and-good-ways-to-write-a...

compumike•1y ago
I'd add that, in terms of tactical implementation, production tests can be implemented at least two different ways:

(1) You set up an outside service to send an HTTP response (or run a headless browser session) every minute, and your endpoint runs some internal assertions that everything looks good, and returns 200 on success.

(2) You set up a scheduled job to run every minute internal to your service. This job does some internal assertions that everything looks good, and sends a heartbeat to an outside service on success.

For #2: most apps of any complexity will already have some system for background and scheduled jobs, so #2 can make a lot of sense. It can also serve as a production assertion that your background job system (Sidekiq, Celery, Resque, crond, systemd, etc) is healthy and running! But it doesn't test the HTTP side of your stack at all.

For #1: it has the advantage that you also get to assert that all the layers between your user and your application are up and running: DNS, load balancers, SSL certificates, etc. But this means that on failure, it may be less immediately clear whether the failure is internal to your application, or somewhere else in the stack.

My personal take has been to lean toward #2 more heavily (lots of individual check jobs that run once per minute inside Sidekiq, and then check-in on success), but with a little bit of #1 sprinkled in as well (some lightweight health-check endpoints, others that do more intense checks on various parts of the system, a few that monitor various redirects like www->root domain or http->https). And for our team we implement both #1 and #2 with Heii On-Call https://heiioncall.com/ : for #2, sending heartbeats from the cron-style check jobs to the "Inbound Liveness" triggers, and for #1, implementing a bunch of "Outbound Probe" HTTP uptime checks with various assertions on the response headers etc.

And this production monitoring is all in addition to a ton of rspec and capybara tests that run in CI before a build gets deployed. In terms of effort or lines of code, it's probably:

    90% rspec and capybara tests that run on CI (not production tests)
    9% various SystemXyzCheckJob tests that run every minute in production and send a heartbeat
    1% various health check endpoints with different assertions that are hit externally in production
And absolutely agree about requiring multiple consecutive failures before an alarm! Whenever I'm woken up by a false positive, my default timeout (i.e. # of consecutive failures required) gets a little bit higher :)
hugs•1y ago
yeah, full end-to-end tests/monitors are like fire alarms: they can often tell you something is wrong, but not exactly what is wrong. but that doesn't mean fire alarms have no value. most common failure mode for teams are having too many or none at all. but having a few in a few key places is the way to go.
mhw•1y ago
The fabulous blazer gem includes a feature for #2: https://github.com/ankane/blazer?tab=readme-ov-file#checks - it’s limited to checks that can be expressed as SQL queries, but that can get you quite a way
aleksiy123•1y ago
At Google we call these probers.

Does anyone know of any tools/saas that do this.

Was thinking it may be a good potential product.

Especially if it was super easy to generate/spin up for side projects.

hugs•1y ago
"testing in production" can be controversial, but this is a well-balanced take on it.

lately i've been working on a decentralized production testing network called 'valet network' [1] (full-disclosure: selenium creator here)

i suspect production tests are the killer app for this kind of network: test any site on a real device from anywhere on idle devices that more closely match real world conditions, but as mentioned in the article, it's not that simple. dev users will still need to be smart about creating test data and filtering out the tests from system logs. i'm still in the "is this something people want?" learning phase, even though this is definitely something i want and wish i had when i was helping to fix healthcare.gov back in 2013/2014.

[1]: https://gist.github.com/hugs/7ba46b32d3a21945e08e78510224610...

vasusen•1y ago
Thank you for the balanced take on an extremely spicy topic.

At WePay (YC S09) we debated this extensively and came up with a similar middle of the way solution. Making sure that a credit card can get tokenized is the critical flow and should run every minute. We ended up with about 4-5 very quick production tests. They helped with debugging as well as alerting.

I am now building a full, automated testing solution at Donobu (https://www.donobu.com), and production tests definitely come up as their own subcategory of e2e tests. I am going to use your guidelines to refine our prompt and bound our production test generator.

testthetest•1y ago
> Running a test every minute, or 1440 times a day, will show up quite a lot in logs, metrics, and traces.

...not to mention that automated tests are by definition bot traffic, and websites do/should have protections against spam. Cloudflare or AWS WAF tends to filter out some of our AWS DeviceFarm tests, and running automated tests directly from EC2 instances is pretty much guaranteed to be caught by Captcha. Which is not a complaint: this is literally what they were designed to do.

A way to mitigate this issue is to implement "test-only" user agents or tokens to make sure that synthetic requests are distinguishable from real ones, but that means that our code does something in testing that it doesn't do in "real life". (The full Volkswagen effect.)

burnt-resistor•1y ago
Also known as deep monitoring: checking that functionality is available and working correctly.