frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

I Solved PyTorch's Cross-Platform Nightmare

https://svana.name/2025/09/how-i-solved-pytorchs-cross-platform-nightmare/
40•msvana•3d ago

Comments

Simulacra•2h ago
Good writeup. PyTorch has generally been very good to me when I can mitigate its resource hogging at times. Production can be a little wonky but for everything else it works
di•2h ago
Note that https://peps.python.org/pep-0440/#direct-references says:

> Public index servers SHOULD NOT allow the use of direct references in uploaded distributions. Direct references are intended as a tool for software integrators rather than publishers.

This means that PyPI will not accept your project metadata as you currently have it configured. See https://github.com/pypi/warehouse/issues/7136 for more details.

doctorpangloss•4m ago
Guess the guy who wrote this article will learn the hard way: The last 20% of packaging is 800% of your time.
mdaniel•1h ago
> Cross-Platform

  cpu = [
  "torch @ <https://download.pytorch.org/whl/cpu/torch-2.7.1%2Bcpu-cp312-cp312-manylinux_2_28_x86_64.whl> ; python_version == '3.12'",
  "torch @ <https://download.pytorch.org/whl/cpu/torch-2.7.1%2Bcpu-cp313-cp313-manylinux_2_28_x86_64.whl> ; python_version == '3.13'",
  ]
:-/ It reminds me of Microsoft calling their thing "cross platform" because it works on several copies of Windows

In all seriousness, I get the impression that pytorch is such a monster PITA to manage because it cares so much about the target hardware. It'd be like a blog post saying "I solved the assembly language nightmare"

gobdovan•29m ago
Torch simply has to work this way because it cares about performance on a combination of multiple systems and dozens of GPUs. The complexity leaks into packaging.

If you do not care about performance and would rather have portability, use an alternative like tinygrad that does not optimize for every accelerator under the sun.

This need for hardware-specific optimization is also why the assembly language analogy is a little imprecise. Nobody expects one binary to run on every CPU or GPU with peak efficiency, unless you are talking about something like Redbean which gets surprisingly far (the creator actually worked on the TensorFlow team and addressed similar cross-platform problems).

So maybe the the blogpost you're looking for is https://justine.lol/redbean2/.

lynndotpy•55m ago
> Setting up a Python project that relies on PyTorch, so that it works across different accelerators and operating systems, is a nightmare.

I would like to add some anecdata to this.

When I was a PhD student, I already had 12 years of using and administrating Linuxes as my personal OS, and I'd already had my share of package manager and dependency woes.

But managing Python, PyTorch, and CUDA dependencies were relatively new to me. Sometimes I'd lose an evening here or there to something silly. But I had one week especially dominated by these woes, to the point where I'd have dreams about package management problems at the terminal.

They were mundane dreams but I'd chalk them up as nightmares. The worst was having the pleasant dream where those problems went away forever, only to wake up to realize that was not the case.

kwon-young•47m ago
In my opinion, anything that touch compiled packages like pytorch should be packaged with conda/mamba on conda-forge. I found it is the only package manager for python which will reliably detect my hardware and install the correct version of every dependency.
zbowling•4m ago
Try pixi! Pixi is a much more sane way for building with conda + pypi packages in a single tool that makes this so much easier for torch development, regardless if you get the condaforge or pypi builds of pytorch. https://pixi.sh/latest/

GrapheneOS and Forensic Extraction of Data (2024)

https://discuss.grapheneos.org/d/13107-grapheneos-and-forensic-extraction-of-data
197•SoKamil•3h ago•64 comments

Gregg Kellogg has passed away

https://lists.w3.org/Archives/Public/public-json-ld-wg/2025Sep/0012.html
198•daenney•4h ago•29 comments

Behind the Scenes of Bun Install

https://bun.com/blog/behind-the-scenes-of-bun-install
145•Bogdanp•3h ago•51 comments

Spiral

https://spiraldb.com/post/announcing-spiral
12•jorangreef•32m ago•0 comments

Conway's Game of Life, but Musical

https://www.hudsong.dev/digital-darwin
58•hudsongr•2h ago•14 comments

An Engineering History of the Manhattan Project

https://www.construction-physics.com/p/an-engineering-history-of-the-manhattan
49•rbanffy•3h ago•18 comments

Reshaped is now open source

https://reshaped.so/blog/reshaped-oss
180•michaelmior•6h ago•40 comments

The US is now the largest investor in commercial spyware

https://arstechnica.com/security/2025/09/the-us-is-now-the-largest-investor-in-commercial-spyware/
62•furcyd•1h ago•16 comments

The Rise of Async Programming

https://www.braintrust.dev/blog/async-programming
39•mooreds•3h ago•24 comments

Strong Eventual Consistency – The Big Idea Behind CRDTs

https://lewiscampbell.tech/blog/250908.html
9•todsacerdoti•3d ago•1 comments

I Solved PyTorch's Cross-Platform Nightmare

https://svana.name/2025/09/how-i-solved-pytorchs-cross-platform-nightmare/
40•msvana•3d ago•8 comments

Mapping to the PICO-8 palette, perceptually

https://30fps.net/pages/perceptual-pico8-pixel-mapping/
46•ibobev•3d ago•13 comments

DeepCodeBench: Real-World Codebase Understanding by Q&A Benchmarking

https://www.qodo.ai/blog/deepcodebench-real-world-codebase-understanding-by-qa-benchmarking/
63•blazercohen•6h ago•4 comments

GrapheneOS accessed Android security patches but not allowed to publish sources

https://grapheneos.social/@GrapheneOS/115164133992525834
116•uneven9434•8h ago•21 comments

Piramidal (YC W24) Is Hiring Back End Engineer

https://www.ycombinator.com/companies/piramidal/jobs/1HvdaXs-full-stack-engineer-platform
1•dsacellarius•4h ago

KDE launches its own distribution

https://lwn.net/SubscriberLink/1037166/caa6979c16a99c9e/
625•Bogdanp•18h ago•426 comments

PgEdge Goes Open Source

https://www.pgedge.com/blog/pgedge-goes-open-source
69•Bogdanp•8h ago•13 comments

NearToilets – Airbnb of toilets, earn from toilets for rent

https://neartoilets.com/
29•kevin11111•1h ago•39 comments

Show HN: Term.everything – Run any GUI app in the terminal

https://github.com/mmulet/term.everything
1004•mmulet•2d ago•135 comments

Show HN: I built a minimal Forth-like stack interpreter library in C

19•Forgret•4h ago•8 comments

DOOMscrolling: The Game

https://ironicsans.ghost.io/doomscrolling-the-game/
377•jfil•17h ago•88 comments

Hashed sorting is typically faster than hash tables

https://reiner.org/hashed-sorting
153•Bogdanp•3d ago•32 comments

ChatGPT Developer Mode: Full MCP client access

https://platform.openai.com/docs/guides/developer-mode
487•meetpateltech•1d ago•268 comments

CRISPR Offers New Hope for Treating Diabetes

https://www.wired.com/story/no-more-injections-crispr-offers-new-hope-for-treating-diabetes/
34•manveerc•2h ago•10 comments

How the tz database works (2020)

https://yatsushi.com/blog/tz-database/
56•jumbosushi•3d ago•10 comments

Germany is not supporting ChatControl – blocking minority secured

https://digitalcourage.social/@echo_pbreyer/115184350819592476
917•xyzal•7h ago•289 comments

Where did the Smurfs get their hats (2018)

https://www.pipelinecomics.com/beginning-bd-smurfs-hats-origin/
121•andsoitis•15h ago•51 comments

C++20 Modules: Practical Insights, Status and TODOs

https://chuanqixu9.github.io/c++/2025/08/14/C++20-Modules.en.html
51•ashvardanian•3d ago•47 comments

Court rejects Verizon claim that selling location data without consent is legal

https://arstechnica.com/tech-policy/2025/09/court-rejects-verizon-claim-that-selling-location-dat...
581•nobody9999•14h ago•69 comments

Brussels faces privacy crossroads over encryption backdoors

https://www.theregister.com/2025/09/11/eu_chat_control/
60•jjgreen•4h ago•18 comments