Uv and Ray: Pain-Free Python Dependencies in Clusters

https://www.anyscale.com/blog/uv-ray-pain-free-python-dependencies-in-clusters

44•robertnishihara•7mo ago

Comments

jessekv•7mo ago

It would be a fun callback if the demo was a factorial server:

https://joearms.github.io/#2013-11-21%20My%20favorite%20Erla...

lz400•7mo ago

Unfortunately uv is usually insufficient for certain ML deployments in Python. It's a real pain to install pytorch/CUDA with all the necessary drivers and C++ dependencies so people tend to fall back to conda.

Any modern tips / life hacks for this situation?

devjab•7mo ago

https://docs.astral.sh/uv/guides/integration/pytorch/#automa...

doesn't work?

lz400•7mo ago

the problem is that you still need to install all the low level stuff manually, conda does it automatically

gcarvalho•7mo ago

I was pleasantly surprised to try the guide out and see that it just worked:

    λ uv venv && uv pip install torch --torch-backend=auto
    λ uv run python -c 'import torch; print(torch.cuda.is_available())'
    True

This is on Debian stable, and I don't remember doing any special setup other than installing the proprietary nvidia driver.

pcwelder•7mo ago

This script has been sufficient for me to configure gpu drivers on fresh ubuntu machines. It's just uv add torch after this.

https://cloud.google.com/compute/docs/gpus/install-drivers-g... (NOTE: not gcloud specific)

Kydlaw•7mo ago

You should give a try to https://pixi.sh/latest/ (I am not involve in the project).

They are a little more focus on scientific computing than uv, which is more general. They might be a better option in your case.

miohtama•7mo ago

Would it be possible to use Docker to manage native dependencies?

rsfern•7mo ago

Are there particular libraries that make your setup difficult? I just manually set the index and source following the docs (didn’t know about the auto backend feature) and pin a specific version if I really have to with `uv add “torch==2.4”`. This works pretty well for me for projects that use dgl, which heavily uses C++ extensions and can be pretty finicky about working with particular versions

This is in a conventional HPC environment, and I’ve found it way better than conda since the dependency solves are so much faster and I no longer experience PyTorch silently getting downgraded to cpu version of I install a new library. Maybe I’ve been using conda poorly though?

chatmasta•7mo ago

A whole blog post and nine comments and nobody has made the pun about UV Rays?!

Tiny C Compiler

You Are Here

SectorC: A C Compiler in 512 bytes

The F Word

Speed up responses with fast mode

LLMs as the new high level language

Software factories and the agentic moment

Hoot: Scheme on WebAssembly

OpenCiv3: Open-source, cross-platform reimagining of Civilization III

Stories from 25 Years of Software Development

GitBlack: Tracing America's Foundation

FDA intends to take action against non-FDA-approved GLP-1 drugs

Show HN: A luma dependent chroma compression algorithm (image compression)

Al Lowe on model trains, funny deaths and working with Disney

First Proof

Brookhaven Lab's RHIC concludes 25-year run with final collisions

Vocal Guide – belt sing without killing yourself

I write games in C (yes, C) (2016)

Start all of your commands with a comma (2009)

Show HN: I saw this cool navigation reveal, so I made a simple HTML+CSS version

Italy Railways Sabotaged

Reinforcement Learning from Human Feedback

Selection rather than prediction

The AI boom is causing shortages everywhere else

72M Points of Interest

A Fresh Look at IBM 3270 Information Display System

Coding agents have replaced every framework I used

Unseen Footage of Atari Battlezone Arcade Cabinet Production

France's homegrown open source online office suite

Microsoft account bugs locked me out of Notepad – Are thin clients ruining PCs?