frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Ask HN: What can I do with a single R9700?

2•scott01•2h ago•2 comments

Ask HN: Is Ask HN Shrinking?

6•keiferski•3h ago•9 comments

Ask HN: Who wants to be hired? (August 2026)

159•whoishiring•5d ago•510 comments

Ask HN: Who is hiring? (August 2026)

232•whoishiring•5d ago•303 comments

DeepSeek announced to raise its API price tremendously

29•alexwwang•2d ago•21 comments

Ask HN: What is a good advice for someone looking to fractional hire a team?

4•vanessa1211•1d ago•6 comments

Laguna S 2.1:118B-a9B better than Qwen3.5:122B-a10B? So far, yes

3•spottedmarley•1d ago•1 comments

Ask HN: Did GitHub remove the stargazers list?

27•reconnecting•3d ago•3 comments

Read HN twice a day for the last decade. Here's my list of S-Tier HN links

109•vivzkestrel•3d ago•21 comments

You've reached the end!

Open in hackernews

Ask HN: What can I do with a single R9700?

2•scott01•2h ago
Hi HN,

I’m considering getting an R9700, budget only for one unit currently. Is there anything useful I can do with local LLMs within its 32G VRAM? I’m also thinking to try and learn building a simple inference engine. Any thoughts?

Comments

spottedmarley•1h ago
For learning it's all you need. Pick a good small model, I would recommend Qwen3.5 there are models ranging from 0.8b params (will run on a smart phone) all the way up to 397b params .. I run the 122b param model daily with 128GB vram and get 20+tk/sec. regardless of the model, you can learn all about how to host and harness a model with any size
scott01•1h ago
With this amount of VRAM, do you happen to be using a Strix Halo or a Mac?