Ask HN: What are the machine requirements for a LLM like Llama-3.1-8B?

2•wasimsk•1h ago

I want to create a local GenAI. Tell me the server machine requirements.

Or if you can suggest both—The model & a cheap machine requirement against that, it will help a lot. By the way, for now—I have Intel i5 6th Gen CPU, Graphics card with 4 GB VRAM, 16 GB RAM & Ethernet. I will improve it if I get a good guidance here on.

Comments

alex7o•53m ago

Think of it like that 8b model needs 8gb of vram. Also search online there is a lot of info on that

yorwba•10m ago

https://www.canirun.ai can help you find a model that'll run on your hardware.

Ultraconserved Element

What if Hyperliquid x TradingView made a baby?

Microsoft ghostwrote EU policy that keeps data centers' energy use secret

AI Deepfake Nudes in Schools

Athena – Claude Code for Product Teams

Optimizing XGBoost Machine Learning Models with AI Agents

Tell HN: I found the perfect way to get maximum Claude Code quality

Data centre delays threaten to choke AI expansion

Ask HN: Judge My Idea: Converting web pages into APIs and index them

Editors resign from math journal, former Elsevier publisher a mini-dictator?

Ruby AI News – April 16th 2026

Scientists Engineer a Tool to "Edit" Brain Circuits and Enhance Memory

Ask HN: Building a solo business is impossible

What breaks when messaging hits scale (and why APIs don't show it)

Soma- train your own AI

Show HN: Ejectify 2 Launched: No More "Disk Not Ejected Properly" notifications

Salesforce Launches Headless 360

Show HN: mcp.hosting – The easiest way to install MCP servers

Show HN: Xata, open-source Postgres platform with copy-on-write branches

How to make buffet breakfasts less wasteful

Mozilla Introduces Thunderbolt: Enterprise AI You Control

Tell me an alternative of Claude for writing/strategy generation

Julia: DistributedArrays

Can AI agents autonomously design components on photonic chips?

Chinese carmaker patents voice-controlled 'in-vehicle toilet'

The rise of malicious repositories on GitHub

Fret is a GPU-first Rust UI framework

FIM – Linux framebuffer image viewer

Show HN: I built a Twitch social network

Show HN: Real-time aviation Pirep dashboard built on Cloudflare Workers and D1