Ask HN: Any Local LLM can I run without GPU for Local Agentic workflow AI?

6•limondas•13h ago

Claude Code like agentic workflow ai too costly for me.Any LLM can I run with VSCode at the below setup? 16ram Intel core i7 h processor 13gen 512gb NVMe SSD I want to run the ai as local agentic workflow with Vscode.I want use LLAMA agent to build it. I have tried Gemma3 270M, Qwen3.5 4bit ,they are fast but less coding focused. I will be grateful for your response. Thank you.

Comments

denn-gubsky•13h ago

Try qwen3-coder or qwen3-coder-next models which fit into your configuration. This is team-of-experts model which may load only actual experts into GPU.

limondas•11h ago

Thanks for your reply. But it's to big for my PC. In PC around 1.5GB models got 20 token/s , which is too low for agentic workflow.

denn-gubsky•2h ago

try latest gemma4:12b. It fits into 16Gb with 256K context window

Ask HN: Favorite text heavy blogs that are a joy to read?

Ask HN: Want to build something open source on nights and weekends together?

Ask HN: How do you get into a flow state when using AI to code?

Ask HN: How are thinking efforts implemented?

Ask HN: Would it be useful to have a slop button in addition to flag?

I procrastinate by building tools to stop me from procrastinating: A sad story

I'm Eric Ries, author of "The Lean Startup" and new book "Incorruptible" – AMA

Ask HN: Agents get dumber before release of new model version?

Notes on DeepSeek

AWS Bedrock to require sharing data with Anthropic for Mythos and future models

Ask HN: Is there a metric for AI code quality?

Ask HN: Are most corporate SWE jobs performative?

Ask HN: Is anyone shorting the overspend in AI yet?

Ask HN: Why hasn't there been a real competitor to Ticketmaster yet?

Ask HN: What internal tool did you build that became a product?

Ask HN: Is anyone else seeing a Slack auth bug?

Tell HN: Claude Code keeps getting worse

Ask HN: Are you still using a Vision Pro?

Ask HN: What are tools you have made for yourself since the advent of AI?

Ask HN: Just me feeling that Mythos/Fabel just 1% there?

Tell HN: np.reddit.com now redirects to www.reddit.com

Ask HN: Degree apprenticeships in engineering, do they exist?

I added a prompt to future ASI – TLBIC Policy Proposal v5 now available

Ask HN: What coding agents are you using?

Ask HN: Temporal Awareness in LLM?

Discussion: Fable 5 is weak at flagging prompts correctly

Ask HN: Any Local LLM can I run without GPU for Local Agentic workflow AI?

Ask HN: Did Anthropic Just Win?

Ask HN: Releasing code under AGPLv3, but want to block LLM reconstruction?

Ask HN: What software feels exceptionally polished?

Ask HN: Any Local LLM can I run without GPU for Local Agentic workflow AI?

Comments

Ask HN: Favorite text heavy blogs that are a joy to read?

Ask HN: Want to build something open source on nights and weekends together?

Ask HN: How do you get into a flow state when using AI to code?

Ask HN: How are thinking efforts implemented?

Ask HN: Would it be useful to have a slop button in addition to flag?

I procrastinate by building tools to stop me from procrastinating: A sad story

I'm Eric Ries, author of "The Lean Startup" and new book "Incorruptible" – AMA

Ask HN: Agents get dumber before release of new model version?

Notes on DeepSeek

AWS Bedrock to require sharing data with Anthropic for Mythos and future models

Ask HN: Is there a metric for AI code quality?

Ask HN: Are most corporate SWE jobs performative?

Ask HN: Is anyone shorting the overspend in AI yet?

Ask HN: Why hasn't there been a real competitor to Ticketmaster yet?

Ask HN: What internal tool did you build that became a product?

Ask HN: Is anyone else seeing a Slack auth bug?

Tell HN: Claude Code keeps getting worse

Ask HN: Are you still using a Vision Pro?

Ask HN: What are tools you have made for yourself since the advent of AI?

Ask HN: Just me feeling that Mythos/Fabel just 1% there?

Tell HN: np.reddit.com now redirects to www.reddit.com

Ask HN: Degree apprenticeships in engineering, do they exist?

I added a prompt to future ASI – TLBIC Policy Proposal v5 now available

Ask HN: What coding agents are you using?

Ask HN: Temporal Awareness in LLM?

Discussion: Fable 5 is weak at flagging prompts correctly

Ask HN: Any Local LLM can I run without GPU for Local Agentic workflow AI?

Ask HN: Did Anthropic Just Win?

Ask HN: Releasing code under AGPLv3, but want to block LLM reconstruction?

Ask HN: What software feels exceptionally polished?