frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Ask HN: What are you using for code search for internal repos?

1•Winterflow3r•38s ago•0 comments

EU Growth Forecast for 2027

https://economy-finance.ec.europa.eu/economic-forecast-and-surveys/economic-forecasts/autumn-2026...
1•bpierre•1m ago•0 comments

Ratwires – The Graffiti Wall of the Internet

https://ratwire.space/
1•dffgsdfgsd•1m ago•0 comments

Show HN: Soccer-Bench – Watch teams of LLM agents play 5v5 soccer

https://darksinian.github.io/soccer-bench/
1•Darksinian•1m ago•0 comments

Show HN: Skjalf TV, Steam Deck native, controller-first IPTV player

https://github.com/bikemazzell/skjalf-tv
1•ctbellmar•2m ago•0 comments

3D printed bearing at 10000 RPM

https://studio.youtube.com/video/sLW6DIH8r08/edit
1•budpencer•2m ago•0 comments

Tesla Powercore

https://twitter.com/tesla_megapack/status/2122721563493744771
2•pr337h4m•2m ago•0 comments

The Next Hardware Renaissance

https://twitter.com/federicoantoni/status/2122733806578745807
2•federicoantoni•2m ago•0 comments

One environment variable made our llama.cpp server up to 21% faster

https://tensward.com/blog/huge-pages-llama-cpp
1•tensward•2m ago•0 comments

CLI for torrenting open weight AI models

https://pirateface.co/articles/pirate-face-cli
5•headless_ai•3m ago•0 comments

Grand Theft Auto VI heads to launch amid feverish anticipation

https://www.reuters.com/lifestyle/grand-theft-auto-vi-heads-launch-amid-feverish-anticipation-202...
1•skibz•3m ago•0 comments

Full server-side Datasette Python app in the browser with service workers

https://simonwillison.net/2026/Nov/17/datasette-lite/
1•simonw•4m ago•0 comments

Organizing Large Documents

https://developers.google.com/tech-writing/two/large-docs
1•ankitg12•4m ago•0 comments

SyntraScan Cloudflare Edge Auditor for GA4 Consent Mode v2+live B2B Leak Vault

https://leakradar.leakradar.workers.dev/leads
1•Buisnessdesigne•4m ago•0 comments

Code is easy. What about marketing and sales?

1•jorgeacf•5m ago•0 comments

Safety in the Age of Hands-Free Driving

https://www.aptiv.com/en/insights/article/safety-in-the-age-of-hands-free-driving-with-end-to-end-ai
1•ohjeez•5m ago•0 comments

The Department of Justice Is Using AI Detector Pangram Against Defense Attorneys

https://www.404media.co/the-department-of-justice-is-using-ai-detector-pangram-against-defense-at...
1•waximabbax•6m ago•0 comments

Is Argon2 better than Bcrypt?

https://pilcrowonpaper.com/blog/14
2•mooreds•6m ago•0 comments

Show HN: Your Spreadsheet Is Your Database

https://spreadsheettoapp.ai
1•laotoutou•7m ago•0 comments

Capability-Based Security for AI Agents

https://magenticos.com/blog/capability-based-security-for-ai-agents/
1•iandaily•8m ago•0 comments

Java4Shell

https://hadrian.io/vulnerability-alerts/oracle-critical-security-patch-update-java-17-rce-claims
1•rvwaveren•8m ago•0 comments

Show HN: Atlas – Give Your AI Agent Better Web Context

https://atlas-compiler.com/
1•LIGHTINGSTAR•8m ago•0 comments

Show HN: Ask your AI before you renew any SaaS (free MCP server)

https://hissingkitty.com/developers
1•tech-pulse•9m ago•0 comments

Hoy: A macOS VMM on Hypervisor.framework with GPU acceleration for local models

https://hoy.cua.ai/launch
1•frabonacci•9m ago•1 comments

Cybercriminals hijack old Bitly social media links to promote offensive content

https://www.neowin.net/news/cybercriminals-hijack-old-bitly-social-media-links-to-promote-offensi...
1•bundie•10m ago•0 comments

A New Era of Dark Mode

https://www.felixgrassl.xyz/blog/adaptive_dark_mode/
1•speckx•11m ago•0 comments

The hot disk of gas around a spinning black hole

https://twitter.com/EelcoHoog/status/2122710459900108977
1•admsmz•12m ago•1 comments

Getting Off My Engineer Ass and Doing Sales

https://telemetrymachine.com/blog/getting-off-my-engineer-ass-and-doing-sales
2•tmach32•12m ago•0 comments

Practical Tips to Discourage Agents from Cheating

https://grady.dev/projects/agentic-cheating/
2•gbdubs•12m ago•1 comments

How Do We Know If an AI Model Is Safe for Us?

https://medium.com/affirmengineering/how-do-we-know-an-ai-model-is-safe-for-us-we-built-a-pressur...
2•alexanderstatni•15m ago•0 comments
Open in hackernews

Show HN: Fast and Quality Code Chunking with Chonkie

1•snyy•1y ago
Hi HN,

We’re Chonkie (https://github.com/chonkie-inc/chonkie) — we build open source tools that help split documents into meaningful chunks for use with AI models.

When you use LLMs over large documents or codebases, you often need to break them into smaller parts to fit the model’s context window. Our chunkers do this in a smart way: they preserve structure and meaning, so only the most relevant pieces are passed into the model. This reduces hallucinations, avoids confusion, and improves performance and accuracy.

Today we’re launching our Code Chunker — a fast, structure-aware way to break down source code into high-quality, token-aware chunks.

How it works:

(See the code: https://github.com/chonkie-inc/chonkie/blob/main/src/chonkie...)

Code Chunker uses tree-sitter (https://tree-sitter.github.io/tree-sitter/) to parse your code into an abstract syntax tree (AST). It then recursively merges and groups nodes in a way that respects both code structure and token limits.

It supports all languages that tree-sitter supports, and is designed to preserve formatting and semantics. Large functions or class definitions won’t be split in the middle of a block — instead, we dive recursively into the AST to produce clean, coherent chunks that fit your configured token budget.

What it’s useful for:

  - Embedding-based code search

  - RAG (retrieval-augmented generation) over codebases

  - Long-context analysis of code

  - Preparing repos for fine-tuning or pretraining
Try it out:

  - Open source package: https://docs.chonkie.ai/chunkers/code-chunker

  - Hosted playground (free with account): https://cloud.chonkie.ai
Happy Chonking!