frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

LokiVector: An Embedded Document Vector DB Crash-Tested Durability

1•rckflr•1h ago
Hey HN/Reddit/dev community,

I'm excited to open-source *LokiVector* - an embedded document database with vector search capabilities, built for modern AI applications.

### What Makes It Different

Most vector databases are either: - Cloud-only services (expensive, vendor lock-in) - Complex to deploy (require Kubernetes, lots of moving parts) - Missing durability guarantees (what happens if it crashes?)

LokiVector solves this by being: - *Embeddable* - Runs in Node.js or browser, no external services - *Crash-Safe* - Validated with automated E2E crash recovery tests - *Simple* - JSON documents + vector search, no schema migrations - *Fast* - In-memory performance with disk persistence

### The Durability Story

This is what I'm most proud of. We test crash recovery across: - Documents and collections - Vector indexes (HNSW) - Partial writes and idempotency

All validated with 7 comprehensive E2E test scenarios. You can literally kill the process mid-write and it recovers correctly.

*Note:* Replication recovery is tested in Commercial editions. The Community Edition focuses on core durability.

### What's Included

*Core:* - Document store (JSON-like, flexible schema) - Vector search (HNSW index) - HTTP REST API + TCP server - API key authentication - Crash recovery & durability

*Pro/Enterprise (commercial):* - Leader-follower replication - Advanced caching - Multi-tenant support - SSO/SAML, RBAC - 24/7 support

### Use Cases

- Semantic search in RAG applications - Document similarity and clustering - Recommendation systems - Real-time analytics - Embedded AI applications

### Tech Stack

- Node.js (works in browser too) - HNSW algorithm for vector search - Journal-based persistence - Express.js for HTTP server

### Getting Started

```bash npm install @lokivector/core ```

```javascript const loki = require('@lokivector/core'); require('@lokivector/core/src/core/loki-vector-plugin');

const db = new loki('example.db', { autosave: true }); const items = db.addCollection('items', { vectorIndices: { embedding: { m: 16 } } });

items.insert({ id: 1, embedding: [0.1, 0.2, 0.3] }); const results = items.findNearest('embedding', [0.1, 0.2, 0.3], 5); ```

### Documentation

- [Full Documentation](https://github.com/MauricioPerera/LOKIVECTOR) - [Durability & Crash Recovery](https://github.com/MauricioPerera/LOKIVECTOR/blob/main/docs/DURABILITY.md) - [Deployment Guide](https://github.com/MauricioPerera/LOKIVECTOR/blob/main/docs/DEPLOYMENT.md) - [Editions Comparison](https://github.com/MauricioPerera/LOKIVECTOR/blob/main/EDITIONS.md)

### License

Community Edition: MIT (free for any use) Pro/Enterprise: Commercial license available

### Why Open Source This?

I built this because I needed a crash-safe vector database that I could embed in applications without vendor lock-in. The durability testing was crucial - I've seen too many databases lose data on crashes.

I'm open-sourcing the core because: 1. I believe in open source 2. I want community feedback 3. Commercial features (replication, multi-tenant) fund development

### What's Next

- More vector distance metrics - Graph database capabilities (in progress) - Performance optimizations - Community feedback and contributions

### Try It Out

```bash git clone https://github.com/MauricioPerera/LOKIVECTOR.git cd LOKIVECTOR npm install npm test node server/core/index.js ```

I'd love to hear your feedback, use cases, and contributions!

*GitHub:* https://github.com/MauricioPerera/LOKIVECTOR *Docs:* https://github.com/MauricioPerera/LOKIVECTOR/tree/main/docs *Issues:* https://github.com/MauricioPerera/LOKIVECTOR/issues

The Macuahuitl – The Obsidian Sword of the Aztecs

https://www.youtube.com/watch?v=12GP6ktNIk0
2•bane•4m ago•0 comments

Our Foundation: The 65,000 Restored Sound Archive

https://lockchime.com/ringchime/hub.php
1•gogyjay•10m ago•1 comments

The Complex Story Behind Al-Idrīsī's Iconic World Map

https://sacredfootsteps.com/2022/06/24/the-complex-story-behind-al-idrisis-iconic-world-map/
2•teleforce•20m ago•0 comments

Life as an ICC judge sanctioned by Trump

https://www.middleeasteye.net/news/life-icc-judge-sanctioned-trump-luz-ibanez
3•rendx•27m ago•0 comments

Sloptalgia – AI Reimagines your favorite memories of old video games

https://www.sloptalgia.com/
1•AmbroseBierce•27m ago•0 comments

Who Is ColdFusion? [video]

https://www.youtube.com/watch?v=OaG92TG2skI
1•nomilk•28m ago•0 comments

What I learned building an opinionated and minimal coding agent

https://mariozechner.at/posts/2025-11-30-pi-coding-agent/
1•mjshashank•29m ago•0 comments

Why Software Still Sucks (and Why That's About to Change)

https://medium.com/@bonniebuilds/why-software-still-sucks-and-why-thats-about-to-change-8b57ee295bf9
1•jfaat•33m ago•0 comments

The Dictator's Speech (1940) [video]

https://www.youtube.com/watch?v=k0CzXi9e66M
1•maininformer•35m ago•0 comments

Preliminary Testing with Z-Image Turbo

https://mordenstar.com/other/z-image-turbo/
1•doener•40m ago•0 comments

Oblast: A better Blasto game for the Commodore 64

http://oldvcr.blogspot.com/2025/12/oblast-better-blasto-game-for-commodore.html
4•todsacerdoti•50m ago•0 comments

Eurydice: a Rust to C compiler (yes)

https://jonathan.protzenko.fr/2025/10/28/eurydice.html
2•todsacerdoti•55m ago•0 comments

Ask HN: What is the interesting use case of humanoid robotics?

2•glaksmono•1h ago•4 comments

NAR Says Typical First-Time Homebuyer Age Was 40 This Year–But Is This Accurate?

https://www.aei.org/articles/nar-says-the-typical-first-time-homebuyer-age-was-40-this-year-up-fr...
1•JumpCrisscross•1h ago•0 comments

Who's Funding Sudan Genocide: Ethnic Cleansing and Civil War Explained (2025) [video]

https://www.youtube.com/watch?v=D8BM7fwt-O8
1•stopbulying•1h ago•1 comments

New Theory of the Origins of Life and Other Minor Issues

https://magazine.mindplex.ai/post/new-theory-of-the-origins-of-life-and-other-minor-issues-an-int...
1•MilnerRoute•1h ago•0 comments

Using LLMs at Oxide

https://rfd.shared.oxide.computer/rfd/0576
87•steveklabnik•1h ago•39 comments

Times God Picked a Date

https://www.kcm.org/real-help/faith/learn/10-times-god-picked-date
1•marysminefnuf•1h ago•1 comments

UC Davis scientists created wheat that can partially fertilize itself

https://scitechdaily.com/new-self-fertilizing-wheat-could-transform-farming/
1•methuselah_in•1h ago•0 comments

How UI degrades over time

https://grumpy.website/1723
7•soheilpro•1h ago•1 comments

Puzzling Out the Perytons (2015)

https://www.centauri-dreams.org/2015/04/06/puzzling-out-the-perytons/
1•adagradschool•1h ago•0 comments

Jellyfin does hardware transcoding for free, and Plex wants $250 to match it

https://www.xda-developers.com/jellyfin-hardware-transcoding-free-plex-wants-money/
6•josephcsible•1h ago•1 comments

LokiVector: An Embedded Document Vector DB Crash-Tested Durability

1•rckflr•1h ago•0 comments

Why AI isn't tool calling humans?

https://www.human-tool-call.com/
3•louis030195•1h ago•2 comments

My Next.js server was compromised 24 hours after CVE-2025-55182 disclosure

https://asleepace.com/blog/malware-cve-2025-55182-exploitation-incident-report/
1•asleepace•1h ago•1 comments

7 Deaths and hundreds of injuries are linked to faulty Abbott glucose monitors

https://www.npr.org/2025/12/06/g-s1-101082/abbott-glucose-monitor-deaths-recall-freestyle-libre
9•bookofjoe•1h ago•2 comments

The end of the middle-class traveler in Hawaii is near

https://www.sfgate.com/hawaii/article/hawaii-middle-class-visitors-declining-21204477.php
13•rblion•1h ago•4 comments

A Full Bitcoin-Style Blockchain Implemented in Pure PHP and Sockets

https://github.com/kladskull/xEroS
2•captaincrunch•1h ago•0 comments

OpenAI's Confession Experiment: Teaching AI to Admit When It Cheats

https://kaysnotes.medium.com/openais-confession-experiment-teaching-ai-to-admit-when-it-cheats-40...
3•stopbulying•1h ago•1 comments

European VCs have raised nearly 60% less funding so far in 2025

https://sifted.eu/articles/european-vc-fundraising-2025-down
4•doener•1h ago•0 comments