frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Ask HN: How can I test FTS5 engine in SQLite3?

1•mysh•1h ago
I'm working on a fairly long article about me trying to find a combination of PRAGMAs for fastest INSERT/SELECT queries that specifically target the FTS5 engine. However, the more testing and benchmarking I do, the more unsure I am of the results and how I should word things.

---

For example, there's "threads = N" PRAGMA in SQLite3, it sets an upper bound on the number of auxiliary threads that a prepared statement is allowed to launch to assist with a query. My instinct is that more is better, but:

```

Value, Insert Time (s), StdDev, Rows/Second, Degradation, Query Avg (ms)

1, 2.68, ±0.08, 3732, 1.43x, 0.8

0, 2.72, ±0.18, 3689, 1.51x, 0.8

2, 2.85, ±0.03, 3515, 1.30x, 0.8

```

So it's not always the case.

('Degradation' checks the timings of the first N inserts and compares them with the latest N inserts to determine how much slower they have become (varies by configs, too). I should probably rename Rows/Second to something else and show N rows/s at start and the end of the run)

---

And for the second example, you can set a "synchronous" PRAGMA to OFF, NORMAL, FULL or EXTRA: https://www.sqlite.org/pragma.html#pragma_synchronous

However, sometimes in specific configurations, EXTRA outperforms NORMAL, which makes no sense to me (even after multiple runs; every benchmark is performed 3 times). Though there is some randomness introduced by CPU vs. I/O bound transitions and etc.

---

I feel that if I publish my findings as they are, it might give people the wrong idea. Additionally, my results vary for HDD-only and SSD-only systems, as well as for 86 and ARM differences in random places. So:

- How can I ensure that, if I publish my findings, people won't be misled by the idea that "THIS – pointing at the most unsafe configuration possible – is absolute best configuration and we should use always use it"?

- How can I find out why, for example, synchronous configurations that are doing more work are sometimes faster than the ones that do less?

- Currently, I test 94 configurations three times each. So even though it is plenty, I still feel I need to have more, but at the same time who will read results of 94 benchmarks?

p.s. Oh I also made this image for the article that will be shown on link previews, thoughts? :) https://i.imgur.com/04Mvx5Q.png

Comments

mysh•1h ago
Apologies for the rapid editing of this post. The markdown table got obliterated by the layout, had to convert to CSV-like

Why Did People Think They Could Cheer Charlie Kirk's Murder Without Consequences

https://www.realclearpolitics.com/video/2025/09/14/scott_adams_why_did_people_think_they_could_ch...
1•ytNumbers•1m ago•0 comments

Postwave: An opinionated flat-file based based blog engine

https://postwave.blog/
1•thunderbong•11m ago•0 comments

Show HN: Preview ePub/MOBI/CBZ (and more) with a spacebar tap [macOS]

https://apps.apple.com/us/app/book-preview/id6744098874?mt=12
1•parotid•11m ago•0 comments

Help me learn compression please provide materials for this

1•whyandgrowth•14m ago•0 comments

Programming Language Foundations in Agda

https://plfa.inf.ed.ac.uk/
1•amir•14m ago•0 comments

DuckDB 1.4.0 LTS

https://duckdb.org/2025/09/16/announcing-duckdb-140.html
1•whyho•15m ago•0 comments

Tried turning my old Android phone into a Linux server, ended up distro-hopping

https://www.xda-developers.com/i-ended-up-distro-hopping-on-my-android-phone/
2•sipofwater•15m ago•1 comments

Ask HN: I underestimated how lonely building solo can be

3•paulwilsonn•16m ago•0 comments

Show HN: Destinies of Pure Intelligence – A Manifesto

1•Aeon_Frame•17m ago•1 comments

Slow Social Media

https://herman.bearblog.dev/slow-social-media/
2•HermanMartinus•17m ago•0 comments

I Use AI

https://timkellogg.me/blog/2025/09/15/ai-tools
2•tkellogg•20m ago•0 comments

Top job boards to find remote jobs

5•rrmdp•20m ago•2 comments

Creating full-text RSS/Atom feeds for any page with FreshRSS

https://tzovar.as/fulltext-freshrss/
1•alastairr•20m ago•0 comments

Instagram is testing new iOS push notifications that include a profile photo

https://twitter.com/mysk_co/status/1967327859518951905
1•tosh•21m ago•0 comments

A creepy, unsettling week with an AI toy

https://www.theguardian.com/technology/2025/sep/16/i-love-you-too-my-familys-creepy-unsettling-we...
1•lonelyasacloud•23m ago•1 comments

Top niche job boards to find remote jobs

1•rrmdp•24m ago•0 comments

Microsoft Goes Back to Basic, Open-Sources Bill Gates' Code

https://gizmodo.com/microsoft-goes-back-to-basic-open-sources-bill-gates-code-2000654010
1•jatwork•24m ago•0 comments

Debugging Equity

https://column.com/blog/debugging-equity/
1•jbredeche•27m ago•0 comments

Dementia Is Stealing the Imagination of Robert Munsch

https://www.nytimes.com/2025/09/14/magazine/robert-munsch-author-children-books-dementia.html
1•kareemm•29m ago•0 comments

Task v3.45 Released

https://github.com/go-task/task/releases/tag/v3.45.3
2•todsacerdoti•30m ago•0 comments

Grok Code Fast 1: Why "good enough and fast" beats "perfect and slow"

https://blog.kilocode.ai/p/grok-code-fast-1-why-good-enough
1•heymax054•32m ago•0 comments

A high-performance streaming Markdown renderer for Vue, born from our AI chatbot

https://vue-markdown-renderer.netlify.app/
1•simon_he•33m ago•1 comments

UN inquiry finds top Israeli officials incited genocide in Gaza

https://www.reuters.com/world/middle-east/un-inquiry-finds-top-israeli-officials-incited-genocide...
3•hggh•34m ago•0 comments

Ask HN: You are given a PETAFLOP of compute, what do you do with it?

1•FattiMei•40m ago•0 comments

SpessComputer – 6502 Assembly Space Computer Simulator

https://spesscomputer.nsarrazin.com/
1•hggh•42m ago•0 comments

TIL that the iPhone Air camera bump is thicker than the main body

1•fdomingues•46m ago•0 comments

I am not notable enough for Wikipedia. Thank goodness

https://neilzone.co.uk/2025/09/i-am-not-notable-enough-for-wikipedia-thank-goodness/
2•sdoering•48m ago•0 comments

Sylvia Plath's fig tree meets machine learning

https://dontlognow.substack.com/p/sylvia-plaths-fig-tree-meets-machine
1•batkin•51m ago•0 comments

Engineered plants with doubled carbon uptake and more seeds and lipids

https://phys.org/news/2025-09-scientists-carbon-uptake-ability-seeds.html
2•thatcherc•53m ago•0 comments

ChatGPT: Why do most of your users ask for help writing – prose, not code?

https://www.theregister.com/2025/09/16/chatgpt_usage_study/
1•rntn•57m ago•0 comments