So what figure exactly is tested for 10k+? Is it 12k, 100k or more like 1m? I couldn't find.
zazuke•49m ago
it should be doing fine on any size, but I noticed OmniSearch hits limits around 10k notes for me, you could also use it way before and way over. But I guess if you have fewer than 4k, you might not need sophisticated search, except if you enjoy the added features such as preview and searching by title, headers, and semantics.
zazuke•39m ago
The "exact" tests were made with 12k notes in my test vault and 10k in my personal vault. I haven't tested for 100k, but it would be interesting, do you have a vault or example of such a vault?
exceptione•19m ago
I know people hit the 10K really fast. 10K is the limit for which obsidian switches algorithms (personally, I don't understand how 10K db rows would be a problem, but ok).
It is very easy to run into 100k:
- external sources like the documentation for your programming languages, frameworks etc that come as markdown
- if you store every entity as a note, like you do with obsidian bases. Think task tracking, habit trackers, book collections
exceptione•55m ago
zazuke•49m ago
zazuke•39m ago
exceptione•19m ago
- external sources like the documentation for your programming languages, frameworks etc that come as markdown
- if you store every entity as a note, like you do with obsidian bases. Think task tracking, habit trackers, book collections
- clippings, daily notes, project notes, zettels etc
So if I would design a search improvement, I would test the 100k, 200k, 500k, 1m mark with synthetic data.