Other features: - Binary delta patching for firmware/OTA updates - Block-level random access - 10x+ compression on logs - Genomic data: 4:1 on 2-bit encoded DNA, 111,000:1 with reference compression - Parallel compression, 1GB/s+ decompression
Other features: - Binary delta patching for firmware/OTA updates - Block-level random access - 10x+ compression on logs - Genomic data: 4:1 on 2-bit encoded DNA, 111,000:1 with reference compression - Parallel compression, 1GB/s+ decompression
theamk•3w ago
danebl•3w ago
Traditional: must decompress entire file (even when streaming) - zstd -dc huge_logs.zst | grep "error" # 709 MB decompressed through memory
Crystal: indexed search, skip to matches - cuz search huge_logs.cuz "error" # Only decompress matching blocks
Thanks for pointing this up. We will update the readme file.