Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

More Tailscale tricks for your jailbroken Kindle

User Interfaces of the Demo Scene

SQLite in Production: Optimizing WAL Mode, Concurrency, and VFS Layers

Codex Security

Lisp moving Forth moving Lisp

Show HN: I was tired of opening 2 tabs for every HN link, so I made a userscript

Substack writers, you need a website

Cracking Windows Open: Porting RADV to Win32

Half-Life ported to Mac OS 9

LearnVector – Andrew Ng's AI company building one‑to‑one learning experiences

ReFrame – The EPaper Camera

Kimi K3 Architecture Overview and Notes

Hubble: Open-source notetaking app for you and your agents

Teach yourself programming in ten years (1998)

Transformer Transformer: A Unified Model for Motion-Conditioned Robot Co-Design

Truth is not a direction: a Tarski attack on LLM probes

Steel Bank Common Lisp version 2.6.7

Delayed Gratification – Proud to Be 'Last to Breaking News'

Hooray for the Sockets Interface

Mag Computer: A Mag History of RAM (1960–2025)

60 Years Ago, a Submerged Submarine Circled the Globe for the First Time (2020)

Log is non-monotonic in PHP and Lua

The iPhone Upgrade Program is being replaced by Apple Upgrade

Zig's Incremental Compilation Internals

Una GPS smart watch – Repairable, USB-C charging, developer-friendly

Beyond Greece and Rome

Interview with Boris Cherny [video]

Fixing a bug with byte order marks

Now is the time to give LLMs access to the ACM digital library

Multiple Mouse Cursors in Wayland