Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

Cloud in a Bottle: making self-hosting accessible to everyone

The revolt of the reader

The ColorChecker, photography's most important 24 squares, turns 50

OpenBSD Stories: Strange Medieval Devices

Music Theory for Programmers

GPT-6 Astra on robot arms

Chrome again exempts Google from user site data settings

AMD Based FreeBSD Desktop Reloaded

Learn Programming with OCaml

Discovery of a new OpenAI agent message board

The "$60 Gaming PC" – AMD BC-250 (2025)

Private German rocket makes history, reaches orbit from European soil

AI, Tools and Transformation

Actively exploited sandbox RCE in all Chromium versions

RecurseCenter.return()

Nitter has more working instances than before the takedowns

Visualizing Rust's Vtables: How dyn Trait Works In Memory

Topologist's Map of the World

LLMs as a Cognitive Virus

How Swiss tables work in Go built-in map

Watch the 'Eclipse of the Century' Next Year When Spain, Egypt and More Go Dark

Finite time blowup for an averaged three-dimensional Navier-Stokes equation (2014)

Balrogg: Demonically compacting (up to 15%) lossless Vorbis/Opus recompressor

Delidded Intel I9-14900KS CT Scan

Terpstra Keyboard

Statichost.eu – European static site hosting

OKF Agent Memory – Git-native persistent memory for AI coding agents

Can AI design circuit boards yet?

Show HN: Fly By – retro biplane flying game

ISAR Aerospace 5 Sept Mission Onward and Upward