Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•10mo ago

Comments

yxhuvud•10mo ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•10mo ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•10mo ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•10mo ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•10mo ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•10mo ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

Corruption erodes social trust more in democracies than in autocracies

MoD sources warn Palantir role at heart of government is threat to UK security

US Job Market Visualizer – Andrej Karpathy

My Journey to a reliable and enjoyable locally hosted voice assistant

Launch HN: Voygr (YC W26) – A better maps API for agents and AI apps

I Love FreeBSD

Canada's bill C-22 mandates mass metadata surveillance

Even Faster Asin() Was Staring Right at Me

Cert Authorities Check for DNSSEC from Today

Comparing Python Type Checkers: Typing Spec Conformance

Lazycut: A simple terminal video trimmer using FFmpeg

Show HN: Hackerbrief – Top posts on Hacker News summarized daily

Home Assistant waters my plants

Human Organ Atlas

The bureaucracy blocking the chance at a cure

Nango (YC W23, API Access for Agents and Apps) Is Hiring

How I write software with LLMs

Polymarket gamblers threaten to kill me over Iran missile story

Event Publisher enables event integration between Keycloak and OpenFGA

Obsession with growth is destroying nature, 150 countries warn

The 49MB web page

MCP Server Is Eating Your Context Window. There's a Simpler Way

Skillfile, the declarative skill manager, now with search for 110K+ skills

'Pokémon Go' players unknowingly trained delivery robots with 30B images

Chrome DevTools MCP (2025)

Autoresearch Hub

Stop Sloppypasta

Six ingenious ways how Canon DSLRs used to illuminate their autofocus points

Why Are Viral Capsids Icosahedral?

Reviewing Large Changes with Jujutsu