Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

Introducing System One Models and Jev

Apple Reference Image: A New Approach for Verified Photography

Show HN: An e-ink frame that hears birds and draws them as 1800s illustrations

Negativland, Culture Jamming, and the Art of Making Something New

Show HN: I made a flight simulator, except you're just a passenger

An update on Wayback Machine access

Gemini 3.8 Live and 3.8 Live Extended Thinking

German Rheinmetall open-sources its Battlesuite connected weapon system protcol

Recreating Voodoo Graphics and a Late-1990s Gaming PC on an FPGA

Building a Linux GPU Driver for the M4 Mac Mini in One Month

Datamimic – don't let your coding agent invent its own test world

Saving Jet Fuel

Jean-Pierre Serre turns 100

We got admin access to Baseten's production GitHub

Stay discoverable in search while disallowing AI training

Chopping up books when they're physically too big

An interactive world map of the stories cultures have told

Learning to solve hard problems in RL for LLMs by never giving up

Show HN: Capsule – Single-file web apps that save their data into SQLite

A single firm is behind OpenAI, Anthropic, and Meta hacking scandals

Let's make quality the norm again

WangNet – 1.8 MB, zero-dependency Numberwang adjudication in 11 languages

Doing Everyone Else's Job

Suspected sabotage causes major Netherlands rail disruption

Sierra digital cameras on the Apple II

Most people prefer traditional architecture

Show HN: Hacking a $20 4G wireless hotspot into a texting device

The CSS Zen Garden dream, finally shipped

The Inference Hardware Revolution of 2026

Jiga (YC W21) Is Hiring Product Engineer (Remote/US)