Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•11mo ago

Comments

yxhuvud•11mo ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•11mo ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•11mo ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•11mo ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•11mo ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•11mo ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

Native Instant Space Switching on macOS

Charcuterie – Visual similarity Unicode explorer

Reverse engineering Gemini's SynthID detection

PicoZ80 – Drop-In Z80 Replacement

Robots Eat Cars

Funerals Keep Africa Poor

Hegel, a universal property-based testing protocol and family of PBT libraries

Unfolder for Mac – A 3D model unfolding tool for creating papercraft

Research-Driven Agents: When an agent reads before it codes

Moving from WordPress to Jekyll (and static site generators in general)

Instant 1.0, a backend for AI-coded apps

Top laptops to use with FreeBSD

Microsoft is employing dark patterns to goad users into paying for storage?

Show HN: I built a Cargo-like build tool for C/C++

Reallocating $100/Month Claude Code Spend to Zed and OpenRouter

Old laptops in a colo as low cost servers

EFF is leaving X

Show HN: Druids – Build your own software factory

Progressive encoding and decoding of 'repeated' protobuffer fields

Introduction to Nintendo DS Programming

Maine is about to become the first state to ban major new data centers

How Do You Find an Illegal Image Without Looking at It?

A WebGPU implementation of Augmented Vertex Block Descent

The Future of Everything Is Lies, I Guess: Part 3 – Culture

Wit, unker, Git: The lost medieval pronouns of English intimacy

Show HN: CSS Studio. Design by hand, code by agent

Meta removes ads for social media addiction litigation

Help Keep Thunderbird Alive

LittleSnitch for Linux

Doing Impressions: Monet's Early Caricatures (ca. late 1850s)