Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•8mo ago

Comments

yxhuvud•8mo ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•8mo ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•8mo ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•8mo ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•8mo ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•8mo ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

The Microstructure of Wealth Transfer in Prediction Markets

What came first: the CNAME or the A record?

CSS Web Components for marketing sites (2024)

Apple testing new App Store design that blurs the line between ads and results

GLM-4.7-Flash

Show HN: Pipenet – A Modern Alternative to Localtunnel

A Brief History of Ralph

Bypassing Gemma and Qwen safety with raw strings

Iterative image reconstruction using random cubic bézier strokes

A decentralized peer-to-peer messaging application that operates over Bluetooth

Folding NASA Experience into an Origamist's Toolkit

Cows Can Use Sophisticated Tools

Radboud University selects Fairphone as standard smartphone for employees

Luxury Yacht is a desktop app for managing Kubernetes clusters

Conditions in the Intel 8087 floating-point chip's microcode

Dead Internet Theory

San Francisco coyote swims to Alcatraz

Bootstrapping Bun

Robust Conditional 3D Shape Generation from Casual Captures

Nepal's Mountainside Teahouses Elevate the Experience for Trekkers

Ask HN: COBOL devs, how are AI coding affecting your work?

I set all 376 Vim options and I'm still a fool

"Anyone else out there vibe circuit-building?"

Raccoons break into liquor stores, scale skyscrapers and pick locks

Flux 2 Klein pure C inference

Two Concepts of Intelligence

The Code-Only Agent

The space and motion of communicating agents (2008) [pdf]

Self Sanitizing Door Handle

MTOTP: Wouldn't it be nice if you were the 2FA device?