Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•6mo ago

Comments

yxhuvud•6mo ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•6mo ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•6mo ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•6mo ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•6mo ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•6mo ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

Show HN: We built an open source, zero webhooks payment processor

Google Antigravity Exfiltrates Data

FLUX.2: Frontier Visual Intelligence

Launch HN: Onyx (YC W24) – Open-source chat UI

The 101 of analog signal filtering (2024)

It is ok to say "CSS variables" instead of "custom properties"

Human brains are preconfigured with instructions for understanding the world

Making Crash Bandicoot (2011)

Trillions spent and big software projects are still failing

Ozempic does not slow Alzheimer's, study finds

Python is not a great language for data science

how to repurpose your old phone into a web server

Most Stable Raspberry Pi? Better NTP with Thermal Management

LPLB: An early research stage MoE load balancer based on linear programming

Roblox is a problem but it's a symptom of something worse

Unpowered SSDs slowly lose data

Jakarta is now the biggest city in the world

Broccoli Man, Remastered

Nearby peer discovery without GPS using environmental fingerprints

Brain has five 'eras' with adult mode not starting until early 30s

APT Rust requirement raises questions

PRC elites voice AI-skepticism

Claude Advanced Tool Use

Orion 1.0

Hollywood's vision of ancient Rome is all wrong, according to Mary Beard

Using an Array of Needles to Create Solid Knitted Shapes

Show HN: I built an interactive HN Simulator

Three Years from GPT-3 to Gemini 3

How the Atomic Tests Looked Like from Los Angeles

Pebble Watch software is now open source