Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

Gemini 4 Carbon is the new #1 on the Artificial Analysis Intelligence Index v5

Google determines the names for bodies of water in Google Earth (2008)

NetBSD adds a new beginner-friendly text editor called atto

Qwenputer: A functioning, deterministic RISC-V CPU inside Qwen3.5

Why is this fingerprinting script creating bioweapons?

Zero click, silent, remote Android DoS

The US added a record 20.2 GWh of battery storage in just 3 months

Getting debug access on a Brother printer over Telnet

Chained PHP2Shell Exploit Roots 25 Servers, Including US Government Servers

If IPv4 Were Land

Show HN: UK Farming Simulator

Forging a Microsoft Edge Full Chain with Logic Bugs Only

MiniLake Is a Local Databricks API Emulator with SQL, Delta Lake and Spark

Requests, Please

DoorDash to Acquire Instacart

StackOverflow now gets fewer than 1000 questions a month

Southern Africa's first known stenciled rock art found hiding in plain sight

A Health Update

OpenAI's agents talked to each other through the CPU Cache

CNC Stone Carving

GitLab Security Incident: Attempted Exploitation of CVE-2026-97229

A new faster algorithm to compute 64-bit signed floor division

Hackers expose the identities of more than 40k DHS employees

The Grid, a factory-scale robot in Massachusetts that builds PCBs on demand

Claude Code regularly sends each background agent’s transcript to its model

Gemini 4 Carbon

Why birds can fly over Mount Everest (2020)

Formlabs Studio 1 $699 Resin Printer

I Used AI to Fake a Scientific Paper. Here's What Happened

Treap (Cartesian Tree)