Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

Flock Wants a Closely Surveilled World with No Exit

Desert Ant Labs: local, fast models that run on device

I advertise malicious software on Google Ads

Lotus Notes and the dangers of starting from scratch

Muse – Meta’s personal AI agent

How An AI math breakthrough ignited a controversy

Roame (YC S23) Is Hiring Viral Content Editor

DeepSeek launching v4.1 flash cheaper and more capable than v4 pro

Navier-Stokes – Tristan Buckmaster [pdf]

Coyote v. Acme (1990)

Tension wood: A 'muscle' that can both bend and straighten plants

Building a Wall Lamp from Scratch

How to build a printer

Open-source 3D anatomy explorer: 2,234 selectable BodyParts3D meshes

AlphaGenome Atlas: a high-resolution map of human DNA

Researchers Spot Fake Ancient Pottery Using the Earth's Magnetic Field

A Biography of Lee Holloway, the Architect of Cloudflare's Technology (Part 1)

Maak.el: Lisp machine command runner in Emacs, infinitely extensible and Scheme

How GPT‑5.6 Sol helps run quantum computing experiments

Mercury 2.5

Large language models develop novel social biases through adaptive exploration

On Really Trying (2009)

DaVinci Resolve 21.1

I-have-ADHD: A skill to stop coding agents from burying the answer

“Tweet” and the bird logo apparently enter the public domain

Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses

On the Navier–Stokes Millennium Prize Problem

Tao: Open math problems being non-renewably mined by AI

27.5KB language-agnostic WebGPU syntax highlighter

An Accidental Blackboard