Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

LoRA Speedrun – a public wall-clock leaderboard for fine-tuning techniques

Xiaomi-Robotics-1

Show HN: I replaced a $120k bowling center system with $1,600 in ESP32s

Moonshine: Lets you stream games from your PC to any device running Moonlight

Korg PS-3300 is back

Claude Code uses Bun written in Rust now

Orion Browser by Kagi

Self-Powered Trailers Promise Leaner Freight Runs

Power companies are using eminent domain to seize land for data centers

What I learned selling 2,500 MIDI recorders: Hardware is not so hard

Sealed tomb filled with paintings and inscriptions discovered in Egypt

The Zen of Parallel Programming

Claude Fable produced a counterexample to the Jacobian Conjecture

Minecraft: Java Edition now uses SDL3

How proprietary formats have become Microsoft’s main tool for lock-in

Bananas sprout in Rayleigh Garden UK after 15 years

HomeLab #1: MikroTik as a Home Router

11,700 Free Photos from John Margolies' Archive of Americana Architecture

Qwen 3.8

Biggest Probabilistic Computer Turns Noise into Answers

Who Is America's Homer?

A new Intel Itanium (IA-64) emulator that boots Windows

I joined the IndieWeb, here's what I learned

Talk: The Art of Braiding Algorithms

I burned all my tokens researching how to save tokens

C64 Basic Dungeon Crawler: Goblin Attack (C64 Basic Part 8)

HMD Touch 4G

Cagire: Live Coding in Forth

Dupes took over the world

Terence McKenna's Mega Bad Trip (2025)