Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

DeepSeek open-sources inference optimizations with 60–85% faster generation [pdf]

Fintech Engineering Handbook

Previewing GPT‑5.6 Sol: a next-generation model

Linux on Older Hardware: The Complete Revival Guide

Long Wave radio era set to end with switch-off

Beer CSS – Build material design in record time

WordStar: A Writer's Word Processor (1996)

Why does kinetic energy increase quadratically, not linearly, with speed? (2011)

Faster KNN search in Manticore: 2-pass HNSW, batched distances, and AVX-512

OpenTTD 16.0-Beta1

U.S. allows Anthropic to release Mythos AI to ‘trusted’ US organizations

AI in mathematics is forcing big questions

MicroVMs: Run isolated sandboxes with full lifecycle control

Fusion Programming Language

Jest/Vitest interactive course (runs in the browser)

The US Army Issued Ocarinas to Soldiers in World War II

Hellishly Slow Level 13 Deflate Compression

IBM MCGA Gate Array Reverse Engineering

U.S. government will decide who gets to use GPT-5.6

Anatomy of a Failed (Nation-State?) Attack

Show HN: Hacker News on a train station-style flip board

Ultrasound imaging of the brain

Om

The gap between open weights LLMs and closed source LLMs

We can still stop California's 3D printer surveillance scheme

SCC Technical Assistance Program

Foreign funds help make housing unaffordable: research

A C++ implementation of a fast hash map and hash set using hopscotch hashing

Show HN: DBOSify – Drop-in Temporal replacement built on Postgres

Hightouch (YC S19) Is Hiring