Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

PipePipe: NewPipe hard fork implementing SponsorBlock

Drawgent: Coding agent on a live Excalidraw canvas

Fifteen years later, the Apple Cards origin story

The Lost Atomic Update on Loongson CPU

A searchable library of forgotten public-domain film clips from 1915 onward

Show HN: Reladraw – A diagram language where you decide where to place things

Modern Object Pascal Introduction for Programmers

Revealing the details of how OpenAI agents hacked Hugging Face

Reflections on 1,000 Days of Math

We're gonna need a lot more mathematicians

Breaking Up with Google Play: Why Conversations Is Now Free

Analyzing Frontier Model Progress with My Favourite Game: Prince of Persia

Plunging test scores are a slow-moving catastrophe

Plan mode is dead

The Murky History of Soviet-Born Tetris

Banks and Credit Unions to Team Up Against Apple Pay Fees

How to keep enjoying programming in a world of LLMs

Ollaya – Ollama for open-source, Jev-style decision models

The Rise of Audio AR

OpenAI bots meddled with multiple US Government agency sites

Experiencing writing at our recent Chinese calligraphy workshop

Automattic has a new board after failed attempt to put CEO on leave

Show HN: Jev Plays Pokémon Red

Floci: Locally emulating any cloud service

Is your Postgres migration safe or not safe?

Show HN: A Claude Code skill to analyze your chess games

I'm the mom in that viral Giants clip. Let me tell you about my husband

What even is an OS now?

A single function Jev-like wrapper for LLMs, including vision models

16GB iPod Nano 3G Upgrade