Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

Auto-research with codex: How I achieved a 232x Faster Kernel

Brazilian election filter in X For You timeline

GenRec: Towards LLM-Native Recommendation at Netflix

Strait of Hormuz Live Traffic Tracking

The other Sean Byrne doesn't exist

Qwen 3.8 27B

The mathematical beauty of hyperbezier curves

The Color of White Light

Working with AI Feels More Like Leadership Than Coding

Show HN: Eigendrum - Draw any shape and hear what it sounds like as a drum

Using GCC's Nested Functions with Wide Pointers and No Trampolines II

Going Dark, and the era of law enforcement hacking

Geometric Reasoning

In 1962, Egypt's Missile Program Lost Its Key Scientist Without a Trace

Brain turns listening inward during REM sleep, EEG recordings suggest

Google is making private AI practical with homomorphic encryption

Understanding WCAG 2.2 as ePub and PDF

Show HN: ThoughtDAG – An editable context graph for LLM conversations

Firefox is now the last major browser that still supports uBlock Origin

RustDesk now supports true unattended remote access on Wayland

388 years ago, Galileo worked out why human giants can't exist

eigendrum

Coin-sized device can hack a Boeing 737

Magnitude 7.7 Earthquake – 68 km NNW of Ende, Indonesia

AI by Hand

Maximizing the value of your Claude Code sessions

Debian has begun voting on the future of AI/LLM contributions

Simplifying and Refactoring Introductory Calculus (2018)

Show HN: Silent Shark – tactical map-based WWII submarine sim

Unearthing a 31 year old Easter egg in Ecco the Dolphin