Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

Steam Machine launches today

Runing GLM-5.2 on local hardware

In praise of memcached

VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO

Cyberdecks, going analog, and convivial technology

Polymarket has flooded social media with deceptive videos by paid creators

Optocam Zero: a Pi Zero based digital camera made using off the shelf components

My Mathematical Regression

Japanese symbols that speak without words

An Introduction to YOLO26

Windows NT for GameCube/Wii

1,700 free online courses from top universities

British Columbia, Time Zones, and Postgres

Moebius: 0.2B image inpainting model with 10B-level performance

Is it time for a new Embedded Linux build system?

Canada plans 'nuclear renaissance' with up to 10 reactors built by 2040

Show HN: Oak – Git alternative designed for agents

Canyon HUD helmet for road riding

Flock-Powered Police Chiefs Stalking Women Shows Why Warrants Are Needed

Kyber (YC W23) Is Hiring a Head of Engineering

Ultralytics YOLO26: Unified Real-Time End-to-End Vision Models

Package Managers need global hooks

Show HN: Pagecast – Publish Markdown/HTML Reports to Cloudflare Pages

SpaceX sheds $400B in market value as debut rally hits reverse

Job application asked for my SAT scores

Prompt Injection as Role Confusion

Show HN: Got sick of ads, so I made my own logic puzzle site

Help I accidentally a wigglegram

Chevron signs 20-year power agreement with Microsoft for West Texas data center

ytr: YouTube Radio for Emacs