Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

Erlang/OTP 29.0

Project Gutenberg – keeps getting better

I believe there are entire companies right now under AI psychosis

The Zulip Foundation

The main thing about P2P meth is that there's so much of it (2022)

Naturally Occurring Quasicrystals

'No Way to Prevent This,' Says Only Package Manager Where This Regularly Happens

How to Write to SSDs [pdf]

Show HN: Epiq – Distributed Git based issue tracker TUI

ESP-EEG is an affordable 8-channel biosensing board

A 0-click exploit chain for the Pixel 10

California bill would require patches or refunds when online games shut down

The sigmoids won't save you

Spectre Programming Language

I designed a nibble-oriented CPU in Verilog to build a scientific calculator

U.S. DOJ demands Apple and Google unmask over 100k users of car-tinkering app

Microscale Thermite Reaction

Image-blaster: Creates 3D environments, SFX, and meshes from a single image

The Bird Eye Was Pushed to an Evolutionary Extreme

O(x)Caml in Space

Show HN: Watch a neural net learn to play Snake

ASCII by Jason Scott

Hightouch (YC S19) Is Hiring

ABC News has taken all FiveThirtyEight articles offline

Waymo updates 3,800 robotaxis after they 'drive into standing water'

The nuclear-physics infrastructure behind PET scans

A SQL-Inspired Query Language Designed for Event Sourcing (2025)

London Police Deploy Facial Recognition at Protest for First Time

Steve Jobs in Exile – New book on Steve Jobs’s years at NeXT Computer

Radicle: Sovereign {code forge} built on Git