Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

Frontier AI has broken the open CTF format

Project Gutenberg – keeps getting better

SQL patterns I use to catch transaction fraud

Ploopy Bean: a trackpoint for every computer

I believe there are entire companies right now under AI psychosis

The bird eye was pushed to an evolutionary extreme

Additive Blending on the Nintendo 64

Gaining control of every projector and camera on campus

The main thing about P2P meth is that there's so much of it (2021)

Naturally Occurring Quasicrystals

England Runestones

A 0-click exploit chain for the Pixel 10

Research on mildew contamination affecting the sound quality of analog tapes

I Bought a “Junk” PSP From Japan

How to Write to SSDs [pdf]

The sigmoids won't save you

Orthrus-Qwen3: up to 7.8×tokens/forward on Qwen3, identical output distribution

California bill would require patches or refunds when online games shut down

EMiX: Emulating Beyond Single-FPGA Limits

Show HN: Epiq – Distributed Git based issue tracker TUI

ESP-EEG is an affordable 8-channel biosensing board

I designed a nibble-oriented CPU in Verilog to build a scientific calculator

Image-blaster: Creates 3D environments, SFX, and meshes from a single image

Erlang/OTP 29.0

The Zulip Foundation

Show HN: Watch a neural net learn to play Snake

ASCII by Jason Scott

Bun Rust rewrite: "codebase fails basic miri checks, allows for UB in safe rust"

U.S. DOJ demands Apple and Google unmask over 100k users of car-tinkering app

Radicle: Sovereign {code forge} built on Git