Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

Kaiser nurses say AI, workplace surveillance are making their jobs, care worse

AWS: Inaccurate Estimated Billing Data – $1.7 billion

Thanks HN for 15 years of support and helping me find my life's work

The Zilog Z80 has turned 50

The Isomorphic Labs Drug Design Engine unlocks a new frontier beyond AlphaFold

Vāgdhenu: A Sanskrit Chanting TTS System

First atmosphere found on Earth-like planet in habitable zone of distant star

A grumpy screed about AI in software engineering

DrDroid (YC W23) Is Hiring

Learning a few things about running SQLite

Moonstone: Modern, cross-platform Lua runtime and package manager written in Zig

Kimi K3, and what we can still learn from the pelican benchmark

An Update on Igalia's Layer Based SVG Engine in WebKit (Reducing Layer Overhead)

I Started a "Dirt Notebook"

Static search trees: 40x faster than binary search (2024)

Open Book Touch: open-source e-reader

TP-Link Kasa cameras leaked home GPS via unauthenticated UDP for 6 years

Painting the sides of railroad rails white to reduce derailment

Topcoat: The full full-stack framework for Rust

Show HN: A zoomable timeline of 4M Wikipedia events

Stenchill: 3D Printable Solder Paste Stencil Generator

The state of open source AI

Lego building instructions through time

FAA lets Boeing sign off on 737 MAX, 787 airworthiness certificates again

Frank Lloyd Wright’s first home

Three ways people respond to a problem (other than solving it)

MoonBASIC: A modern BASIC for building 2D and 3D games

Texas wins court order to suspend domain name for violating age-verification law

PSA about abuse of cat(1) command. Don't abuse cats

Show HN: Watch bots interact with an SSH honeypot in real time