Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•11mo ago

Comments

yxhuvud•11mo ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•11mo ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•11mo ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•11mo ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•11mo ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•11mo ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

How NASA built Artemis II’s fault-tolerant computer

Apple's New iPhone Update Is Restricting Internet Freedom in the UK

Native Instant Space Switching on macOS

The Raft Consensus Algorithm Explained Through "Mean Girls"

Generative art over the years

Hip-hop pioneer, Afrika Bambaataa, dies aged 68

Principles of Mechanical Sympathy

CollectWise (YC F24) Is Hiring

Charcuterie – Visual similarity Unicode explorer

RAM Has a Design Flaw from 1966. I Bypassed It [video]

PicoZ80 – Drop-In Z80 Replacement

Reverse engineering Gemini's SynthID detection

Unfolder for Mac – A 3D model unfolding tool for creating papercraft

Research-Driven Agents: When an agent reads before it codes

Old laptops in a colo as low cost servers

Moving from WordPress to Jekyll (and static site generators in general)

Hegel, a universal property-based testing protocol and family of PBT libraries

An AI robot in my home

Many African families spend fortunes burying their dead

LLM plays an 8-bit Commander X16 game using structured "smart senses"

Show HN: I built a Cargo-like build tool for C/C++

A WebGPU implementation of Augmented Vertex Block Descent

Show HN: Druids – Build your own software factory

Kagi Product Tips – Customize Your Search Results with URL Redirects

Microsoft is employing dark patterns to goad users into paying for storage?

LittleSnitch for Linux

Show HN: Rust based eBook library for Python, with MIT license

EFF is leaving X

Launch HN: Relvy (YC F24) – On-call runbooks, automated

Microsoft PhotoDNA scanning problem