Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

Dropbox CEO Drew Houston to step down

Is "colorectal cancer" rising in "young people"?

The Ballad of TIGIT

Launch HN: Minicor (YC P26) – Windows desktop automations at scale

What color is your function? (2015)

Language Models Need Sleep

Spain blocks prediction markets Polymarket, Kalshi over lack of gambling licence

Sage Care (YC S24) Is Hiring Software Engineers

Using AI to write better code more slowly

C64 Basic: Game Map Overhead "Camera View"

A few interesting modern pixel fonts

Outsourcing plus local AI will soon become more economical vs. frontier labs

The real cost of owning a home

Opaque Types in Python

Netherlands blocks US takeover of vital digital supplier

Rosalind: A genomics toolkit in Rust running whole-genome pipelines on a laptop

DynIP – Dynamic DNS with RFC 2136, IPv6, DNSSEC, and BYOD

Uber, Lyft drivers in Massachusetts form first US ride-share union

Taking a walk may lead to more creativity than sitting, study finds (2014)

Performance of Rust Language [pdf]

Are we self-sovereign PKI yet?

Phantasy Star IV – 1993 Developer Interviews

Don't put aria-label on generic elements like divs

Use boring languages with LLMs

The user is visibly frustrated

How Shamir's Secret Sharing Works

Incident with Actions and Pages

How do you build a semiconductor company on something that's free?

Eagle 3.1: Collaboration Between the EAGLE Team, vLLM Team, and TorchSpec Team

Don't Subscribe So Casually