Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

OpenLogi

Where Human Sleep Went Wrong

Cerebras CS-4

Palomar: A registry of Lean verified mathematics

Scientists stunned by children's lung recovery in ultra low emission zone

Supersonic Trebuchet [video]

Being ambitious and being a dad

A 3D fruit fly on macOS desktop powered by the real FlyWire connectome

The Two Factions of C++

λλ: A Programming Language for Silicon Photonics

Solo – a .so loader for static Linux binaries

How does IKEA come up with names for its products?

The Vietnam Binh Chau (Chau Tan) Late Tang Wreck

"Sabotage": Experts, lawmakers blast RFK Jr. for destroying healthcare research

AI usage patterns in software teams

CUDA Shared Memory Swizzling

Meta's blockbuster trial draws parallels to big tobacco

Finger: the 1971 social network that never died

The Mojo language (by Modular, now Qualcomm) is now open-source

Show HN: Automatically detect and patch walking-dead states in Sierra games

Turbovec – Google's TurboQuant for vector search in Rust

A 25-year-old video patent just expired, ending a legal headache for Linux

Looking for Missed Alarm Bugs in a Formal Verification Tool

And then the men with guns tell you to do it anyway

The Amazon tax

Claude writing a macOS driver for my obscure HP printer built only for Windows

We turned off Pub/Sub and nobody noticed

Show HN: Interactive, animated architecture of any HuggingFace models

Apple announces changes for apps in the European Union

Tiny satellite will use the dark side of the Moon as a shield