Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

Astra for Law

Hister: A private search engine for the pages you visit and the files you keep

Fujitsu launches made-in-Japan next-generation CPU FUJITSU-MONAKA

Wax motor

Everybody's Lost Their Minds

CrowdSec Source Code Leak

Rate limits on GitLab.com are changing

Towards Self-Driving Codebases

Infinite-Parameter LLMs: Generating and Adapting Weights from Live Data

Bend

André Weil and the Hodge Conjecture

Why I didn’t sign the Fields medallists’ letter

The American Religion of Self-Storage Facilities

Zettascale (YC S24) Is Hiring ASIC/FPGA Engineers to Build Chips for ASI

How GLM built its own inference infrastructure

Running Ubuntu on the Lenovo IdeaPad Duet

TSMC revealing details about next gen A14 node

Launch HN: Skillsync (YC W26) – AI chat sessions made portable across agents

One year of sponsored Servo development

T. Rex Had a Body Temperature of 97 Degrees

How do we prevent mathemathics from devolving into the Medieval Era of secrecy?

CCC invites all model citizens to 40C3

Canto: A speech model built for the real world

Grand MS-DOS Gaming General MIDI Showdown

Vibe Coding is the new Internet Dating?

Show HN: Share your AI Setup, Learn from others

The Return of Sail Power: Cargo Ships Are Turning Back to the Wind

Vinix – A modern operating system written in V

LLM Classification Is Feature Engineering

Don't Make Job Referrals Public