Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

iCloud+ Hide My Email addresses will remain on icloud.com

Nostr is an inclusive communication commons

Xiaomi: New CPU matches Apple cores single threaded, much faster multithreaded

MS Paint and Photos inivisibly watermark even locally generated output with GUID

How Universities Should Prepare Founders

Headlong: A Microharness for Persistent Agents

How Europe is killing makers and micro-entrepreneurs

SiFive's First Server Platform

Show HN: Screen memory without screenshots, just text to Markdown

Moon (2024)

The entire city of San Francisco as a video game

Bookshelf – Self-hosted eBook library that runs on object storage

What's new in Emacs 31.1

Was modern art a CIA psy-op? (2020)

Where did all the public bathrooms go?

Training AI to Paint with Code

Jabber/XMPP: 25 Years of Digital Independence

Show HN: I wrote a BASIC interpreter that boots on UEFI machines

Vintage Artificial Intelligence: Before It Got Awkward

Peppermint oil reduces blood pressure by 8.48 mmHg in small study

Crafting QR Codes: A deep dive into QR code art (2024)

Octopus intelligence may be related to never-before-seen mutation

Walgit – a Git server that is one binary in front of an object store

LLMs could control their host machines by exploiting inference engines

Volcanoes that made history

SeL4 security proofs now complete on AArch64

I were 17, I'd learn how to build LLMs from scratch

Oceans hit highest temperature on record

Autostep (YC P26) Is Hiring AI/Fullstack Engineers and a Chief of Staff

Thomson Reuters Launches Its Own Frontier Model