Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

OnePlus halts operations in USA and Europe

Goes-19 weather satellite enters Safe Hold mode

Let's Build PlanetScale from Scratch: Infrastructure

Show HN: AI Law Tracker – one audited API for US, EU and global AI law

How to spend 15 years perfecting a product

Show HN: I've built a words game based on binary search

Ente – Opening Our Books

The lost joy of music piracy

Where are YC founders now? OpenAI and Anthropic, mostly

Sony Deletes a Bunch More Movies from the Accounts of People Who 'Bought' Them

Inkling: Our Open-Weights Model

Teen hackers who live streamed cyber-attack on TfL jailed

The Act and the Outcome of Creation

A Beautiful Theory Falls to Ugly Data

The LLM Critics Are Right. I Use LLMs Anyway

Track your workout from the iPhone Lock Screen

1,300 Beautiful Wildlife Illustrations from the 19th Century Now Restored

Teardown: A Generic 7-Port USB 3.0 Hub That Wasn't

Show HN: We hid a backdoor in an LLM – $51,200 on finding it

Panel meter calculator with floating point

Let's build a simple interpreter for APL – part 1

Grok Build is open source

Governments, companies, nonprofits should invest in free, open source AI [pdf]

If you want to create a button from scratch, you must first create the universe

SQLite should have (Rust-style) editions

Introduction to KizunaShelf: A shelf for everything you love

World-War-Ⅱ-era telephone line still in use in Upper Tanana Valley Alaska (2021)

Bluesky Trademarks ATProto

Reynard: A real Firefox web browser for iOS 13 or later

I also filed the corners off my MacBook