Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

The End of an Era

DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

The session you cannot take with you

JEP 401: Value Objects (Preview) merged to OpenJDK master

IMAX vs. IMAX 70mm: The difference between these two cinema formats

Google fixed more Chrome bugs in June than over the past two years, thanks to AI

Tasklet (YC P26) Is Hiring a Customer Success Engineer

DeepSeek-V4-Flash Update

Stacked PRs are now live on GitHub

How A Gang of Thieves Pulled Off a Multimillion-Dollar Data Center Heist

Gemini Robotics 2 brings whole body intelligence to robots

I flagged two research papers for fake authors and both were accepted as orals

Show HN: Gander, an Android file viewer that asks for no permissions at all

The Religion of Speed

The mean means nothing: data visualization to debug a latency problem

Read this before you buy that TV streaming stick

Ruby Central's Destructive Legacy

Where USB Memory Sticks are Born (2013)

The Economic Benefit of Refactoring

Simulating TCP loss and congestion in browser using Go/WASM

GCC steering committee announces AI policy

Bad Apple but It's Traceroute

Memo-1: A 6502 computer built from scratch, using a Minitel as its terminal

The lost civic life of movie rental stores

Premier league bans gambling sponsors

UEFA and its national associations will not participate in FIFA competitions

CodePen 2.0

The AI Aesthetic

Rune 1.1: adds Python, an Emacs editor, a symbol index and is now free

Show HN: Distilling DeepSeek into GPT-OSS doesn't transfer censorship. Try it