Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•10mo ago

Comments

yxhuvud•10mo ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•10mo ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•10mo ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•10mo ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•10mo ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•10mo ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

1M context is now generally available for Opus 4.6 and Sonnet 4.6

A Survival Guide to a PhD (2016)

Emacs and Vim in the Age of AI

Qatar helium shutdown puts chip supply chain on a two-week clock

Show HN: Channel Surfer – Watch YouTube like it’s cable TV

I found 39 Algolia admin keys exposed across open source documentation sites

You gotta think outside the hypercube

Mouser: An open source alternative to Logi-Plus mouse software

Atari 2600 BASIC Programming (2015)

Hammerspoon

Optimizing Content for Agents

Can I run AI locally?

Parallels confirms MacBook Neo can run Windows in a virtual machine

Our Experience with I-Ready

Games with loot boxes to get minimum 16 age rating across Europe

Wired headphone sales are exploding

Digg is gone again

New 'negative light' technology hides data transfers in plain sight

I beg you to follow Crocker's Rules, even if you will be rude to me

Elon Musk pushes out more xAI founders as AI coding effort falters

AEP (API Design Standard and Tooling Ecosystem)

Coding after coders: The end of computer programming as we know it?

Using Thunderbird for RSS

Launch HN: Spine Swarm (YC S23) – AI agents that collaborate on a visual canvas

Show HN: Context Gateway – Compress agent context before it hits the LLM

Stanford researchers report first recording of a blue whale's heart rate (2019)

John Carmack about open source and anti-AI activists

The Wyden Siren Goes Off Again: We’ll Be “Stunned” By What the NSA Is Doing

Your phone is an entire computer

Launch HN: Captain (YC W26) – Automated RAG for Files