Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

Molly (Signal fork) has not been updated since 3 months and is vulnerable

We Took over ChatGPT Accounts

Casio Watches of the 1980s

Jepsen: ParticleDB 1.1.4

Redox: Ring Buffers Project Summary

UK Green party drops longstanding opposition to nuclear power

Reading and writing are less symmetric than you (probably) think

A/SIDE – Private photo sharing and encrypted messages

Simple circuits can create complex behaviors

Switch Lowering in GCC

Serbia just elected the world's brainiest parliament

Malware uses LLMs to rank victims by how much they're worth

Digital minimalism

Show HN: Ghostman – A fast, keyboard-driven TUI API client and webhook inspector

What is a light-day? The milestone Voyager 1 is closing in on

AI, Lean, and the Future of Formal Verification, with Lean Creator Leo de Moura

Prospero: A new coding harness for a more civilized age

Hunting 'Zombie Accounts' in Active Directory

Show HN: Marelleo, an open-source story box I built for my kids using ESP32

Noctua Fan Swap on a Calnex Rb/GPS Frequency Reference

The $6.3B Binance hack was pulled off in just 20 minutes

Enlightenment 0.28 Released with Many Improvements

My favourite PowerMac is a Nintendo Wii

Show HN: Jointter – A daily word puzzle using dots and lines

Cloudflare Turnstile solver library (no headless browser required)

Northflank Breached

Breaking the open web won't stop the bad bots

Show HN: A USB-C LTE modem that gives my computer a phone line

Cisco gives engineer unlimited AI tokens to rewrite legacy code

The oldest ice disappears and the Stone Age emerges from it