Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

Quad9 (DNS Resolver) to Exit France

eMudhra to exit global SSL/TLS certificate business

Nvidia OpenShell

Show HN: Run full iOS 16.5 firmware on Android Devices

Getting ready to operate GNU Taler in Germany

Award-Winning AI Literature

What's Getting Pwned

Show HN: UI micro interactions prompts for AI

What Is Gridifcation

Jailbreaking the Switch 2

AI and the Enclosure of the Scientific Commons

A farewell to Arc browser

Dungeon Generation in the Gnomish Mines of NetHack

AI analysis of CT scans finds 42.9% of patients have coronary inflammation

Google cleared 300 hectares of Finnish forest

Show HN: agent-usage-guard – a Claude Code mod to protect your usage window

Hedra is a 3D open world game I wrote from scratch while in highschool

Mini brain organoids 'reading' Braille key step towards biohybrid computing

Faster than earcut: triangulating 3.7M map polygons in 489 ms

Show HN: Turn regular JavaScript into a neural net

MPs moving to restrict gambling ads in Canada

Show HN: Build a world on your phone, explore it in XR on Vision Pro and Quest

Show HN: Uberblok – an interactive museum of ZFS internals

The Last Museum: Semantic search across 5.8M artworks from major museums

WorldTUI: I trained a 360M model to pretend to be a terminal

VMMouse for NT 3.x: QEMU/VMware mouse integration driver

Startup taps underwater volcano as energy source in "proof point" test

Security Disclosure

The recently proposed o(n log n) integer multiplication algorithm [pdf]

Pentulive (Puppy Live) [video]