Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•6mo ago

Comments

yxhuvud•6mo ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•6mo ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•6mo ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•6mo ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•6mo ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•6mo ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

France threatens GrapheneOS with arrests / server seizure for refusing backdoors

SHA1-Hulud the Second Comming – Postman, Zapier, PostHog All Compromised via NPM

NSA and IETF, part 3: Dodging the issues at hand

Inside Rust's std and parking_lot mutexes – who wins?

Chrome Jpegxl Issue Reopened

Show HN: Cynthia – Reliably play MIDI music files – MIT / Portable / Windows

Serflings is a remake of The Settlers 1

Corvus Robotics (YC S18): Hiring Head of Mfg/Ops, Next Door to YC Mountain View

Shai-Hulud Returns: Over 300 NPM Packages Infected

We stopped roadmap work for a week and fixed bugs

Slicing Is All You Need: Towards a Universal One-Sided Distributed MatMul

Historically Accurate Airport Dioramas by AV Pro Designs

RuBee

Disney Lost Roger Rabbit

Japan's gamble to turn island of Hokkaido into global chip hub

µcad: New open source programming language that can generate 2D sketches and 3D

Ask HN: Hearing aid wearers, what's hot?

Lambda Calculus – Animated Beta Reduction of Lambda Diagrams

I built a faster Notion in Rust

The Rust Performance Book (2020)

A New Raspberry Pi Imager

Show HN: Virtual SLURM HPC cluster in a Docker Compose

New magnetic component discovered in the Faraday effect

Building the largest known Kubernetes cluster, with 130k nodes

I put a real search engine into a Lambda, so you only pay when you search

Fran Sans – font inspired by San Francisco light rail displays

Ego, empathy, and humility at work

Show HN: Stun LLMs with thousands of invisible Unicode characters

Set theory with types

The Cloudflare outage might be a good thing