Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

Jemalloc 5.4.0

The scourge of x86 emulation

Astra for Law

Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint

Bend – A language that blocks AI mistakes via proof, on CPU and GPU

Qwen 3.8 Omni Flash

When the fractional part of a float fixes your shader

Hister: A private search engine for the pages you visit and the files you keep

Wax motor

Pre-Greek: The lost language hidden within Ancient Greek

A heap overflow and SSO misconfiguration to compromise OpenAI internal repos

Fujitsu launches made-in-Japan next-generation CPU FUJITSU-MONAKA

Shapelearn Qwen 3.8 27B (13.1 GB VRAM)

How to Write with an LLM

Ask A Monk – A digital wilderness for thoughts with no immediate answer

Why Does the Universe Expand?

Flet 1.0 – Build cross-platform apps in Python

Telstra outage: The night a network decided the year was 2006

Speeding up gearhash on ARM64

Diplodocus, Long Thought Exclusively American, Turns Up in Spain

Apple detectives solved mystery of ancient tree and rewrote the history of fruit

Fixing an NZXT Signal 4K30 part 2: the green/pink video bug

Why I didn’t sign the Fields medallists’ letter

CrowdSec Source Code Leak

The most important product decision is what you don't build

Show HN: Snapdrop: Instantly share files between devices. No setup, no signup

Infinite-Parameter LLMs: Generating and Adapting Weights from Live Data

How do we prevent mathemathics from devolving into the Medieval Era of secrecy?

Khipu (Quipu) Field Guide

How Uber Protects Against Retry Storms