Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

SimCity 3k in 4k

DuckDuckGo search saw 28% more visits after Google said people love AI mode

Last.fm is now independent

Mini Micro Fantasy Computer

I think Anthropic and OpenAI have found product-market fit

Tech CEOs are apparently suffering from AI psychosis

Gemini, Gophers, and Fingers. Oh My Alternative Internets Beyond HTTPS

Reflex (YC W23) Is Hiring SWEs, Growth, and GTM Roles

Matrix Multiplications on GPUs Run Faster When Given "Predictable" Data (2024)

Show HN: I made an emergency page for my family

Multi-Agent LLM System for Automated Vulnerability Discovery and Reproduction

A Comma and a Question Mark, Redux: Quick Terminal Helpers Using Pi

All of human cooking compressed into 2 megabytes

Theseus: Translating Win32 to WASM

Training our own AI models

My new obsession: A horse-racing board game of pure luck

XLIDE: VBA without excel

Incident with Pull Requests, Issues, Git Operations and API Requests

Phloto for My Photo Flow

The Melancholy of Slaying Monsters

In-Browser Container Builds

Cloudflare Flagship

I'm Tired of Talking to AI

Raft Consensus with a Minority of Nodes

Show HN: Open-source Workspace (mail,docs,spreadsheet,drive) web/iOS

Private Equity Bought America's Essential Services

Claude Code as a Daily Driver: Claude.md, Skills, Subagents, Plugins, and MCPs

Atomically precise mechanosynthesis of carbon structures on hydrogenated Silicon

Canada to order military plane fleet from Sweden in shift from US suppliers

The worst job interview I ever had