Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

VGHF Digital Archive passes 5000 magazines. Here's what's next

Tell HN: Bob Cringely has died

Why don't more developers “use the platform”?

So you think you could be an electrician?

The work by Valve's Timur Kristóf on improving old AMD GPUs on Linux

Treachery in the Rodin Museum 3D scan verdict

Agents don't need memory, they need documentation

gpuvis: GPU Trace Visualizer

Hole Punch: Sling your spaceship around gravitational fields

We're going to need default hard budget caps on pretty much everything

We're working on a new RuneScape MMO

Celebrating the 100th birthday of the kidney donated to him as a teenager

Reasons I didn't become an EMT, ranked

In Ukraine, distributed renewables foil Russia's assaults

LeCun has "zero concerns" about AI wiping out humanity, recent "rogue" incidents

Religious scholars met with Anthropic

We want you to build the next Git platform on Cloudflare

Sea Monkeys Show Scientists How to Rewrite a Rule of Turbulence

Math's pedagogical curse – Grant Sanderson [video]

I quit OpenAI because its culture is broken

How to hack time, with C2PA

Your body of work thinks back at you

Dirty Optimization Secrets (C for Playdate)

Former SR-71 engineer talks NASA's Blackbird revival program

FTL: A new operating system for clouds

Emitting metadata early makes building/checking Rust up to twice as fast

Three AI agents, two countries, and one uneven world wide web

What Meta got right with Muse

Surely you have ultra-wideband radios on your bins too?

City building games have a Soul Problem pt.2