Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

Old and new apps, via modern coding agents by Terry Tao

How to Read More Books

A no-brainer for protecting your brain

Don't You Mean Extinct?

Understanding the Odin Programming Language

Website is served from a 200KB binary

Why study Diophantine equations?

The power of collaboration: How we can reduce traffic congestion

Show HN: Shirei, cross-platform GUI framework in native Go

AI Boosts Research Careers but Flattens Scientific Discovery

Ghostel.el: Terminal emulator powered by libghostty

Unauthenticated RCE in Motorola's MR2600 Router

Vint Cerf, a “father of the Internet”, is retiring

Gina Gallery of International Naive Art

Autoresearch, Claude and Constrained Optimization

Satteri: A Markdown pipeline forged in Rust for the JavaScript world

Lessons from the Vasa Shipwreck

Ditching Zotero for a Text File

Show HN: Mindwalk – Replay coding-agent sessions on a 3D map of your codebase

Mesh LLM: distributed AI computing on iroh

Protobuf-py: Protobuf for Python, without compromises

Morphometrics: Introduction to the Analysis of Shape

TK, or the secret to effortless writing (2024)

Nvidia, CoreWeave, and Nebius: Inside the Circular Financing of the GPU Boom

An agent in 100 lines of Lisp

Show HN: Skillscript – A declarative, sandboxed language for tool orchestration

Xbox 'OG' Adventures

RISCBoy is an open-source portable games console, designed from scratch

Handsum: An LQIP Image File Format

An explanation of our search results