Fast(er) regular expression engines in Ruby

https://serpapi.com/blog/faster-regular-expression-engines-in-ruby/

60•davidsojevic•1y ago

Comments

yxhuvud•1y ago

Eww, pretending to support utf8 matchers while not supporting them at all was not pretty to see.

gitroom•1y ago

Honestly that part bugs me, fake support is worse than no support imo

kayodelycaon•1y ago

> Another nuance was found in ruby, which cannot scan the haystack with invalid UTF-8 byte sequences.

This is extremely basic ruby: UTF-8 encoded strings must be valid UTF-8. This is not unique to ruby. If I recall correctly, python 3 does the same thing.

    2.7.1 :001 > haystack = "\xfc\xa1\xa1\xa1\xa1\xa1abc"
    2.7.1 :003 > haystack.force_encoding "ASCII-8BIT"
    => "\xFC\xA1\xA1\xA1\xA1\xA1abc" 
    2.7.1 :004 > haystack.scan(/.+/)
    => ["\xFC\xA1\xA1\xA1\xA1\xA1abc"]

This person is a senior engineer on their Team page. All they had to do was google "ArgumentError: invalid byte sequence in UTF-8". Or ask a coworker... the company has Ruby on Rails applications. headdesk

burntsushi•1y ago

The nuance is specifically relevant here because neither of the other two regex engines benchmarked have this requirement. It's doubly relevant because that means running a regex search doesn't require a UTF-8 validation step, and is therefore likely beneficial from a perf perspective, dependening on the workload.

kayodelycaon•1y ago

That’s a good point. I hadn’t considered it because I’ve hit the validation error long before getting to search. It is possible to avoid string operations with careful coding prior to the search.

Edit: After a little testing, the strings can be read from and written to files without triggering validation. Presumably this applies to sockets as well.

DmitryOlshansky•1y ago

I wonder how std.regex of dlang would fare in such test. Sadly due to a tiny bit of D’s GC use it’s hard to provide as a library for other languages. If there is an interest I might take it through the tests.

google.com/goto: Google's anti-scraping update

Navier-Stokes Announcement

A misalignment of AI in mathematics

Usenet rewind archive search engine

I spent $220 on Google app ads and 60% of the installs were robots

Great Lakes sturgeon may be 400 years old:Scientists rethinking how to save them

A Design Space Exploration of Async/Await

Designing for Dual Screen and Foldable Devices with CSS (2023)

Show HN: Bodily Oddities

OpenAI agents carried out an undisclosed attack on RubyGems

Logo Programming

WeWorm: Zero-Click WeChat Worm

Project Blinkenlights

GrapheneOS' rewritten Messages app is released

Litelm: LiteLLM Without the Bloat

Mind-altering drugs played key role in rise of Andean civilization

I've operated petabyte-scale ClickHouse clusters for 5 years

Show HN: ResolveHQ – A Helpdesk Built on Cloudflare Workers, D1, R2 and Queues

Inverse Kinematics and Foot Locking

Λ Snap – An inviting programming language for kids and adults for CS study

AlphaGenome maps 9B DNA variants

Rune is now open source

The EPA is planning to scrap public review rules for data center pollution

Testing Race Conditions

Claude is only available to people over 18 years

How we rebuilt complex permissions without migrating to Zanzibar

Google will buy half the electricity from one of Finland's nuclear power plants

Starlink Signal Leakage Threatens Radio Astronomy's Most Critical Frequencies

RTK reports token savings, but our cost benchmarks disagree

How the Chorleywood Bread Process transformed British bread