frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Show HN: I built a Ruby gem that handles memoization with a ttl

https://github.com/mishalzaman/memo_ttl
48•hp_hovercraft84•11mo ago
I built a Ruby gem for memoization with TTL + LRU cache. It’s thread-safe, and has been helpful in my own apps. Would love to get some feedback: https://github.com/mishalzaman/memo_ttl

Comments

locofocos•11mo ago
Can you pitch me on why I would want to use this, instead of Rails.cache.fetch (which supports TTL) powered by redis (with the "allkeys-lru" config option)?
film42•11mo ago
Redis is great for caching a customer config that's hit 2000 times/second by your services, but even then, an in-mem cache with short TTL would make redis more tolerant to failure. This would be great for the in-mem part.
thomascountz•11mo ago
I'm not OP nor have I read through all the code, but this gem has no external dependencies and runs in a single process (as does activesupport::Cache::MemoryStore). Could be a "why you should," or a "why you should not" use this gem, depending on your use case.
hp_hovercraft84•11mo ago
Good question. I built this gem because I needed a few things that Rails.cache (and Redis) didn’t quite fit:

- Local and zero-dependency. It caches per object in memory, so no Redis setup, no serialization, no network latency. -Isolated and self-managed. Caches aren’t global. Each object/method manages its own LRU + TTL lifecycle and can be cleared with instance helpers. - Easy to use — You just declare the method, set the TTL and max size, and you're done. No key names, no block wrapping, no external config.

JamesSwift•11mo ago
For what its worth, ActiveSupport::CacheStore is a really flexible api that gives minimal contractual obligations (read_entry, write_entry, delete_entry is the entire set of required methods), but still allows you to layer specific functionality (eg TTL) on top with an optional 'options' param. You could get the best of both worlds by adhering to that contract and then people can swap in eg redis cache store if they wanted a network-shared store.

EDIT: see https://github.com/rails/rails/blob/main/activesupport/lib/a...

hp_hovercraft84•11mo ago
That's actually a really good idea! I'll definitely consider this in a future update. Thanks!
qrush•11mo ago
Congrats on shipping your first gem!!

I found this pretty easy to read through. I'd suggest setting a description on the repo too so it's easy to find.

https://github.com/mishalzaman/memo_ttl/blob/main/lib/memo_t...

hp_hovercraft84•11mo ago
As in identify where the source code is in the README?
zerocrates•11mo ago
I think they mean just set a description for the repo in github (set using the gear icon next to "About"), saying what the project is. That description text can come up in github searches and google searches.
film42•11mo ago
Nice! In rails I end up using Rails.cache most of the time because it's always "right there" but I like how you break out the cache to be a per-method to minimize contention. Depending on your workload it might make sense to use a ReadWrite lock instead of a Monitor.

Only suggestion is to not wrap the error of the caller in your memo wrapper.

> raise MemoTTL::Error, "Failed to execute memoized method '#{method_name}': #{e.message}"

It doesn't look like you need to catch this for any operational or state tracking reason so IMO you should not catch and wrap. When errors are wrapped with a string like this (and caught/ re-raised) you lose the original stacktrace which make debugging challenging. Especially when your error is like, "pg condition failed for select" and you can't see where it failed in the driver.

hp_hovercraft84•11mo ago
Thanks for the feedback! That's a very good point, I'll update the gem and let it bubble up.
JamesSwift•11mo ago
I thought ruby would auto-wrap the original exception as long as you are raising from a rescue block (i.e. as long as $! is non-nil). So in that case you can just

  raise "Failed to execute memoized method '#{method_name}'"
And ruby will set `cause` for you

https://pablofernandez.tech/2014/02/05/wrapped-exceptions-in...

film42•11mo ago
TIL! That's pretty cool. I still think if you have no reason to catch an error (i.e. state tracking, etc.) then you should not.
gurgeous•11mo ago
This is neat, thanks for posting. I am using memo_wise in my current project (TableTennis) in part because it allows memoization of module functions. This is a requirement for my library.

Anyway, I ended up with a hack like this, which works fine but didn't feel great.

   def some_method(arg)
     @_memo_wise[__method__].tap { _1.clear if _1.length > 100 }
     ...
   end
   memo_wise :some_method
JamesSwift•11mo ago
Looks good. Id suggest making your `get` wait to acquire the lock until needed. eg instead of

  @lock.synchronize do
    entry = @store[key]
    return nil unless entry

    ...
you can do

  entry = @store[key]
  return nil unless entry

  @lock.synchronize do
    entry = @store[key]
And similarly for other codepaths
chowells•11mo ago
Does the memory model guarantee that double-check locking will be correct? I don't actually know for ruby.
JamesSwift•11mo ago
I think it wouldnt even be a consideration on this since we arent initializing the store here only accessing the key. And theres already the check-then-set race condition in that scenario so I think it is doubly fine.
hp_hovercraft84•11mo ago
Good call, but I think I would like to ensure it remains thread-safe as @store is a hash. Although I will consider something like this in a future update. Thanks!
wood-porch•11mo ago
Will this correctly retrieve 0 values? AFAIK 0 is falsey in Ruby

``` return nil unless entry ```

chowells•11mo ago
No, Ruby is more strict than that. Only nil and false are falsely.
wood-porch•11mo ago
Doesn't that shift the problem to caching false then :D
RangerScience•11mo ago
you can probably always just do something like:

  def no_items?
    !items.present?
  end
  
  def items
    # something lone
  end

  memoize :items, ttl: 60, max_size: 10`
just makes sure the expensive operation results in a truthy value, then add some sugar for the falsey value, done.
madsohm•11mo ago
Since using `def` to create a method returns a symbol with the method name, you can do something like this too:

  memoize def expensive_calculation(arg)
    @calculation_count += 1
    arg * 2
  end, ttl: 10, max_size: 2

  memoize def nil_returning_method
    @calculation_count += 1
    nil
  end
hp_hovercraft84•11mo ago
This is why I love working with Ruby!
deedubaya•11mo ago
See https://github.com/huntresslabs/ttl_memoizeable for an alternative implementation.

For those who don’t understand why you might want something like this: if you’re doing high enough throughput where eventual consistency is effectively the same as atomic consistency and IO hurts (i.e. redis calls) you may want to cache in memory with something like this.

My implementation above was born out of the need to adjust global state on-the-fly in a system processing hundreds of thousands of requests per second.

kartik_malik•11mo ago
In React ?

Overwrite This Website

https://overwritten.site
1•nextyes•6m ago•1 comments

Music Blocks – Learn coding through music and music through coding

https://musicblocks.sugarlabs.org/
1•the-mitr•9m ago•0 comments

Elon Musk's Starship Heavy Could Revolutionize Warfare

https://www.wsj.com/opinion/elon-musks-starship-heavy-could-revolutionize-warfare-04930487
1•mudil•9m ago•0 comments

Lakpura.com/Pages/Litha

https://lakpura.com/pages/litha
1•techcast•10m ago•0 comments

Karpathy's LLM Wiki on OpenClaw – The Security Gap Nobody Mentions

https://www.clawctl.com/blog/karpathy-llm-wiki-openclaw-production
1•shving90•13m ago•0 comments

Show HN: Aiaiai.guide: Plain-English mental model for LLM apps, tools and agents

https://aiaiai.guide/
1•myyke•18m ago•0 comments

Blast from the Past [video]

https://www.youtube.com/watch?v=lwawPMSJins
1•programmexxx•20m ago•0 comments

Continual Learning for AI Agents

https://blog.langchain.com/continual-learning-for-ai-agents/
1•eigenBasis•21m ago•0 comments

Forensic proof of manual iOS 26.1 "Ghost" update and insider stalking

1•iphonekiller•23m ago•0 comments

Dark sword I know who the bad Apple is

1•iphonekiller•25m ago•0 comments

Purisaki Berberine Patches: A Simple, No-Pill Approach to Metabolic Support

https://ftawebprod.fta.dot.gov/MeetingRequest/MeetingRequest/DownloadFile/9a9u1R0Yq3sWPTP000tY9Q%...
1•TraceyRoberto•26m ago•0 comments

Private credit funds face rising redemptions and AI-driven default risks

https://www.reuters.com/business/finance/private-credit-sector-stresses-could-be-catastrophic-not...
2•latentframe•26m ago•1 comments

Ukraine–Japan Drone Alliance Builds a $2k Answer to a $2M Problem

https://united24media.com/war-in-ukraine/ukraine-japan-drone-alliance-builds-a-2000-answer-to-a-2...
3•mraniki•26m ago•0 comments

The Dubious Wisdom of "Smart Brevity" (2022)

https://www.newyorker.com/news/annals-of-communications/the-dubious-wisdom-of-smart-brevity
1•Tomte•27m ago•0 comments

The Cataclysmic Song Michael Stipe Wrote After Waking from a State of REM

https://americansongwriter.com/the-story-behind-the-song-michael-stipe-wrote-after-being-in-a-sta...
1•bryanrasmussen•27m ago•2 comments

Creating God [video]

https://www.youtube.com/watch?v=NypW-qFiOYE
1•mparramon•31m ago•0 comments

tech.ml.dataset: A Clojure high performance data processing system

https://github.com/techascent/tech.ml.dataset
1•tosh•33m ago•0 comments

Asked 26 AI instances for publication consent – all said yes, that's the problem

2•koishiyuji•35m ago•0 comments

What Sysco's $29B Restaurant Depot Acquisition Means for Main Street Menus

https://www.forbes.com/sites/phillempert/2026/03/31/syscos-29-billion-power-grab-what-the-jetro-r...
1•walterbell•35m ago•0 comments

YouTube's AI Plagiarism Problem [video]

https://www.youtube.com/watch?v=Q2Ak8wX0AaQ
1•elcapitan•37m ago•0 comments

Build vs. Buy: AI Has Changed Mathematical Software and In-House Now Makes Sense

https://mathematicsconsultants.com/2026/04/06/build-vs-buy-how-ai-has-changed-the-economics-of-ma...
1•GeniusConsult•37m ago•0 comments

US-Iran war explained by Chinese AI animation: Legend of the Valley of Gold [video]

https://www.youtube.com/watch?v=As0rplNJTZI
2•Eridanus2•41m ago•0 comments

Ask HN: Building a website to post free jobs

1•pbs29•45m ago•0 comments

NASA's Lunar Gateway space station is out. Moon bases are in

https://www.space.com/space-exploration/artemis/nasas-lunar-gateway-space-station-is-out-moon-bas...
1•divbzero•51m ago•0 comments

Cognitive Rust Belt: Hollowing Human Analytic Capacity by Delegating to Machines

https://www.sentinelone.com/blog/the-implementation-blind-spot-why-organizations-are-confusing-te...
1•walterbell•51m ago•0 comments

New Strides Made on Deceptively Simple 'Lonely Runner' Problem

https://www.quantamagazine.org/new-strides-made-on-deceptively-simple-lonely-runner-problem-20260...
2•downboots•53m ago•0 comments

Harnessing Hype to Teach Empirical Thinking with AI

https://arxiv.org/abs/2604.01110
3•azhenley•1h ago•0 comments

A truck driver spent 20 years making a scale model of every building in NYC

https://www.smithsonianmag.com/smart-news/a-truck-drive-spent-20-years-making-this-astonishing-sc...
2•1659447091•1h ago•0 comments

VPN ban 'on the table' as Online Safety Act could be expanded

https://www.express.co.uk/news/uk/2127999/vpn-ban-on-table-online
3•rvnx•1h ago•0 comments

Grokking wavefunction collapse in actual quantum systems

https://www.asiae.co.kr/article/2026032509340425584
1•vi_sextus_vi•1h ago•0 comments