frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

A Rust API Inspired by Python, Powered by Serde

https://ohadravid.github.io/posts/2025-05-serde-reflect/
58•lukastyrychtr•1y ago

Comments

ohr•1y ago
(Author here) I needed to do a bit of "reflection" in a Rust crate but didn't want to implement a procedural macro, so I used Serde (which is a (de)serialization crate) instead.

This is also a deep dive into Serde internals - hope you'll like it!

snthpy•1y ago
Yes, great post! Thank you.
dundarious•1y ago
Pardon me, but I prefer the original by 1 million miles.

  let res = raw_api::query("SELECT * FROM Win32_Fan");
  for obj in res {
    if obj.get_attr("ActiveCooling") == Value::Bool(true) {
        if let Value::String(name) = obj.get_attr("Name") {
            if let Value::UI8(speed) = obj.get_attr("DesiredSpeed") {
                println!("Fan `{name}` is running at {speed} RPM");
            }
        }
    }
  }
If actually concerned about the need to know UI8, then create a typedef DesiredSpeedT or similar. This is equivalent to the struct Fan.

Edit: I understand the post is probably more of a playful exercise than anything else, but I really think the original is far far better (smaller, simpler, etc.) and hope that is not lost on people.

ohr•1y ago
That's understandable, but I think it depends on how many different structs like this you have and how many fields you need to work with (for our usecase, we had tens of structs with tens of fields each).

There's also an Alternatives section in the article about other approaches that can achieve similar results, but of course 'do nothing' is also a valid option.

Edit: > If actually concerned about the need to know UI8 ..

Just a small note: even if you don't care about the fact that it's a UI8, you still have to use the correct type. For example, if the field happens to be returned as UI4, this code won't work!

dundarious•1y ago
Right, but isn't the struct definition equivalent in line count and effort compared to some typedefs and perhaps a handful of trivial-to-inspect oneline helper functions?

Regarding the UI8, don't you have to get your version's struct data member type correct to the exact same degree as a typedef in my suggestion?

ohr•1y ago
> don't you have to get your version's struct data member type correct

No, since Serde will happyly fill a `u64` field with any other `u{8,16,32}` value, and even with signed types (as long as the actual value is non-negative) - this is sort of what happens when you deserialize a JSON `[1, 2, 3]` into `[u64]`.

dundarious•1y ago
Yes, but an equivalent to `impl<'de> Deserializer<'de> for ValueDeserializer` handles that. That could be a useful helper.
LtWorf•1y ago
dgacmu•1y ago
This kind of sells the reason not to wrap things behind an object interface, doesn't it?

    for fan in c.query("SELECT * FROM Win32_Fan"):
        if fan.wmi_property("ActiveCooling").value is True:
            print(f"Fan `{fan.wmi_property('Name').value}` is running at {fan.wmi_property('DesiredSpeed').value} RPM")
vs "SELECT Name, DesiredSpeed from Win32_Fan where ActiveCooling"

Obviously, this doesn't matter when you have 5 fans, but in general, you want to push your restrictions as deeply into the query as possible from an optimization standpoint.

ohr•1y ago
In WMI, the fields are lazy loaded when you do a `*` query, but the real crate [does use the same Serde reflection tricks](https://github.com/ohadravid/wmi-rs/blob/main/src/query.rs#L...) to create the correct field list when you query a struct which improves perf a lot!
vlovich123•1y ago
> Obviously, this doesn't matter when you have 5 fans, but in general, you want to push your restrictions as deeply into the query as possible from an optimization standpoint.

Depends where the database lives. If it's an in-process SQLite DB instance, there's no difference & doing this in code is easier to understand than more complicated SQL queries (of course not necessarily in this case but in general). But in all other cases you are correct about efficiency in general (although again other effects can dominate & make it irrelevant).

lnyng•1y ago
Interesting post. We wrote this “below” utility [1] that monitor system metrics similar to atop. We want the ability to collect all metrics into a single object, pass it around and visualize it elsewhere. Naturally we need some way to query into fields or even nested-struct fields. For example, to get the file cache usage of a particular process, we need to go through sample->processes->pid->memory->file cache. To do it ergonomically and also type-safely, we end up using proc macro to generate enums that represent field paths of the structs and then use them to query values of non-struct (leaf) fields. I always wonder if there are simpler ways or existing proc macro derives to safe us the efforts. Maybe I do need to look into serde internals for some inspirations.

[1] https://github.com/facebookincubator/below/blob/main/below/b...

lovasoa•1y ago
In my opinion, the clean way to implement this is with methods instead of attributes for name, desired_speed, etc...
xpe•1y ago
The title is vague in my opinion. What kind of API? What problem does it hope to solve? The article uses querying system data as examples, but after skimming it, I’m not sure why I would care. My comment is also a criticism of the article, since I couldn’t skim in quickly to figure out if I should spend more time on it.
ohr•1y ago
(Author here) Thanks! That's useful feedback.

I also agree - the final article isn't skim-friendly enough, which drives away some readers.

xpe•1y ago
Glad you are open to feedback. My top question is: What kind of people do you want to read this and why?
vlovich123•1y ago
I don't really understand what this offers above diesel.rs which AFAIK is a similar reflection interface except with much more flushed out ORM capabilities (much more complex filtering, joining etc) & support for an assortment of SQL dialects.
VWWHFSfQ•1y ago
> let res: Vec<Fan> = query();

It might feel more natural, and less magical if this used a turbofish instead

    let res = query::<Fan>();

Very neat
throw_a_grenade•1y ago
That's wdat minijinja does internally. As an argument to Template::render() you can give it any struct that implements Deserialize. That's how you can get varying (sic) variables to a single function and even attributes on "objects" processed by tte template.
I wrote typedload in python. Once they show you an API with hundreds of types you appreciate not having to do like that all the time.
dundarious•1y ago
I don't see the issue with just using an equivalent to `impl<'de> Deserializer<'de> for ValueDeserializer` then.
LtWorf•1y ago
There's unions, there's stuff that uses reserved words in the language as field names... You are obviously not familiar with this task.
dundarious•1y ago
The "generic macro over struct definitions" approach is the one that has at least some trouble dealing with these situations, not the "getter function with string argument" approach. I've had to do plenty of json and protocol buffers wrangling (meaningfully different, I know), and versioned packed struct memcpy/reinterpret_cast "parsing" as well.

My point is I don't want to do "this task" at all if "this task" means layering funky auto-generated machinery on top of what is already a perfectly reasonable API.

olalonde•1y ago
Why? It's much more verbose and error prone (e.g. "stringly typed"). Do you never deserialize JSON?
dundarious•1y ago
What's the difference between mistyping in the string here and mistyping in the struct definition? And yes I have.
olalonde•1y ago
You only need to get it right once, and from then on the compiler will catch any mistakes if you use it incorrectly. In contrast, every time you write obj.get_attr("DesiredSpeed"), there's a chance you'll make a typo and the compiler won't warn you about it.

OpenWrt One – Open Hardware Router

https://openwrt.org/toh/openwrt/one
390•peter_d_sherman•5h ago•159 comments

Fable turned remarkable into Tom Riddle's diary from Harry Potter

https://github.com/MaximeRivest/Riddle
47•modinfo•1h ago•16 comments

CoMaps – FOSS Offline Maps

https://www.comaps.app/
273•basilikum•5h ago•59 comments

Ternlight – 7 MB embedding model that runs in browser (WASM)

https://ternlight-demo.vercel.app/
31•soycaporal•1h ago•6 comments

GLM 5.2 and the coming AI margin collapse

https://martinalderson.com/posts/the-upcoming-ai-margin-collapse-part-1-glm-5-2/
94•martinald•3h ago•61 comments

A global workspace in language models

https://www.anthropic.com/research/global-workspace
243•in-silico•6h ago•79 comments

Pruning RAG context down to what the answer actually needs

https://www.kapa.ai/blog/how-we-prune-rag-context
39•emil_sorensen•4h ago•2 comments

A 2048-spin bulk acoustic wave Ising machine for number partitioning and Sudoku

https://arxiv.org/abs/2607.02112
12•Jimmc414•2d ago•0 comments

Full Writeup of the Windows GDID

https://github.com/SmtimesIWndr/gdid-reversal
25•typeofhuman•2h ago•9 comments

Linux on the Atari Jaguar

https://cakehonolulu.github.io/linux-for-jaguar/
94•cakehonolulu•5h ago•16 comments

AI: The ROI Runway Could Be Long Outside the Tech Sector

https://www.apollo.com/wealth/insights-news/insights/daily-spark/ai-the-roi-runway-could-be-long-...
34•u1hcw9nx•2h ago•20 comments

Evaluation order and nontermination in query languages

https://www.rntz.net/post/2026-06-11-datalog-nontermination.html
16•luu•4d ago•0 comments

Resetting Xbox

https://news.xbox.com/en-us/2026/07/06/resetting-xbox/
448•dijksterhuis•9h ago•411 comments

Stealth robotics startup (YC S26) is hiring principal engineers (Palo Alto)

1•david-venegas•7h ago

AMD Ryzen AI Halo – $4k AI Dev Kit

https://www.lttlabs.com/articles/2026/07/06/amd-ryzen-ai-halo
264•LabsLucas•9h ago•194 comments

Vessel

https://claude.ai/public/artifacts/2c647671-3f94-4d22-b3c1-f2b5a0e17b6e
11•schwarzarno•1h ago•3 comments

OfficeCLI: Office suite for AI agents to read and edit Microsoft Office files

https://github.com/iOfficeAI/OfficeCLI
111•maxloh•7h ago•33 comments

The LLVM Compiler Infrastructure

https://cacm.acm.org/federal-funding-of-academic-research/the-llvm-compiler-infrastructure/
31•tosh•2d ago•4 comments

OpenSSH 10.4/10.4p1 Released

https://www.openssh.org/txt/release-10.4
11•throw0101a•1h ago•3 comments

M/PC – A Concatenative OS

https://wiki.xxiivv.com/site/m_pc.html
27•caminanteblanco•3h ago•2 comments

Using precision editing to study human embryo development shows master gene

https://www.cam.ac.uk/research/news/first-use-of-precision-editing-to-study-human-embryo-developm...
37•gmays•3d ago•16 comments

Januscape: Guest-to-Host Escape in KVM/x86 [CVE-2026-53359]

https://github.com/V4bel/Januscape
68•Imustaskforhelp•6h ago•22 comments

Rotman Lens

https://en.wikipedia.org/wiki/Rotman_lens
66•thomasjb•5d ago•17 comments

Aluminum foil (2021)

https://dernocua.github.io/notes/aluminum-foil.html
228•firephox•10h ago•101 comments

Kani: A Model Checker for Rust

https://arxiv.org/abs/2607.01504
121•Jimmc414•8h ago•7 comments

Poly/ML – A Standard ML Implementation

https://github.com/polyml/polyml
7•Lyngbakr•1h ago•1 comments

Taiganet.com, Home of the WS4000 Simulator

https://www.taiganet.com/
12•Aloha•3h ago•2 comments

Road to Elm 1.0

https://elm-lang.org/news/faster-builds
297•wolfadex•12h ago•148 comments

Real-time map of Great Britain's rail network

https://www.map.signalbox.io
379•scrlk•14h ago•140 comments

Egypt Is Building a New Nile

https://www.theb1m.com/video/egypt-is-building-a-new-nile
118•geox•3d ago•67 comments