frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

Open in hackernews

Show HN: Using eBPF to see through encryption without a proxy

https://github.com/qpoint-io/qtap
132•tylerflint•2h ago
Hi HN, I'm Tyler Flint, one of the creators of qtap.

For a while now, my team and I at Qpoint.io have been grappling with the challenge of understanding what's actually happening inside the encrypted traffic leaving our production systems. Modern apps rely heavily on third-party APIs (think payment processors, data providers, etc.), but once TLS kicks in, figuring out exactly what data is being sent, identifying PII exposure, or debugging integration issues becomes incredibly difficult without resorting to complex and often brittle solutions.

Traditional approaches like forward proxies require terminating TLS (MITM), managing certificates, and often introduce performance bottlenecks or single points of failure. Network firewalls usually operate at L3/L4 and lack payload visibility. We felt there had to be a better way.

That's why we built qtap. It's a lightweight agent that uses eBPF to tap into network traffic at the kernel level. The key idea is to hook into common TLS libraries (like OpenSSL) before encryption and after decryption. This gives us deep visibility into the actual request/response payloads of HTTPS/TLS traffic without needing to terminate the connection or manage certs. Because it leverages eBPF, the performance impact is minimal compared to traditional methods.

With qtap, we can now see exactly which external services our apps are talking to, inspect the payloads for debugging or security auditing (e.g., spotting accidental PII leaks), monitor API performance/errors for third-party dependencies, and get a much clearer picture of our egress traffic patterns.

We've found this approach really powerful for improving reliability and security posture. We've packaged qtap as a Linux Binary, Docker container, and Helm chart for deployment.

This is still evolving, but we're excited about the potential of using eBPF for this kind of deep, yet non-intrusive, visibility.

We'd love to get the HN community's feedback:

    Do you face similar challenges monitoring encrypted egress traffic?
    What are your thoughts on using eBPF for this compared to other methods?
    Any suggestions or potential use cases we haven't considered?
Happy to answer any questions!

Comments

compscidr•2h ago
Have been following this project for a while, cool stuff!

I work a bunch with vpn-like networking on Android phones and it would be cool to have a bit of info on how I might get something like working on phones. I guess its probably not your typical usecase.

Currently since the project is a VPN client, I already intercept all of the packets, I have a pcap writer and can write to files or a tcp sockets and connect wireshark to it - but it needs a bunch of complication to setup the keys so that I can see through encryption, so anything that would make that process easier would be great.

PcChip•2h ago
I'm curious what your product does

I've seen that type of behavior for apps that inject ads and add affiliate marketing links

compscidr•2h ago
Its an internet sharing app that uses Wi-Fi direct and BLE

The wireshark stuff is only for when I'm debugging

yonatan8070•1h ago
That sounds like a hotspot with extra steps, what does it do differently?
bbkane•2h ago
Does this work for Go binaries? My understanding is that Go programs do all the encryption "in the process" so the data is encrypted before eBPF can intercept it. I'd love to be wrong about that!
lights0123•2h ago
Most programs do encryption without syscalls! eBPF can intercept userspace execution, which they do as mentioned in the post:

> The key idea is to hook into common TLS libraries (like OpenSSL) before encryption and after decryption

bbkane•2h ago
I saw that, but Go doesn't use dynamically linked libraries for encryption, so I don't think it helps in this particular case.
Retr0id•2h ago
If I want to do something similar, do you know where the relevant parts of the eBPF docs are?
jonfriesen•2h ago
Qtap scans binaries of processes as well known locations for OpenSSL on startup, then passes the offsets to eBPF where it hooks into the SSL_read and SSL_write to get the content before or after it's been encrypted.

This is the eBPF side: https://github.com/qpoint-io/qtap/blob/main/bpf/tap/openssl....

The Go side which indicates what we are scanning for is here: https://github.com/qpoint-io/qtap/blob/main/pkg/ebpf/tls/ope...

For more docs on the topic: - https://docs.ebpf.io/ is a must read - https://eunomia.dev/en/tutorials/30-sslsniff/ has a tutorial on cracking OpenSSL open and getting the content as well. The tutorials they have are fantastic in general

tylerflint•2h ago
We have Go support, but it is not open sourced yet. Go is a bit more complicated but we were able to get it after some cave diving in the ELF formats. To give you a little insight on how this works, because Go is statically linked, we need to pull several different offsets of the functions we are going to hook into.

We do this by scanning every version of Go that is released to find offsets in the standard library that won't change. Then when we detect a new Go process, we use an ELF scanner to find some function offsets and hook into those with uprobes. Using both of these, we have all the information we need to see Go pre-encryption content as well as attribute it to connections and processes.

bbkane•2h ago
Ok, that's exciting, and thanks for the insight!
pclmulqdq•2h ago
To hook into OpenSSL, don't you either need dynamic linking or userspace programs to compile your hooks in? Go and many Rust and C++ binaries tend to prefer static linking, so I wonder if this solution is workable there.
tylerflint•2h ago
Great point! Yes it supports both scenarios. Qtap scans the binary ELF (curl, rust, etc) and looks for the TLS symbols. If they were statically compiled the eBPF probes will be attached directly to the binary, if dynamically linked the probes will be attached to the symbols in the library (.so).
pclmulqdq•1h ago
Yeah, so -O2 and -O3 are likely to be problems for you, and the ELF surgery is very invasive.
jonfriesen•1h ago
Fair point on -O2 and -O3 optimized bins. We've approached this by building custom bin utils that are optimized for blazingly fast symbol recognition. Traditional ELF tools that focus on providing comprehensive context for debugging, we are strip away everything that is not the symbol locations we need.

We've also added caching so frequently used bins don't require multiple scans. Shared libraries as well. This has proven effective with optimized binaries, especially bins that are optimized, start, make a super quick network call, then exit, which was the bane of our existence for a little while.

adampk•2h ago
How easy is the set up, does this need to be deeply integrated in each step of the life-cycle?
tylerflint•2h ago
Just run the qtap agent on whatever Linux machine has apps running on it and it will see everything through the kernel vs eBPF.

You can customize config and/or integrate with existing observability pipelines, but initially you just need to turn it on for it to work. No app instrumentation required.

nikolayasdf123•2h ago
sounds like a security breach. how you ensure this does not become link in some next complex CVE?
mberning•2h ago
My first thought was this is cool. My second thought was that this is going to be impossible to securely manage and administer.
jonfriesen•1h ago
This is a great point, and Qtap itself does need to be used with care. The company behind Qtap (Qpoint.io) provides full inventory and alerting for this sort of scenario.

That said, the eBPF verifier has robust security guarantees and runs on every load. So arbitrary mem access for example isn't possible. Qtap runs exclusively on your nodes, so you control what it captures and where that data goes. Our paid offering provides more functionality with a Control Plane solutions that provides dashboards, alerting, and live config updates. However, all sensitive information, like captured http bodies, are uploaded to a S3 compliant bucket that you control. This could be S3, Minio, or anything else that supports the S3 API. We never see this information.

It's intentionally designed for deployment within your infra and abides by the security policies you set within your org.

captainbland•1h ago
What's the recommended way of locking down communications for this application? With a MITM based solution it's fairly clear you can lock its egress down to precisely what it needs at the network policy level at least, whereas it's a bit trickier with this as it necessarily shares an instance with other processes.

Is uploading clear text encrypted in flight data to another system even a good idea in most cases? In some cases that won't even be allowed because you'd end up storing regulated information in a way that auditors won't approve of (e.g. sometimes there is a requirement for field level encryption when data is in storage/at rest)

jonfriesen•1h ago
You've definitely hit on a point that we've talked about at length and have come to terms that different organizations have different requirements, especially when it comes to regulatory and compliance.

Qtap can be locked down with local firewalls or perimeter firewalls like other applications running within a network. The TLS inspection can also be disabled with a `--tls-probes=none` flag on startup.

Even without inspection enabled, Qtap provides rich context when it comes to connections to processes. For example, source/destination information, bandwidth usage, SNI information, container meta, even Kubernetes pod and namespace meta. All of this can paint a thorough picture of what's happening with zero instrumentation.

When it comes down to it, some orgs may not be able to use the TLS inspection or require specific methods of persisting data. If we can't support this today, our goal is to address these as they come up and hopefully help devs and ops folks working in these constrained environments get what they need while maintaining compliance.

worldsavior•2h ago
Isn't there already mechanisms for patching specific SSL libraries to view encrypted requests (e.g. frida)? What is the benefit of using eBPF?
tylerflint•2h ago
The main benefit is complete coverage. In production systems there are many different workloads with many different binaries, each with different build processes. Leveraging eBPF enables seeing everything on a system without having to adjust the build pipeline.
0nethacker1•2h ago
I like the fact this doesn't impact performance like MITM solutions do.
jonfriesen•1h ago
That was one of our biggest motivators when dreaming up Qtap.

How can we remove the impact that proxies have on connections, AND see the content without having to manage a custom certificate authority, AND not have to instrument all of our code.

kristopolous•1h ago
Just found out about a related things: https://github.com/cle-b/httpdbg

Anyone have any experience with it?

markasoftware•1h ago
this looks like it hooks into python libs, not all openssl traffic system-wide.
eptcyka•1h ago
I know that arguing that SSLKEYLOGFILE is all you need will just be a different version of the rsync/dropbox comment, but I do wonder under what circumstances is one able to strace a binary and isn’t able to make it dump session keys? I read the headline and set high hopes on finding a nifty way to mitm apps on Android - alas, I’m not sure this would work there necessarily.
delusional•46m ago
The big usecase for me would be if you could attach the trace after starting the binary. The idea of coming into a production system that's behaving unexpectedly and getting a network sniff without having to fiddle with certificates is very attractive.

There's an alternative implementation where SSLKEYLOGFILE is more "dynamic" and permits being toggled on an off during runtime, but that doesn't currently exist.

delusional•54m ago
What does the usage pattern look like for this. Will I need to be root to run it, and can it run from inside a container without "real" host root?

I'm always looking for a way to make sniffing traffic from inside a container easier, and if I could attach a debug sidecar with something like an eBPF based SSL pre-master key extractor (both on incoming and outgoing requests) it starts to feel a lot like having network JTAG.

jonfriesen•35m ago
Qtap does require root privileges to function as it uses eBPF to hook into kernel and userspace program functions. The good news is it can also be run within a container.

There are some important flags when spinning it up in docker: `--privileged`, `--cap-add CAP_BPF`, `--cap-add CAP_SYS_ADMIN`, and `--pid=host`. These provide access to load eBPF programs, and monitor traffic.

Many deployments use Kubernetes daemonsets where Qtap runs in a container, but monitors all of the traffic on the node. The Qpoint paid offering comes with a Control Plane that produces context specific dashboards so seeing what's happening from a specific container, or pod namespace can provide a lot of insights into your deployments.

dahateb•52m ago
Does it also work on android? Afaik ebpf is also available there.
jonfriesen•35m ago
Not today, maybe one day!
sunbum•6m ago
Look into HTTP Toolit for android (not affiliated with it at all, it's just that cool a tool)
armitron•23m ago
There are many independent implementations of the same idea (given how easy it is to implement) but all suffer from similar shortcomings:

1. uprobes can be expensive and add latency (they force a context switch and copy data), especially when the hooked functions are called a lot

2. EBPF is not widely available outside of Linux, requires elevated privileges (compared to a MITM proxy that requires no privileges and works with every OS)

3. Doesn't work with JVM, Rust, any runtime that doesn't use the hooked functions

jonfriesen•10m ago
These are all great callouts. We've worked hard to address some of them, some are future endeavours.

To address your points:

1. In our testing, uprobes add a statistically insignificant amount of latency and in comparison to a MITM proxies it's nearly identical to native.

2. True, we're focused on Linux right now. I'm looking forward to exploring Microsoft's eBPF implementation and exploring how we can support the Windows ecosystem.

3. You're right that the technique we are using for OpenSSL will not work for other runtimes. That said, there are other techniques that we've implemented in our Pro offering for the JVM, Go, and NodeJS. Rust is in the works!

zxilly•8m ago
There's a similiar tool https://github.com/gojue/ecapture
Severian•5m ago
Kinda related, anyone know of something similar for Windows? This is definitely going in my toolkit, but I need something similar for Windows client traffic inspection (tls 1.2+) to get the full picture. Working with proprietary client/server coms over tls. Can use a special debug build, but requires shutting down and replacing. Need something in-sutu.

Japanese Retailers Push Back as GPU Tourists Flock for RTX 5090/5080 Cards

https://old.reddit.com/r/intel_arc_graphics/comments/1khypm8/japanese_retailers_push_back_as_gpu_tourists/
1•lamariexa•1m ago•0 comments

Engineers create a robot that can jump 10 feet high–without legs

https://techxplore.com/news/2025-04-robot-feet-high-legs.html
1•PaulHoule•1m ago•0 comments

$100K/day cloud bill isn't a Bug – it's by Design

https://old.reddit.com/r/aethernet/comments/1khyt39/100kday_cloud_bill_isnt_a_bug_its_by_design
1•todsacerdoti•2m ago•0 comments

Hard-Earned Lessons from 2 Years of Improving AI Applications

https://blog.ragas.io/hard-earned-lessons-from-2-years-of-improving-ai-applications
1•amrrs•2m ago•0 comments

Open Source SLM Trained for MCP

https://osmosis.ai/blog/applying-rl-mcp
1•KaseyZhang•4m ago•1 comments

Apple Says Google Searches Down on Safari and Google Says Searches Are Up

https://www.seroundtable.com/apple-vs-google-search-changes-39380.html
1•belter•5m ago•0 comments

Photo Library Export Tool for Mac

https://apps.apple.com/en/app/fotomediathek-export/id6741324048
1•HackerMichl•5m ago•0 comments

Structured Outputs by Example

https://structuredoutputsbyexamples.com/
1•jxnl•5m ago•0 comments

I built a meeting scheduler in a month, and it got 500 signups in 24 hours

https://www.warmcal.com
1•ac1990•6m ago•1 comments

Why Google Search Deal Is Critical for Firefox's Future

https://www.omgubuntu.co.uk/2025/05/mozilla-says-google-search-deal-vital-to-firefoxs-survival
1•StanAngeloff•8m ago•0 comments

Don't Look at Stock Markets. Look at the Ports

https://www.theatlantic.com/economy/archive/2025/05/trump-tariff-shipping-ports/682673/
1•paulpauper•10m ago•0 comments

Here’s How To Handle A Recession If The Job Market Were To Plummet

https://www.forbes.com/sites/eliamdur/2025/05/03/heres-how-to-handle-a-recession-if-the-job-market-were-to-plummet/
1•paulpauper•10m ago•0 comments

How to start a school with your friends

https://prigoose.substack.com/p/how-to-start-a-university
1•geverett•11m ago•1 comments

Details Avoid Bias

https://www.overcomingbias.com/p/details-avoid-bias
1•paulpauper•11m ago•0 comments

Fighting Unwanted Notifications with Machine Learning in Chrome

https://blog.chromium.org/2025/05/fighting-unwanted-notifications-with.html
1•feross•12m ago•0 comments

Level-5 CEO says games being made 80-90% by AI "aesthetic sense" a must for devs

https://automaton-media.com/en/news/level-5-ceo-says-games-are-now-being-made-80-90-by-ai-making-aesthetic-sense-a-must-for-developers/
1•msephton•14m ago•1 comments

QUIC restarts, slow problems: udpgrm to the rescue

https://blog.cloudflare.com/quic-restarts-slow-problems-udpgrm-to-the-rescue/
1•emot•22m ago•0 comments

DOGEs K Schutt's computer infected by malware, credentials found in stealer logs

https://micahflee.com/doge-bro-kyle-schutts-computer-infected-by-malware-credentials-found-in-stealer-logs/
4•cycomanic•23m ago•0 comments

Why Everyone's Talking About Crypto Payments in 2025

https://caizcoin.medium.com/paying-with-stablecoins-why-everyones-talking-about-crypto-payments-in-2025-162330290bf7
1•byte-bolter•25m ago•2 comments

Uber's Journey to Ray on Kubernetes

https://www.infoq.com/news/2025/05/uber-journey-ray-kubernetes/
1•mooreds•26m ago•0 comments

JetBrains AI Pro now included in regular subscription

https://www.jetbrains.com/ai-ides/
2•amit9gupta•26m ago•0 comments

The Apache Attic

https://attic.apache.org//
1•smartmic•27m ago•0 comments

Highlights from the Comments on AI GeoGuessr

https://www.astralcodexten.com/p/highlights-from-the-comments-on-ai
2•feross•29m ago•0 comments

The Screamer – a yell-on yell-off light

https://rulethepla.net/the-screamer/
1•eieio•30m ago•0 comments

The Rise and Fall of the Visual Telegraph (2017)

https://parisianfields.com/2017/11/05/the-rise-and-fall-of-the-visual-telegraph/
3•geox•32m ago•0 comments

Visual Stufio Code version 1.100

https://code.visualstudio.com/updates/v1_100
3•pookieinc•33m ago•1 comments

US Internet traffic rose after announcement of first American pope

https://twitter.com/CloudflareRadar/status/1920552388038938840
2•emot•36m ago•0 comments

Science Is Shaped by Wikipedia: Evidence from a Randomized Control Trial [pdf]

https://ide.mit.edu/sites/default/files/publications/SSRN-id3039505.pdf
1•joebig•37m ago•0 comments

The Truth About AI-Assisted Interviews

https://synervoz.com/blog/the-truth-about-ai-assisted-interviews/
1•trolleycrash•38m ago•0 comments

Mercurity Fintech: Scam by repeat bad actors gained 400% on AI/fintech facade

https://www.morpheus-research.com/mercurity/
1•voytec•41m ago•1 comments