frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Pipe Dreams – The life and times of Yahoo Pipes (2023)

https://retool.com/pipes
142•twalichiewicz•1d ago

Comments

ChrisArchitect•1d ago
Previously: https://news.ycombinator.com/item?id=38650878
postatic•1d ago
Absolutely loved Yahoo Pipes. Created my own last year - https://www.mashups.io
jschrf•1d ago
Very nice! Love the clean UI.
Natfan•1d ago
cool! self-hostable?
tangoalpha•1d ago
Pipes was ahead of its time. Built a scraper and aggregator back in 2008-2010, fetching content from over 2000 sources, pumping all of it into a Drupal website. The amount of regex transformations and other things I had in that pipeline - is in hindsight - more complex, larger scale, and more convoluted that any other nifi or airflow pipelines I built later in my career. And all of it was free. What was possible was limited only by one's creativity!
AceJohnny2•1d ago
> And all of it was free.

It's important to take the perspective that the Silicon Valley isn't an incubator of technology, but of business models.

Yahoo Pipes being free is exactly what killed them. Without a sustainable business model, they could not last.

robertheadley•1d ago
I miss Yahoo Pipes every day of my life.
ManuelKiessling•1d ago
Isn‘t n8n a substitute of sorts?
Towaway69•1d ago
What about Node-RED?
dbacar•1d ago
There was some other tool also, I guess called Dapper.

A similar experience is Apache Nifi for the curious.

hermitcrab•1d ago
It is surely only a matter of time until someone says 'yes, but node based editors are crap, you should do everything in code'. This has been discussed ad nauseum in HN, so I have tried to summarise the arguments here:

https://successfulsoftware.net/2024/01/16/visual-vs-text-bas...

nylonstrung•1d ago
I actually like node based editors but LLMs are the nail in the coffin.

Visual programming just doesn't make sense in a world where "low-code" users can safely be assumed to be using llms

hermitcrab•1d ago
I expect I can drag and drop nodes to solve a problem faster than you can vibe-code a solution. Plus a node-based solution is likely to be more maintainable if your aren't a coder.
Closi•1d ago
Let's see! I'm actually working on a node-based programming LLM paradigm for an app I'm building.

The idea is that you can write the 'nodes' in plain english rather than pre-written blocks, and then the arrows indicate the flow but don't need to absolutely encode everything (closer to a flow chart). The process of writing the flow chart helps define and document the business logic, and the flows are totally clear because everything is encoded into a state machine.

hermitcrab•1d ago
I am unconvinced that natural language is the best way to describe a data transformation problem.
Closi•1d ago
My personal sense is business logic which involves processes with lots of steps rather than data transformation.

I’m unconvinced that code is the best way to describe business logic, so here we are! :)

(Code is probably the best way to encode business logic, but most users can’t read it or edit it, which makes it bad)

tommica•1d ago
Good luck with your project. It is a tough problem you're solving, but hopefully your idea has wings.
Closi•1d ago
Thanks! It's in a very narrow domain (Handset UI flows in Warehouse Management Systems) so i'm hoping that helps, but it's very domain specific and certainly not anything mainstream.
rao-v•1d ago
In a world where node based editors and code are also equivalent to LLMs, it's not super clear to me that the future will not be nicely visualized and understandable nodes (generated by the LLM to explain things to me and to get guidence) kept in sync with the codebase.
Towaway69•1d ago
Having spent a log of time with visual programming and having also loved yahoo pipes, for me, it's time to find a new paradigm.

Last year, I came up with Breadboard Programming[1] which is visual programming using Node-RED but with a different perspective, that of a breadboard[2]. The point is take another perspective on programming and to find new parallels to how electronics are created using breadboards.

Breadboarding is prototyping but with the intention of throwing everything away or iterating by simply copying and pasting the entire code base and then throwing it away. The difference to typical software prototyping is that the prototype can easily be copied and iterated on. Normally prototypes mutate into the final product and then remain those mutated monsters that we were going to refactor before they went into production.

[1]: https://blog.openmindmap.org/blog/breadboard-programming

[2]: https://en.wikipedia.org/wiki/Breadboard

Bjartr•1d ago
Seems to me that breadboard coding would be a like a spreadsheet where dependencies between cells are visible at a glance and could be "rewired" in a way that's easier than hand editing the formula text
Towaway69•1d ago
Definitely not :) i would definitely avoid drawing parallels to spreadsheets rather parallels to the electronics.

I explicitly draw parallels to wires because of the relation to flow based programming.

rendaw•23h ago
I'm not sure if I've ever seen a rigorous comparison between visual and text based editing before, and I'm really interested.

I disagree with some of your points:

- Higher level abstractions - I don't think that's a usage of high level abstraction I'm familiar with, or else it's not true. You can have very very high level abstractions in text code, you can have very low level abstractions in visual programming (max msp). This also goes for the point about optimization in text languages.

- Less hidden state - this really depends on the visual programming language. The geometry node editor in Blender has tons of hidden state - what are the inputs to your program, what are the outputs, how is it applied, etc.

- Less configuration - I have no idea, but my guess is you're thinking of something like Rust where library A uses image type X and library B uses image type Y and you need to write code to convert between X and Y yourself. I don't think this is inherent to visual programming - it's just a consequence of having a large, complex ecosystem with independently evolving parts.

- No syntax to remember - There's still syntax, it's just visual syntax. What does this squiggle mean? What does this color mean? What about this box around things? And unlike text, where you can just write what you see, even if you know what something is with visual programming you might not know how to replicate it (which menu button, what conditions are required, what selection do I have to make, etc), google it, etc.

- Looping and recursion - This is a failing point in visual programming languages I'm familiar with, but I don't think there's anything stopping a visual programming language from offering functions, looping, and recursion.

- Optimization - I touched on this above, but higher level abstraction makes _more_ opportunity for compilers to optimize. Specifically, in visual programming languages, there's no inherent concept of a "sequence" of calculations as there are in imperative languages, so compilers can freely parallelize.

Then: errors and run-time feedback - yes, this is true of most visual programming languages and is super great. It's equally true for many non-visual programming languages (e.g. rust).

The point about discoverability is good, and I agree. Just knowing what you can do in a programming language is very hard (the first steps). Generally in visual programming languages all the parameters are shown right there on the screen.

Here are my extra advantages to visual programming languages:

- I think it's good to make a distinction between control flow graphs and data flow graphs. IMO representing state machines in text based languages is pretty bad and understanding complex call flows etc can be very difficult. Most visual programming languages are purely data flow, but I think a control flow graph programming language would be very good at this.

- Another advantage of visual programming languages is you don't need to come up with names in order to reuse values. Having to name things isn't a joke, and seeing lines and arrows is easier to grok then trying to 1. understand what a complex name means (and maybe forcing yourself to ignore it if the name is bad) and 2. remembering that name so you can mentally connect uses.

That said, there's no need to force these to be mutually exclusive. You could mix them (allow text within the graph, or refer to the graph from text, allow making some files graphs or some text, etc), or even freely convert between them (luna lang, which appears to be thoroughly dead atm but here's some remnants: https://github.com/Luna-Tensorflow/luna).

hermitcrab•19h ago
>I don't think that's a usage of high level abstraction I'm familiar with

The 'primitives' you are presented with are generally at a lot higher level of abstraction in a visual language ('join' node vs '+'). Obviously you can build any level of abstraction using these primitives.

>The geometry node editor in Blender has tons of hidden state - what are the inputs to your program, what are the outputs, how is it applied, etc

I'm not overly familar with Blender. But aren't the inputs and outputs shown as connections? if so, they aren't hidden in the same way they are in code.

>There's still syntax, it's just visual syntax.

You don't have to remember the name of the function, you usually just have to drag it from a list of functions and there is no list of arguments to remember either.

>I don't think there's anything stopping a visual programming language from offering functions, looping, and recursion.

Both are possible in principal.

>Most visual programming languages are purely data flow, but I think a control flow graph programming language would be very good at this.

Trying to mix the two in one environment sounds like a recipe for a lot of additional complexity.

>Another advantage of visual programming languages is you don't need to come up with names in order to reuse values

Good point.

>That said, there's no need to force these to be mutually exclusive.

Indeed. Most visual programming environments include scripting nodes, to get the best of both worlds.

davemo•1d ago
I was an avid user of Pipes and blogged a bit about the experience of using it to build an aggregated set of feeds from various employee blogs to feed into our company site back in 2009 [0]. It holds a special place in my memory alongside early internet greats like del.icio.us [1]

- [0] https://blog.davemo.com/posts/2009-04-06-yahoo-pipes-at-vend...

- [1] https://en.wikipedia.org/wiki/Delicious_(website)

nosrepa•1d ago
Man I miss delicious
croisillon•1d ago
related:

December 2023 - 129 comments - https://news.ycombinator.com/item?id=38650878

tombert•1d ago
I'm surprised I hadn't heard of Pipes.

I do a fair amount with n8n now, and this feels like n8n way way way before. I generally hate the term "ahead of its time", but I think this might apply.

sporkxrocket•1d ago
That's a wildly self-indulgent and navel gazing post with more name dropping than you would think for a barely used product.
ronbenton•1d ago
Reminds me of an early form of IFTTT

“Stop Designing Languages. Write Libraries Instead” (2016)

https://lbstanza.org/purpose_of_programming_languages.html
121•teleforce•2h ago•63 comments

A4 Paper Stories

https://susam.net/a4-paper-stories.html
88•blenderob•2h ago•38 comments

The Eric and Wendy Schmidt Observatory System

https://www.schmidtsciences.org/schmidt-observatory-system/
38•pppone•2h ago•28 comments

LaTeX Coffee Stains [pdf]

https://ctan.math.illinois.edu/graphics/pgf/contrib/coffeestains/coffeestains-en.pdf
7•zahrevsky•17m ago•0 comments

Show HN: KeelTest – AI-driven VS Code unit test generator with bug discovery

https://keelcode.dev/keeltest
13•bulba4aur•1h ago•4 comments

Formal methods only solve half my problems

https://brooker.co.za/blog/2022/06/02/formal.html
46•signa11•4d ago•14 comments

The first new compass since 1936

https://www.youtube.com/watch?v=eiDhbZ8-BZI
52•1970-01-01•5d ago•33 comments

Everyone hates OneDrive, Microsofts cloud app that steals and deletes files

https://boingboing.net/2026/01/05/everyone-hates-onedrive-microsofts-cloud-app-that-steals-then-d...
30•mikecarlton•1h ago•14 comments

Vector graphics on GPU

https://gasiulis.name/vector-graphics-on-gpu/
107•gsf_emergency_6•4d ago•19 comments

Stop Doom Scrolling, Start Doom Coding: Build via the terminal from your phone

https://github.com/rberg27/doom-coding
502•rbergamini27•19h ago•352 comments

Opus 4.5 is not the normal AI agent experience that I have had thus far

https://burkeholland.github.io/posts/opus-4-5-change-everything/
679•tbassetto•21h ago•966 comments

Optery (YC W22) Hiring a CISO and Web Scraping Engineers (Node) (US and Latam)

https://www.optery.com/careers/
1•beyondd•3h ago

Electronic nose for indoor mold detection and identification

https://advanced.onlinelibrary.wiley.com/doi/10.1002/adsr.202500124
155•PaulHoule•14h ago•87 comments

The creator of Claude Code's Claude setup

https://twitter.com/bcherny/status/2007179832300581177
490•KothuRoti•4d ago•319 comments

Show HN: SMTP Tunnel – A SOCKS5 proxy disguised as email traffic to bypass DPI

https://github.com/x011/smtp-tunnel-proxy
99•lobito25•14h ago•33 comments

A 30B Qwen model walks into a Raspberry Pi and runs in real time

https://byteshape.com/blogs/Qwen3-30B-A3B-Instruct-2507/
291•dataminer•18h ago•101 comments

Show HN: Comet MCP – Give Claude Code a browser that can click

https://github.com/hanzili/comet-mcp
9•hanzili•3d ago•5 comments

Vietnam bans unskippable ads

https://saigoneer.com/vietnam-news/28652-vienam-bans-unskippable-ads,-requires-skip-button-to-app...
1468•hoherd•22h ago•747 comments

On the slow death of scaling

https://papers.ssrn.com/sol3/papers.cfm?abstract_id=5877662
96•sethbannon•11h ago•18 comments

I wanted a camera that doesn't exist, so I built it

https://medium.com/@cristi.baluta/i-wanted-a-camera-that-doesnt-exist-so-i-built-it-5f9864533eb7
421•cyrc•4d ago•131 comments

Oral microbiome sequencing after taking probiotics

https://blog.booleanbiotech.com/oral-microbiome-biogaia
168•sethbannon•17h ago•71 comments

Investigating and fixing a nasty clone bug

https://kobzol.github.io/rust/2025/12/30/investigating-and-fixing-a-nasty-clone-bug.html
20•r4um•5d ago•0 comments

The ISEE Trajectories

https://www.drmindle.com/isee/
5•drmindle12358•2d ago•4 comments

We recreated Steve Jobs's 1975 Atari horoscope program

https://blog.adafruit.com/2026/01/06/we-recreated-steve-jobss-1975-atari-horoscope-program-and-yo...
86•ptorrone•14h ago•38 comments

What *is* code? (2015)

https://www.bloomberg.com/graphics/2015-paul-ford-what-is-code/
63•bblcla•5d ago•25 comments

CES 2026: Taking the Lids Off AMD's Venice and MI400 SoCs

https://chipsandcheese.com/p/ces-2026-taking-the-lids-off-amds
123•rbanffy•17h ago•70 comments

Calling All Hackers: How money works (2024)

https://phrack.org/issues/71/17
298•krrishd•18h ago•189 comments

Launch HN: Tamarind Bio (YC W24) – AI Inference Provider for Drug Discovery

74•denizkavi•21h ago•17 comments

Sergey Brin's Unretirement

https://www.inc.com/jessica-stillman/google-co-founder-sergey-brins-unretirement-is-a-lesson-for-...
266•iancmceachern•6d ago•334 comments

High-Performance DBMSs with io_uring: When and How to use it

https://arxiv.org/abs/2512.04859
154•matt_d•19h ago•41 comments