I'm completely disenchanted with the modern data stack, and am trying to create a toolchain that helps treat data as if it were software: Observability, Integrated Testing, Performance and a real UX.

The linked page uses sqlflow (the foundation of this datastack) to consume and window the bluesky post firehose, save it to postgres, then serve it back over HTTP for dashboarding.

What're you using for analytics? Do you serve lines a chart to your customers? What tech are you using? Are you happy with the JVM (flink)?

i'm very interested in learning how you tackle streaming data and analytics today! Thank you