Show HN: Delve, an open source (AGPL) enterprise-grade data analytics platform

21•ilovetux•7mo ago

Hello, I am excited to announce the release of my project that I've been working on for quite a while. It has gone through many iterations. I believe that I now have a scalable platform that can efficiently ingest, search and report on large quantities of data.

If you are at a very large scale, there will need to be some work to streamline your database access, but it is very possible to build a flexible and robust solution.

Delve is built using Django, Django Rest Framework, webpack, JS and SCSS.

Delve can be extended with apps, which are actually specially built Django apps.

Delve has a unix-pipe-like search language that is powered by simple python scripts.

The Delve Web UI has support for showing data in tables, line charts and bar charts with more visualizations on the way.

I am excited to hear your feedback and suggestions.

I will be trying to monitor the comments and reply quickly.

Comments

FuriouslyAdrift•7mo ago

Up until fairly recently, Delve was a Microsoft product that profiled and analyzed corporate data... you might run into some confusion.

https://supersimple365.com/microsoft-is-killing-delve-here-a...

ilovetux•7mo ago

Thank you for letting me know. I did not know about the Delve MS product.

I just recently renamed from Flashlight to Delve.

I like the name and MS retired it, so I'm going to try to stick with it.

atombender•7mo ago

Delve is the name of a popular debugger: https://github.com/go-delve/delve

ilovetux•7mo ago

Thank you. I appreciate you pointing this out.

It seems like Delve is a popular name for software, which makes sense.

I am officially looking for a new name for this software.

It used to be called Flashlight, as in "A portable tool to shine some light on your data", but I liked the name Delve and a naive google search didn't reveal any projects named delve.

As an aside, Delve is not only popular in software naming, but it also appears in the English language writing quite a lot.

atombender•7mo ago

Wish I could help, but names are hard.

ilovetux•7mo ago

They really are.

arp242•7mo ago

DelveDeep, DeepDelve, DataDelve, DelveData, DelveLight, FlashDelve, DelveFlash

tuyguntn•7mo ago

Name might get punished by SEO engines soon. Because of "Let's delve into details"

ilovetux•7mo ago

Good point. because of this and a few other comments, I am planning on renaming the project soon.

Any ideas you would like to share?

chatmasta•7mo ago

I like the name. If everyone renamed their product based on HN comments, the marketplace would look like the home directory of a mentally unstable data hoarder.

It does sound like there are some collisions but that doesn’t really matter unless your CLI name clashes, in which case you have many options for adjusting it. The domain name can have suffix or prefix or just “analytics.” And realistically people are going to google “delve analytics” if they can’t find it.

ernestbro•7mo ago

Do you have a demo video?

ilovetux•7mo ago

I do have a video I made a while ago, but I dropped the ball on starting a youtube channel to publish it.

Any recommendations on where I can upload and share a video, preferably one that I could embed in my README.md?

popalchemist•7mo ago

Just start the youtube.

mdaniel•7mo ago

Depends on the size, but I have seen a non-trivial number of GitHub projects that reference an .mp4 served by raw.githubuserassets.com in their readme

I would suspect the cheapest way of doing that is to create an issue, drag the mp4 onto it, and then you have a stable reference to use from within the readme

popalchemist•7mo ago

Is the name a reference to LOTR or ChatGPT?

ilovetux•7mo ago

Neither. I'm using its English definition:

To research or make inquiries into something

mdaniel•7mo ago

Maybe it's an expected outcome in your system, but this is going to AttributeError if things don't go your way https://github.com/iLoveTux/delve/blob/v0.7.0-dev/src/home/e...

  AttributeError: 'NoneType' object has no attribute 'group'

vivzkestrel•7mo ago

How does it compare to Plausible, Matomo and Umami

ilovetux•7mo ago

Thank you for the question.

Those platforms seem to be web analytics platforms, purpose built to track and analyze data from visitors to your web site.

Delve, on the other hand, concentrates on ingesting large quantities of structured, semi-structured and unstructured text based data. Think log files, csv, json, xml, item descriptions, etc.

The closest product to Delve would be something like Splunk or ELK.

I would say Delve is easier to get started with than Splunk or ELK, but actually offers more control since you can easily write your own search commands and field extractions. Also, role based access control is implemented to give fine-grained access to data.

Also configuration is all in one place, backend databases are configurable (sqlite, postgres, MySQL and any other database that works with the django ORM) and more.

Please let me know if you'd like any more details.

SectorC: A C Compiler in 512 bytes

Brookhaven Lab's RHIC concludes 25-year run with final collisions

The F Word

I write games in C (yes, C)

Software factories and the agentic moment

Speed up responses with fast mode

Hoot: Scheme on WebAssembly

Stories from 25 Years of Software Development

OpenCiv3: Open-source, cross-platform reimagining of Civilization III

First Proof

The Waymo World Model

Al Lowe on model trains, funny deaths and working with Disney

Reinforcement Learning from Human Feedback

Vocal Guide – belt sing without killing yourself

Start all of your commands with a comma (2009)

We mourn our craft

Coding agents have replaced every framework I used

Show HN: I saw this cool navigation reveal, so I made a simple HTML+CSS version

France's homegrown open source online office suite

72M Points of Interest

The AI boom is causing shortages everywhere else

Selection Rather Than Prediction

A Fresh Look at IBM 3270 Information Display System

Unseen Footage of Atari Battlezone Arcade Cabinet Production

History and Timeline of the Proco Rat Pedal (2021)

Where did all the starships go?

Show HN: Kappal – CLI to Run Docker Compose YML on Kubernetes for Local Dev

Learning from context is harder than we thought

Show HN: Look Ma, No Linux: Shell, App Installer, Vi, Cc on ESP32-S3 / BreezyBox

Hackers (1995) Animated Experience

SectorC: A C Compiler in 512 bytes

Brookhaven Lab's RHIC concludes 25-year run with final collisions

The F Word

I write games in C (yes, C)

Software factories and the agentic moment

Speed up responses with fast mode

Hoot: Scheme on WebAssembly

Stories from 25 Years of Software Development

OpenCiv3: Open-source, cross-platform reimagining of Civilization III

First Proof

The Waymo World Model

Al Lowe on model trains, funny deaths and working with Disney

Reinforcement Learning from Human Feedback

Vocal Guide – belt sing without killing yourself

Start all of your commands with a comma (2009)

We mourn our craft

Coding agents have replaced every framework I used

Show HN: I saw this cool navigation reveal, so I made a simple HTML+CSS version

France's homegrown open source online office suite

72M Points of Interest

The AI boom is causing shortages everywhere else

Selection Rather Than Prediction

A Fresh Look at IBM 3270 Information Display System

Unseen Footage of Atari Battlezone Arcade Cabinet Production

History and Timeline of the Proco Rat Pedal (2021)

Where did all the starships go?

Show HN: Kappal – CLI to Run Docker Compose YML on Kubernetes for Local Dev

Learning from context is harder than we thought

Show HN: Look Ma, No Linux: Shell, App Installer, Vi, Cc on ESP32-S3 / BreezyBox

Hackers (1995) Animated Experience

Show HN: Delve, an open source (AGPL) enterprise-grade data analytics platform

Comments