Show HN: Erdos – open-source, AI data science IDE

https://www.lotas.ai/erdos

86•jorgeoguerra•3mo ago

Hey HN! We’re Jorge and Will from Lotas (https://www.lotas.ai/), and we’ve built Erdos, a secure AI-powered data science IDE that’s fully open source (https://www.lotas.ai/erdos).

A few months ago, we shared Rao, an AI coding assistant for RStudio (https://news.ycombinator.com/item?id=44638510). We built Rao to bring the Cursor-like experience to RStudio users. Now we want to take the next step and deliver a tool for the entire data science community that handles Python, R, SQL, and Julia workflows.

Erdos is a fork of VS Code designed for data science. It includes:

- An AI that can search, read, and write across all file types for Python, R, SQL, and Julia. Also, for Jupyter notebooks, we’ve optimized a jupytext system to allow the AI to make faster edits.

- Built-in Python, R, and Julia consoles accessible to both the user and AI

- Plot pane that tracks and organizes plots by file and time

- Database pane for connecting to and manipulating SQL or FTP data sources

- Environment pane for viewing variables, packages, and environments

- Help pane for Python, R, and Julia documentation

- Remote development via SSH or containers

- AI assistant available through a single-click sign-in to our zero data retention backend, bring your own key, or a local model

- Open source AGPLv3 license

We built Erdos because data scientists are often second-class citizens in modern IDEs. Tools like VS Code, Cursor, and Claude Code are made for software developers, not for people working across Jupyter notebooks, scripts, and SQL. We wanted an IDE that feels native to data scientists, while offering the same AI productivity boosts.

You can try Erdos at https://www.lotas.ai/erdos, check out our source code on our GitHub (https://github.com/lotas-ai/erdos), and let us know what features would make it more useful for your work. We’d love your feedback below!

Comments

Centigonal•3mo ago

This is a good idea, although IMO source control, compute, and MLOps integration are bigger but less flashy pain points for data scientists than AI in notebooks.

If you're going to market Erdos as open source, then IMO there should be a github link somewhere on your website.

WillNickols•3mo ago

Thanks for the suggestions - we'll definitely add those to the dev list. Also, the GitHub is https://github.com/lotas-ai/erdos (and it's on the download page but a bit small).

mscbuck•3mo ago

Will echo that one thing that would prevent me from trying this is def the source control. Otherwise it does look pretty slick!

SamTinnerholm•3mo ago

I can't tell how this differs to Cursor from your website. How is it different?

WillNickols•3mo ago

A bunch of specific things below, but the main point is that it integrates a bunch of features that data scientists use that don't come with Cursor.

Specifics (mostly reproduced from above):

1. R/Python/Julia consoles accessible by the user and AI

2. Optimized jupytext system for editing notebooks efficiently

3. Plots pane for viewing and tracking plots

4. Databases pane for managing SQL/FTP connections

5. Environment pane for managing Python/R/Julia packages and environments

6. Help pane for documentation

7. An AI that interacts with all of that.

8. Open source AGPLv3

For me, the biggest difference in the AI usage is that the AI doesn't need to write one-off python scripts for everything and run them from the terminal because it can just use the console directly.

shuwan•3mo ago

I think Rao is more appealing to me since Positron already has that kind of integration, while RStudio doesn’t. Plus, Posit probably won’t ever add an AI Chat feature to RStudio anyway.

WillNickols•3mo ago

FWIW there's a bunch of stuff Erdos has that Positron doesn't (including having solved Positron's top 5 open GitHub issues):

1. Remote development via SSH or containers

2. AI that can connect to ChatGPT, local models, or our backend

3. In-line code execution for Qmd/Rmd files

4. Julia as a first class citizen

5. Multi-agent chats: as many AI sessions as you want and they’ll all run in parallel

6. Windows ARM64 builds

7. Open source AGPLv3 license

8. A bunch of other misc items including read-write data explorer for CSVs and TSVs, plots history sorted by file and time, searchable help, a command history tab, etc

Maybe the biggest difference going forward is that Positron was a ~2 year dev project, whereas Erdos reached feature parity (plus or minus some features) in about ~2 months and is now adding substantial brand new functionality every week.

shuwan•3mo ago

Will, thanks for the explanation. This changes my view a lot. Will give it a try.

harvey9•3mo ago

Do you have the option to run on a local model? Lots of firms don't want data or prompts going outside the local network

jorgeoguerra•3mo ago

Yep — if you have a local model with an OpenAI-compatible v1/chat/completions endpoint (most local models have this option), you can route Erdos to use it in the Erdos AI settings.

vednig•3mo ago

I see Google acquiring Iotas in the future, that's how good it gets

mritchie712•3mo ago

We started with a product like this at Definite (https://www.definite.app/), but it became clear there weren't enough people willing to spend real money on a product like it when Cursor / VS Code already have good coverage on data science.

rubenvanwyk•3mo ago

Not sure if self-promoting on every single analytics- or data-related thread is in line with the ethos of HN: "Please don't use HN primarily for promotion."

johannesf•3mo ago

Have you done any fine-tuning or prompt-customization for the R-specific work? I've found the models worse on R when compared to Python, especially for more complex tasks. This looks cool, thanks for sharing!

WillNickols•3mo ago

Nothing R specific. In my experience, Claude is pretty good about using tidyverse for everything. What was is flopping on for you? Our thought on not fine tuning models is that whatever comes out in 6 months is just going to be better than whatever we fine tuned.

johannesf•3mo ago

Admittedly this was probably ~2 years ago, previous gig used a lot more R and the earlier models were (in my memory) worse in R than in Python. But makes sense that this would've come a long way. Love this!

buppermint•3mo ago

Very cool. Any plans to add support for local models? This has what has prevented us from adopting Positron so far. We have sensitive data and sending to third party APIs is not an option (regardless of their stated retention policies).

jorgeoguerra•3mo ago

Yeah, we just added support for local models. As I mentioned in an earlier comment, if you have a local model with an OpenAI-compatible v1/chat/completions endpoint (most local models have this option), you can route Erdos to use it in the Erdos AI settings.

puppycodes•3mo ago

Looks interesting but i'm unclear what makes it "more accurate"?

jorgeoguerra•3mo ago

When models edit the raw JSON behind a Jupyter notebook, they often mess up the cell structure by adding extra cells, misaligning code, or making bad edits. We fix this by giving the model the notebook in Jupytext format instead, which tends to make its edits cleaner and more accurate.

mkl•3mo ago

The choice of name seems pretty bizarre. The famous Erdos [1] was a mathematician, not data scientist, computer scientist, or statistician.

[1] https://en.wikipedia.org/wiki/Paul_Erd%C5%91s

bigmadshoe•3mo ago

He did contribute to/utilize probability theory. He came up during my undergrad probability class because of this: https://en.wikipedia.org/wiki/Probabilistic_method

jorgeoguerra•3mo ago

Erdos is also widely considered as the most prolific and productive mathematician of all time (in terms of publications and collaborations). Hopefully you can be as productive with Erdos :)

mkl•3mo ago

But productive with it in a different field from the person it's named after? That's weird. It seems disrespectful to him to name a product after him when its purpose is pretty much unrelated to his work.

thom•3mo ago

Give me this, but with a very efficient, opinionated path to put models into production. Give me accessible PM and customer friendly documentation about features and model choices at every stage. Make it reusable and easy to modify. Make it robust and scalable at inference time, with metrics and dashboards tracking performance over time. This seems like optimising the bit that's already fun, but I see a lot of value in hand-holding a department through all the stodgy boring bits and getting high quality analysis repeatably into customer hands.

sosodev•3mo ago

Does it support OpenRouter? I tried configuring OpenRouter as a "local model" but it seems to silently fail.

WillNickols•3mo ago

Not yet - we need to change the header configuration for that to work (versus connecting to local models), but we'll have it available soon.

anigbrowl•3mo ago

Apple Silicon only, might be worth mentioning on the download link.

jorgeoguerra•3mo ago

Thanks for pointing that out - will fix it asap

dartharva•3mo ago

I'm seeing a Windows download link?

jorgeoguerra•3mo ago

The download button on the erdos/ page is OS specific, but you can also find all the download links in the download-erdos/ page.

agnosticmantis•3mo ago

This looks very cool, I’m gonna try it later today.

Out of curiosity, why the name Erdos? AFAIK Erdos was neither a statistician, data scientist nor AI researcher.

He sure solved many probability/combinatorics problems and famously had many many collaborators.

jorgeoguerra•3mo ago

No specific reason. Mainly because he was one of the most productive and collaborative mathematicians of all time. We actually considered "Poisson" at some point but ended up going with Erdos.

Show HN: I saw this cool navigation reveal, so I made a simple HTML+CSS version

Show HN: Stacky – certain block game clone

Show HN: Look Ma, No Linux: Shell, App Installer, Vi, Cc on ESP32-S3 / BreezyBox

Show HN: I spent 4 years building a UI design tool with only the features I use

Show HN: If you lose your memory, how to regain access to your computer?

Show HN: A toy compiler I built in high school (runs in browser)

Show HN: Kappal – CLI to Run Docker Compose YML on Kubernetes for Local Dev

Show HN: R3forth, a ColorForth-inspired language with a tiny VM

Show HN: Smooth CLI – Token-efficient browser for AI agents

Show HN: Nginx-defender – realtime abuse blocking for Nginx

Show HN: Slack CLI for Agents

Show HN: Which chef knife steels are good? Data from 540 Reddit tread

Show HN: BioTradingArena – Benchmark for LLMs to predict biotech stock movements

Show HN: Artifact Keeper – Open-Source Artifactory/Nexus Alternative in Rust

Show HN: MCP App to play backgammon with your LLM

Show HN: ARM64 Android Dev Kit

Show HN: I'm 75, building an OSS Virtual Protest Protocol for digital activism

Show HN: I built Divvy to split restaurant bills from a photo

Show HN: Gigacode – Use OpenCode's UI with Claude Code/Codex/Amp

Show HN: XAPIs.dev – Twitter API Alternative at 90% Lower Cost

Show HN: I Hacked My Family's Meal Planning with an App

Show HN: I built a free UCP checker – see if AI agents can find your store

Show HN: Micropolis/SimCity Clone in Emacs Lisp

Show HN: Daily-updated database of malicious browser extensions

Show HN: Falcon's Eye (isometric NetHack) running in the browser via WebAssembly

Show HN: Compile-Time Vibe Coding

Show HN: Horizons – OSS agent execution engine

Show HN: Slop News – HN front page now, but it's all slop

Show HN: Local task classifier and dispatcher on RTX 3080

Show HN: Fitspire – a simple 5-minute workout app for busy people (iOS)

Show HN: I saw this cool navigation reveal, so I made a simple HTML+CSS version

Show HN: Stacky – certain block game clone

Show HN: Look Ma, No Linux: Shell, App Installer, Vi, Cc on ESP32-S3 / BreezyBox

Show HN: I spent 4 years building a UI design tool with only the features I use

Show HN: If you lose your memory, how to regain access to your computer?

Show HN: A toy compiler I built in high school (runs in browser)

Show HN: Kappal – CLI to Run Docker Compose YML on Kubernetes for Local Dev

Show HN: R3forth, a ColorForth-inspired language with a tiny VM

Show HN: Smooth CLI – Token-efficient browser for AI agents

Show HN: Nginx-defender – realtime abuse blocking for Nginx

Show HN: Slack CLI for Agents

Show HN: Which chef knife steels are good? Data from 540 Reddit tread

Show HN: BioTradingArena – Benchmark for LLMs to predict biotech stock movements

Show HN: Artifact Keeper – Open-Source Artifactory/Nexus Alternative in Rust

Show HN: MCP App to play backgammon with your LLM

Show HN: ARM64 Android Dev Kit

Show HN: I'm 75, building an OSS Virtual Protest Protocol for digital activism

Show HN: I built Divvy to split restaurant bills from a photo

Show HN: Gigacode – Use OpenCode's UI with Claude Code/Codex/Amp

Show HN: XAPIs.dev – Twitter API Alternative at 90% Lower Cost

Show HN: I Hacked My Family's Meal Planning with an App

Show HN: I built a free UCP checker – see if AI agents can find your store

Show HN: Micropolis/SimCity Clone in Emacs Lisp

Show HN: Daily-updated database of malicious browser extensions

Show HN: Falcon's Eye (isometric NetHack) running in the browser via WebAssembly

Show HN: Compile-Time Vibe Coding

Show HN: Horizons – OSS agent execution engine

Show HN: Slop News – HN front page now, but it's all slop

Show HN: Local task classifier and dispatcher on RTX 3080

Show HN: Fitspire – a simple 5-minute workout app for busy people (iOS)

Show HN: Erdos – open-source, AI data science IDE

Comments