That doesn't feel like a good sign to me--for the AI bull or the AI bear cases.

"It Lied, Spammed, and Lost $447."

Sounds like a vast majority of VC startups to me. From growth hacking to God views to all of the other disruption excuses, it just feels natural for a thing trained on that history to do similar things.

Also what is the failure rate of tech businesses again?

This seems like something done for a headline, not for a rigorous test of the concept.

I use LLM daily, did since gpt 3.5, but still in a very conservative, controlled mode. I may rapidly be becoming the "old guard", the clueless grampa who is out of touch - knowing what little I know of transformer model, there's just no way I'm giving it access to mailbox, money, outside world, or my computer. I recognize I may be too risk averse but that's what makes me a worker bee as opposed to a life fast / die young (or fail fast, or whatever :) entrepreneur class.

i am looking forward to when we can put this behind us, it is still a major issue

But when hunting for them in the wild, they get a lot more confused.

how long until the "AI" starts trying to hire hitmen, etc. to disrupt the competition in the physical realworld

not like "AI" has ethics, a pre-teenage kid has more ethics

An interesting experiment would be AI run business with a human agent that does tasks.

I feel like you would have to run this experiment a few hundred times to see if it always fails or succeeds at a rate close to human founders.

This is ripe for a paperclips scenario.

For coding compaction kind of works as the agent could regenerate lot of the missing context(but far from all), but for places where there is need for long term context, solving it is one of the most important challenge.

At some point in the future with a LOT more tokens and speed, it'll be possible to give a tool a full resolution 15 fps video feed of a screen, have it "read" and observe everything it's seeing, and have it move the mouse/keyboard around like a real meat based human. Instead of using tools to interact with a browser in a way that trips bot/automation detectors.

Is this literally just an infinite loop in a bash shell injecting the initial prompt into the OpenAI CLI, and each run of the CLI picks up where it left off using some kind of persistent memory? Or is it a single context window? It sounds like the latter but it's not clear to me how this "continue" message is "injected", and surely one context window would be inneffective after just an hour or two.

Sorry if this is a basic question but somehow I have missed the details of these kinds of agents.