As the article rightly notes, Tesla FSD is still a Level 2 driver assistance system, not a fully autonomous solution. From my background in Human-Machine Interface (HMI) design, I’ve long argued that expecting a human to instantly take over in a high-speed, high-stakes situation - especially to correct an unexpected or erratic system behavior - is a fundamental design flaw.
Human attention and reaction time simply don’t align with the demands of these edge cases. If the system requires a human to be both disengaged and instantly ready, it creates a paradox that undermines safety.
Nothing in that photo hints at "why?". (I have no computer vision experience.) The article speculates about shadows on the road...maybe those suddenly appeared (sun came from behind a cloud), and the FSD image analyzer freaked out?
But I don’t wanna blame him entirely. Firstly not everyone is capable using systems like this, nor everyone should. And obviously system shouldn’t behave like this at all (tho someone looking at data was saying driver deliberately swerved themselves).
He was just cruising on an open road and suddenly the thing swerved giving him less than a second to react.
https://old.reddit.com/r/TeslaFSD/comments/1ksa79y/1328_fsd_...
Excerpt:
JFC, what happened!!!!!!!!
I'm guessing: * Tesla has been doing a bunch of training recently to detect looney tunes walls... For some fairly obvious reason. * This car decided the shadow of the pole was the base of a wall, but it only saw the wall too late to brake so it swerved. * From the time of the hard left to when it was too late to recover was probably about 0.3 seconds, too fast for the combination of human reaction time, raising hands to the steering wheel, and applying enough force to correct. I didn't think there is any way an average human, or particularly an older human, with their hands resting in their lap, could stop this.
[driver] You summarized my experience perfectly was not distracted at all just didn’t have time to react!
jqpabc123•8mo ago
Look out drivers in Austin. This is headed your way.
taylodl•8mo ago
Pedestrians, cyclists, motorcyclists, and even children getting off school buses have been involved in tragic incidents. These are the people who can’t intervene when the system fails. That’s why I believe the conversation around FSD safety needs to focus more on system accountability and protection of vulnerable road users, not just driver vigilance.
desktopninja•8mo ago
But I as one of other drivers should not have to change my driving habits just for elon to make more money.
dzhiurgis•8mo ago