This particular situation, at face value at least, sounds like a good outcome. Kids had a gun, someone noticed, called police, situation handled without escalation or violence or something tragic happening.
But this doesn't generalize. Another incident described in the article was when some kids were drinking in the car and shooting toy guns. What if they hadn't been drinking? What if they were just holding toy guns, innocently going from one kid's house to another? What if Waymo thought the guns were real, called the cops, and the cops screwed up and shot one of the kids? These sorts of escalations aren't imaginary; they happen, and they end in tragedy.
The article is also a little cagey on how this "detection" happened. Was it a human spot checking cameras in vehicles? I doubt it. Most likely it was some sort of computer vision algorithm that flagged something. Perhaps a human was in the loop to verify and be the one to call the cops, but humans seem to be increasingly shutting off their brains and trusting the machine. (I recall a recent incident where someone was wrongfully arrested because one of the companies that run the license-plate reader machines flagged their car as stolen. The machine screwed up the image recognition, but the cops blindly trusted it and arrested the guy.)
What happens when cops are allowed real-time access to Waymo's in-car video footage? Maybe they even have it already. This is just more pervasive, always-on surveillance, and this will only get worse as autonomous vehicles become more popular in the taxi scene.
Imagine the alternative headline saying the murderers used Waymo for their drive-by assassination. There is only one option for Waymo here, and the idiocy of the US police is not within their power to solve.
At least a human usually has some judgment and discretion situationally.
I guess the alternative "Juvenile Driveby Shooting takes place from Waymo" isn't a better headline though.
When we have evidence that Waymo is contracting its external cameras out to local governments and allowing abuse, then we can criticize them for it.
Well now my biggest fear of riding a Waymo is not how it drives but getting my Google account banned because it misdetected something.
I think this is awesome and I want more autonomous cars on the streets, replacing bad human drivers and calling the cops on kids with guns.
I am not against monitoring for safety - I am against deploying a sophisticated network of automated monitoring that covers all digital and soon physical aspects of my life for my "safety" by for profit companies.
And what surveillance or other risks does this introduce outside of the cabin, and why should society allow that? What is the definition of modicum of detection, and who is drawing that line?
And I'm not even convinced that human drivers would be more discerning or rational about it. They could easily overstate the issue to police and create a more biased situation.
Yea, what's disturbing about this article isn't what happened in the article--it's what will happen in the future.
Today, a corporation transmits to the police "user in possession of what appears to be a gun." Tomorrow, what will that message contain?
I take this seriously, but I think this a problem with the cops. Even regular people hesitate to report problems if they think the police might overreact.
MostlyStable•43m ago
kelnos•39m ago
Not to mention the mass surveillance this sort of stuff continues to help enable.
MostlyStable•36m ago
bot403•28m ago
Going to shoot up a place? Take your guns on a waymo. It won't complain. Guy wants to take an obviously distressed and co-erced girl to an abandoned lot? No complaints. Person with obvious head injury and slurring speech wants to go home instead of the hospital? Sure. Person has heart attack and passes out in back? We'll just drive your limp body 45 minutes in traffic to your destination.
These are just a few situations any human driver would obviously react to. And a modicum of detection and human review could solve in an autonomous vehicle.
_vertigo•24m ago
handwarmers•22m ago
jplona•20m ago
anon84873628•15m ago
PunchTornado•2m ago