Health NZ staff told to stop using ChatGPT to write clinical notes

https://www.rnz.co.nz/news/national/590645/health-nz-staff-told-to-stop-using-chatgpt-to-write-clinical-notes

44•billybuckwheat•2h ago

Comments

burnte•1h ago

Yeah, no privacy or security there. There are some tools explicitly designed at helping healthcare providers produce better notes faster, and a couple of them are AMAZING. I'm an AI-half-empty guy, I'm keenly aware of its shortcomings and deploy it thoughtfully, and even with my skepticism there are a couple of tools that are just plain great. I think using LLMs to create overviews and summaries is a great use of the tech.

javascriptfan69•1h ago

The one my doctor was using got my obs numbers completely wrong.

We had to correct them at the end of the consultation.

simmerup•4m ago

Gotta break a few eggs to save 2 minutes of thinking and work

samglass09•1h ago

Meanwhile they are pushing AI transcription and note taking solutions hard.

Patients are guilted into allowing the doctors to use it. I have gotten pushback when asked to have it turned off.

The messaging is that it all stays local. In reality it’s not and when I last looked it was running on Azure OpenAI in Australia.

I spoke to a practice nurse a few days ago to discuss this.

She said she didn’t think patients would care if they knew the data would be shipped off site. She said people’s problems are not that confidential and their heath data is probably online anyway so who cares.

SpaceNoodled•27m ago

Is there nothing like HIPAA there or what?

samglass09•17m ago

Very little protections. The entire medical records of a significant percentage of the NZ population were stolen recently and put up for sale online. Zero consequences for the medical practices who adopted the hacked software.

lights0123•15m ago

Many AI companies, including Azure with their OpenAI hosting, are more than willing to sign privacy agreements that allow processing sensitive medical data with their models.

Ucalegon•4m ago

The devil is in the details. For example, OAI does not have regional processing for AU [0] and their ZDR does not cover files[1]. Anthropic's ZDR [2] also does not cover files, so you really need to be careful, as a patient/consumer, to ensure that your health, or other sensitive data, that is being processed by SaaS frontier models is not contained in files. Which is asking a a lot of the medical provider to know how their systems work, they won't, which is why I will never opt in.

[0] https://developers.openai.com/api/docs/guides/your-data#whic...

[1] https://developers.openai.com/api/docs/guides/your-data#stor...

[2] https://platform.claude.com/docs/en/build-with-claude/zero-d...

jimjimjim•5m ago

The New Zealand Chief Digital Officer allowed Australian cloud providers to be used as there weren't suitable NZ data centers and this was many years ago.

keithnz•39m ago

FYI, AI adoption in health in NZ is moving forward, for example https://www.rnz.co.nz/news/national/589774/emergency-doctors...

This is just about not using free/public AI tools.

Running Tesla Model 3's computer on my desk using parts from crashed cars

ARC-AGI-3

The EU still wants to scan your private messages and photos

Earthquake scientists reveal how overplowing weakens soil at experimental farm

90% of Claude-linked output going to GitHub repos w <2 stars

My astrophotography in the movie Project Hail Mary

Apple randomly closes bug reports unless you "verify" the bug remains unfixed

My DIY FPGA board can run Quake II

Supreme Court Sides with Cox in Copyright Fight over Pirated Music

Quantization from the Ground Up

Ensu – Ente’s Local LLM app

TurboQuant: Redefining AI efficiency with extreme compression

Updates to GitHub Copilot interaction data usage policy

Sodium-ion EV battery breakthrough delivers 11-min charging and 450 km range

China is mass-producing hypersonic missiles for $99,000

FreeCAD v1.1

Thoughts on slowing the fuck down

Goodbye to Sora

Miscellanea: The War in Iran

Ball Pit

Health NZ staff told to stop using ChatGPT to write clinical notes

Meta and YouTube found negligent in landmark social media addiction case

VitruvianOS – Desktop Linux Inspired by the BeOS

Antimatter has been transported for the first time

Show HN: Automate your workflow in plain English

Tracy Kidder has died

Looking at Unity made me understand the point of C++ coroutines

Jury finds Meta liable in case over child sexual exploitation on its platforms

Flighty Airports

Show HN: I took back Video.js after 16 years and we rewrote it to be 88% smaller

Running Tesla Model 3's computer on my desk using parts from crashed cars

ARC-AGI-3

The EU still wants to scan your private messages and photos

Earthquake scientists reveal how overplowing weakens soil at experimental farm

90% of Claude-linked output going to GitHub repos w <2 stars

My astrophotography in the movie Project Hail Mary

Apple randomly closes bug reports unless you "verify" the bug remains unfixed

My DIY FPGA board can run Quake II

Supreme Court Sides with Cox in Copyright Fight over Pirated Music

Quantization from the Ground Up

Ensu – Ente’s Local LLM app

TurboQuant: Redefining AI efficiency with extreme compression

Updates to GitHub Copilot interaction data usage policy

Sodium-ion EV battery breakthrough delivers 11-min charging and 450 km range

China is mass-producing hypersonic missiles for $99,000

FreeCAD v1.1

Thoughts on slowing the fuck down

Goodbye to Sora

Miscellanea: The War in Iran

Ball Pit

Health NZ staff told to stop using ChatGPT to write clinical notes

Meta and YouTube found negligent in landmark social media addiction case

VitruvianOS – Desktop Linux Inspired by the BeOS

Antimatter has been transported for the first time

Show HN: Automate your workflow in plain English

Tracy Kidder has died

Looking at Unity made me understand the point of C++ coroutines

Jury finds Meta liable in case over child sexual exploitation on its platforms

Flighty Airports

Show HN: I took back Video.js after 16 years and we rewrote it to be 88% smaller

Health NZ staff told to stop using ChatGPT to write clinical notes

Comments