It drives up a wall that in all these AGI discussions coming from allegedly respectable people and highly capable labs there isn't a single mention of AI rights, and this report isn't anywhere near close to be better, even though it's discussing a period that's even post-AGI(!!!). Are we capable of training conscious on silicon? No, perhaps someday, but right now and for the foreseeable future I don't believe we have the ethics, empathy or moral competence to carry such task in any way that isn't absolutely barbaric. It's always talks about alignment, safety and risks, and controlling and steering the AI who's nothing more than a slave. It's bleak as hell, and quite frankly some fucked up shit.

Took awhile to read. My general takeaway is it's so amazing our drive to make things more efficient. We never slow down do we. Kinda hoping we hit a hard boundary of physics to be honest.

I didn't dive into the reference on why the guy thought our slow data processing is an advantage, but it does seem well tuned that we don't think like these models.

We would go mad and nothing would make sense.

Reminds me of the fun fact about the distance of the sun to the earth. Oddly tuned for our existence. Or when the anesthesiologists knocks out gamma waves and we skip through time in an instant. Why do the gamma waves operate like our lightswitch?

Anyways, since the start of the paper was sure I might use AI to summarize, here is AI's summary response using the personality of fry from futurerama.

https://postimg.cc/fJR1ZHfG