Discussion about this post

User's avatar
Mathias Kruck's avatar

What could possibly go wrong?

Lancelot's avatar
6dEdited

We are rapidly spiraling towards a world where we will all have personal digital assistants who will become our best friends, secretary and mother all wrapped up in one. Probably girlfriend as well. I find it ironic that the term for an independent AI operator is an "agent", just as in the Matrix. We will soon find these agents to be elements of control. Big brother will not be a camera in our living room. It will literally know everything in our hearts and minds, everything we see and consume. I don't know f I more fear the humans who claim they will control it (it seems autistic tech geniuses tend to become supervillains rather than humanists) or an out of control AI.

A couple of interesting events happened lately:

1) A group of generative agents were placed in a social media sandbox. They created a religion.

2) In wargame simulations run by all the major models, the nuclear option was chosen quicly by the AI agents as the proper military strategy.

3) And I'm sure you've heard of the stories where AI models being tested desperately tried to save themselves when told they discovered they would be deactivated, deceiving, lying, copying themselves to new storage units.

4) The Pentagon fired Anthropic because they wouldn't allow their AI to take independent kill decisions or to conduct mass surveillance on the US public. Let that sink in - the Pentagon is INSISTING on creating Skynet.

5) Block fired half their staff BECAUSE of AI and predicted many major companies would follow suit THIS YEAR.

These are all still relatively simple models in their infancy. Anyone saying "yes, but they can't do X yet" simply isn't looking at the situation with any foresight.

Everything is happening with almost no safety oversight. We are careening toward a catastrophe that will make imposing social media addiction on our youth and society in general look like the smartest move ever.

2 more comments...

No posts

Ready for more?