I have a little bit of an announcement: I am working on a podcast that I'm hoping to release in November. I'm not going to give away much in the way of details; partly because I'm still working on the details, and partly (and perhaps selfishly), I don't want a more perhaps qualified or skillful podcaster to take my idea. Why announce it? Well, announcing to the world that you're going to be doing something holds you accountable to actually do that something.
All that to say that I've been doing a lot of research, and one area that I've been exploring is Artificial Intelligence. When you feel like you've been drinking from the proverbial fire hose for several weeks, it's hard to put down and articulate all of the thoughts you have on a subject. I'm an ideas person; the whole organizing the idea into a cogent plan and then actually finishing the idea is a foreign concept to me.
Back in 2017 (remember those days? Wow I was so naive and certainly not as jaded and cynical towards the world as I am now), Sam Altman - the CEO of OpenAI, one of the biggest and most influential AI companies - published a blog post called The Merge. (He published it on December 7; perhaps unknowingly connecting his vision for Artificial Intelligence with "the day that shall live in infamy.)
Here is the post:
https://blog.samaltman.com/the-merge
People have said that Altman used to be a steadying voice in the area of AI but as his profits have increased, he's become more unhinged. I think that "The Merge" shows us that he's always been who we see him as now.
However, I was surprised to see his company along with several others reach out to the government this past week, basically begging it to help them pause the acceleration of artificial intelligence. There are many reasons as to why this is happening so fast, but two of the most easily understood ones are:
(1) AI companies have switched their focus in AI models from a Language Learning Model to a Reinforcement Learning Model. What does that mean? Basically, an LLM learns by reading giant books in order to talk like a human, while an RLM learns by playing a game and getting treats or penalties for good or bad moves. AI companies have combined these two ways of learning and it has accelerated the speed at which these models become powerful. It is teaching AI models how to think before they speak. Before, they would just blurt out the first thing that came to "mind." It can now break a difficult scenario or problem into smaller steps. It can also pause and correct itself in real time before giving you a final answer. Also, in the past humans in order to make an AI smarter had to manually write down hundreds of examples for the AI to learn, which obviously takes a long time. Now they essentially give the AI a digital playground for them to practice over and over and over, millions of times, without needing human intervention or input.
(2) AI companies are using AI generated feedback (also known as Constitutional AI) to train the next generation of AI. What this means is that rather than having humans train the AI model, they are programming the latest model itself train the next generation. This means that AI is teaching itself instead of us teaching them. Humans get tired. They can't work 24/7. AI can work all day everyday. In the past, humans had to read all the answers the AI gave and give them thumbs up or thumbs down responses. Now, the older system can do that in real time all the time, which accelerates learning. Also, we are running out of quality text to give AI models to learn from, so the current model can come up with synthetic problems and complex equations for the learning AI to learn and discover from.
Okay, that was a lot of stuff to learn. Take a pause. Inhale. Exhale.
What can be done? Obviously the risks are increasing. If an AI is giving another AI fake scenario after fake scenario, it seems like the new AI will be divorced more and more from actual real world situations and its view on humanity and the world will become distorted. AI models are getting more and more skillful at finding loopholes in order to get a perfect AI score from its teacher, even if it didn't solve the problem correctly. Do we really want our artificial intelligence programs to be deceptive?
There is so much more to get into with this, which I will at a later date, but for now let me try and answer the question in the title. Can we halt AI's deceptively exponential growth rate? I think we can.
First, let me just go ahead and say that if we haven't already reached Artificial General Intelligence (where computers are as smart as humans in everything), we will soon. I'm not worried about that. I'm not anti-AI. I see AI as a very helpful tool. I found a spider near my mailbox. I took a picture of it and asked Gemini (Google's AI) what kind of spider it was. It told me (grass spider), told me about it (harmless, great to have around to catch bugs), and that was that. Obviously that's a basic example, there's so much more that AI can do to help us.
What we don't want to have happen is for AI to develop superintelligence. If we get there, there's a really low chance that humanity survives. How would this happen? There are many scenarios that could take place. We will talk about those at a future date. A way to prevent this from happening? Regulate the AI companies and ban Constitutional AI. Don't allow AI to train AI. Inject humanity back into the process. The other thing I would do is pass a law that every AI model has to have a kill switch. Who gets the authority to throw the switch? I don't know. An international judicial body? The leader of each country? That's an interesting question.
The CEOs of AI companies admitting that there is a problem is a good start. Now we just need to act quickly before it's too late. We don't want yet another day that lives in infamy.




