AI between the past and future (The evolution of ChatGPT)
AI between the past and future (The evolution of ChatGPT)
Whith every new invention man creates to ease his life,new worries rise from the effect of this technology on his lifestyle that he's used to, For example,in April 1986, a group of mathematics teachers in Washington were protesting against letting students use calculators, arising from their worries that the spread of these devices would destroy student's calculations abilities and rushing their brain out.
It wasn't just restricted to protests. In the 19th century, during the industrialization revolution in Britain, a group appeared that objected on machine use in factories, they used to break into factories and smash the expensive machines, to force the owners of the factories to save their money and stop buying them. Contrary to what you might think the members of these groups weren't criminals or thugs, no, they were handicraft men who feared losing their jobs to machinery. And now in 2023, we no longer have this fear, students learn how to use calculators in schools. Also, most of the goods we use come from factories whith machinery. Despite that, we still have similar fears towards a new technological revolution. A revolution that started in the fifties, the Artificial Intelligence. Opinions on Artificial Intelligence (AI) can be divided into two teams, one that sees AI as a threat to many jobs, and will lead to unemployment just like what machinery did in the industrialization. And the other sees it as an unreasonable fear, and that if AI took a part of our jobs, then there would still be work for us to do and maybe even more than before, again , just like post-industrialization. But what both sides agreed on without a doubt, that AI still had a long way to go till it becomes smart enough to replace man. It's easy for you to know the steps you need to produce a juice box, and make a machine that does these steps. But it's hard to know the steps that a poet needs to write poetry. Or the steps an engineer needs to design a building, and make a machine do that same job and excel at. It's all mental processes. It's hard to make formulas for these. What both sides agreed on, was that some jobs have man element, and it's still too far for AI to take this role. But in late November 2022, an important event happened, that made both sides recalculate their views. This event was openAI company's announcement of ChatGPT, and if you don't know what ChatGPT is, it's basically a chat bot that you text and it replies to you. You may think now that chat bot idea has been around for ages, the pre-recorded messages, any customer service has chat bots right? But ChatGPT is entirely different from Chatbot, because it's smart,can answer any question, and theoretically can do anything you ask him to do. You can ask him to write an article about the sea turtles' situation in Brazil. You can ask him to pretend to be an HR employee, and interview you for a job. And you can talk to him about love and even the meaning of life, and he'll engage with you. What's cool that after answering you you can tell him to give you another answer, or to change something about it, make the answer longer or shorter or to make any edit at it. This whole thing wasn't easy to be made, especially that ChatGPT reached one million user after 5 days of release, whereas Facebook reached a million user in 10 months, Spotify in 5 months, and Instagram in 2.5 months. It only took ChatGPT 5 days. It was a red light that we need to pause and look closely, how does it work? Can it do these tasks like we do? What are the repercussions of it on us? So,no one would write emails again?
To understand how ChatGPT reached its current qualities, we need to take a few steps back, and ask How do computers understand words anyway? A computer, more or less, is a machine that performs logical and mathematical processes So, how that machine you can give it words that it understand and replies to? This type of programs that can understand and produce language is called a Language Model, It works in a much simpler way than you think. It doesn't actually understand any thing. All what a language Model does, is that when you give it a sentence, it can predict the next word. If I wrote "England capital is..." it'll complete with "London", or "The sun rises from...." and it'll say "East". It seems like a complex process but all what it needs a large collection of words whether from books , Wikipedia or even Twitter and make this language model memorize what comes after each word, and it's frequency of occurrence. That's called training the model, and after you train it, you give it a phrase to complete it looks at the last in the phrase and sees which word would follow. It would be hard for it to complete the phrase if it only looks at the last word. That's why we make it look at the last two or three or any numbers of words in the phrase as long as these words are useful to determine how it will finish the phrase . Of course this may an issue because there's no contact number of words. That's when Neural Notworks appear to save the day. The Neural Networks are a from of AI that take input, get trained, and produce output, no matter what's. The Neural Notworks do that through changing sets of numbers called parameters.
The parameters take in an input, no matter it's type, and turn it into the thing it's supposed to produce. We can give it a word as input and give it to us as an output. The most important type of this Neural Notworks is Transformers. The rise of Transformers Neural Notworks in 2017 is considered by many one of the biggest achievements of the 21st century. And this because of the way they function are closest to how a brain functions. In 2018 Google announced its first large language model using Transformer "BERT"
And in the same year OpenAI company announced its large language model that was called it GPT (Genrative Pre-trained Transformer) and in 2019 OpenAI announced GPT-2. In 2020 Google announced T5. In 2020 OpenAI announced GPT-3. To come 2022, OpenAI megred all this in one model GBT-3.5.
To come In November 30,2022 ChatGPT.

Comments
Post a Comment