A measure of complexity of large language models (LLMs) is the number of “parameters” they use. GPT-1 had on the order of 100 million parameters; the recently released GPT-4 used in ChatGPT has on the order of 1 trillion parameters — a ten-thousand-fold increase. I’m not an AI researcher, but I think we can look at human children to see why scaling the number of parameters will likely lead to diminishing returns on intelligence.
Continue reading “LLMs vs. 5 year olds”ChatGPT: Dawn of ubiquitous AI
Move over Eliza and expert systems. ChatGPT belongs to a family of artificial intelligence (AI) know as large language models (LLMs). The ChatGPT service lets you hold conversations with a computer ranging from astronomy to Zoroastrianism. This AI has some Kepler paid for my first month’s subscription of the ChatGPT service in December which gave me the opportunity to have more conversations with the AI. While it has its quirks, I can definitely see it becoming something that can assist with productivity when used correctly. In fact, I found it so useful, I got myself a subscription. In this blog post, I talk more about my experiences and where I think this technology might be headed.
Continue reading “ChatGPT: Dawn of ubiquitous AI”