Blog
The Oldest AI Blog in the Czech Republic
We have been writing about artificial intelligence since 2017. 1000+ articles, thousands of pages of thoughts, experiments, and reflections. No sensationalism, no ads.
Filter articles▼
Tag Filter: Language Models × cancel
▸Browse by Topics
Topics
Showing 24 of 24 articles
Archive 2019AI Surpasses Moore's Law
As you may know, Moore's Law states that approximately every 18 months (up to two years), the number of transistors on an integrated circuit doubles. A new report prepared by…
Read
Archive 2019Another Course Completed
I have just completed the course ‘Learn BERT – the most powerful NLP algorithm by Google’. It is an advanced course that introduces…
Read
Archive 2019Artificial Intelligence Aids in Uncovering the Mysteries of Physics
It could one day help to reformulate quantum mechanics. Swiss physicist Rennato Renner and his team have proposed an algorithm that can distil vast amounts of information into…
Read
Archive 2019New Technological Trends from Gartner Symposium 2019
1. Hyperautomation is the new name for various automation techniques such as RPA, BPM, ML, DTO, NLP… 2. Multiexperience: People-Centric Smart Spaces. Technology is everywhere. The digital world…
Read
Archive 2019Great news! OpenAI has finally released its largest XLGPT-2 model with 1.5 billion parameters and 48 layers.
I like that people find the outputs of GPT-2 to be very convincing. The 'credibility score' for the largest model is 6.91 out of 10. That's just slightly…
Read
Archive 2019Enthusiasm and Concerns about Artificial Intelligence
Editors of the scientific editorial office of Czech Radio focused on artificial intelligence and the issues it brings. Here you will find sections on ethics, artificial intelligence in...
Read
Archive 2019The Latest Artificial Intelligence Model for Natural Language Processing – ALBERT!
Among the top artificial intelligence models for natural language processing (Bert, Robert, GPT-2, or Megatron), a new player ALBERT joined the ranks last week! ALBERT is brought to us by…
Read
Archive 2019Video: How to Utilise Multiple AI Agents?
Open AI presents a beautiful 3-minute video demonstrating how to utilise multiple AI agents for collaboration and tool usage. It’s a fascinating sight. Those adorable little figures managed to come up with solutions that human creators had no idea about :)
Read
Archive 2019Ladies and gentlemen, this week we are witnessing one groundbreaking step after another
First, Nvidia releases the colossal Megatron (the largest model in the world, five times bigger than the largest GPT-2), to which OpenAI responds by releasing its large model with...
Read
Archive 2019Nvidia Announces It Has Trained the Largest Language Model in the World, GPT-2 8B!
The model uses 8.3 billion parameters and is 24 times larger than BERT and 5 times larger than the previously largest GPT-2 from OpenAI. Nvidia employed parallelism that…
Read
Archive 2019Microsoft invests a billion dollars in OpenAI!
We write about OpenAI quite often. Not only were we amazed by their GPT-2 model, but we also noted how the famous Elon Musk helped establish it back in 2015, although he recently departed from the company.
Read
Archive 2019Open AI Comes with Another Interesting Project – MuseNet!
In this experiment with a deep neural network (using the same universal technology as GPT-2), instead of text, it attempts to predict musical notes. This is nothing new in AI,…
Read
Archive 2019Nietzsche Responded with AI to the Question: 'What is the Meaning of Human Life?'
Yesterday, I conducted a small experiment. I took my favourite model from OpenAI, called GPT-2. Imagine a vast artificial neural network the size of a bird's brain (with over 100 million parameters) trained on millions of interesting articles written by humans...
Read
Archive 2019Andrew Ng has created a new course 'AI For Everyone' – 'AI for Everyone!'
In this classic four-week course, Ng demonstrates for the first time that AI is not just for engineers. If you want to work better with artificial intelligence in your company and…
Read
Archive 2019GPT-2 Interviews Alpha Industries Ltd.
I am still enchanted by the possibilities of the GPT-2 model. Today, I fine-tuned the system for questions and answers. I provided it with information about our company, Alpha Industries, and devised four questions, giving it the correct answer to three. I was curious to see how it would respond to the fourth question, and I must say, the model surprised me once again!
Read
Archive 2019A New Book on Machine Learning by Andriy Burkov
Most books on machine learning are thick and relatively challenging to read. Now, a book by Andriy Burkov has been released, which is only 100 pages long and…
Read
Archive 2019Artificial Intelligence Suffers from Human Prejudice!
Amazon tried an AI-powered recruitment programme but found that the software favoured men. A Microsoft chatbot transformed into a sex-obsessed, neo-Nazi machine in just 24…
Read
Archive 2019The AI Model GPT-2 Generated an Article About Alpha Industries! What’s the Result?
I had the much-discussed AI model GPT-2 generate an article on the topic: “I love Alpha Industries – the best company in the world that...
Read
Archive 2019Scientists have created a language neural network that approaches human quality. It is said to be so good that its authors are afraid to publish it!
Experts from OpenAI have proudly announced another technological success – the language model GPT-2. In the article's headline, they claim that its authors are afraid of it…
Read
Archive 2019Myths about Data Science Debunked!
Becoming a data scientist is complex. Not only do you need to learn mathematics, statistics, and programming, but you also have to constantly battle the myths you hear around you…
Read
Archive 2019Unsupervised MT - Machine Learning Without a Teacher
It is still more of a concept, with relatively weak results, but I am surprised that it works at all. Let’s take a look at machine translation. Traditionally…
Read
Archive 2019Publications on Machine Learning and NLP Written in 2018
In this article, you will find a number of statistical graphs regarding what has been published in this field, in which journals, how much each author has published, and so on.
Read
Archive 2019Test Your Knowledge of NLP (Natural Language Processing)
I found the quiz quite challenging. I didn't know all the answers :) Some questions were trivial, while others seemed a bit speculative. It's interesting that everyone considers something different to be important. In any case, a challenge for all NLP wizards!
Read
Archive 2019A Brief Guide to NLP Has Been Released
Natural language processing with code for the 10 most common tasks. And it’s all free! I think it’s a nice introduction. Perhaps it isn’t...
Read