Blog
The Oldest AI Blog in the Czech Republic
We have been writing about artificial intelligence since 2017. 1000+ articles, thousands of pages of thoughts, experiments, and reflections. No sensationalism, no ads.
Filter articles▼
Tag Filter: Language Models × cancel
▸Browse by Topics
Topics
Showing 7 of 79 articles
Archive 2020FBHave you heard of the conversational agent, or chatbot, called Meena? In…
Have you heard of the conversational agent, or chatbot, called Meena? At the end of January, Google AI introduced it. It is a robust model with 2.6 billion parameters. The model's architecture is based on 13 decoding blocks of the Evolved Transformer.
Read
Archive 2019FBAI Surpasses Moore's Law
AI Surpasses Moore's Law As you may know, Moore's Law states that approximately every 18 months (up to two years), the number of transistors on an integrated circuit doubles. A new report prepared by Stanford University and companies such as McKinsey &
Read
Archive 2019FBI have just completed the course "Learn BERT - most powerful NLP algorithm by Google".
I have just completed the course "Learn BERT - most powerful NLP algorithm by Google". It is an advanced course that introduces both theoretically and practically the use of the BERT model. Bertík is a cutting-edge algorithm from Google that...
Read
Archive 2019FBTechnological Trends from Gartner Symposium 2019:
Technological trends from Gartner Symposium 2019: 1. Hyperautomation is the new name for various automation techniques such as RPA, BPM, ML, DTO, NLP... 2. Multiexperience: People-Centric Smart Spaces. Technology is everywhere. The digital world surrounds us and
Read
Archive 2019FBGreat news! OpenAI has finally released its largest XLGPT-2 model with 1.5 billion…
Great news! OpenAI has finally released its largest XLGPT-2 model with 1.5 billion parameters and 48 layers. I like that people find the outputs of GPT-2 to be very convincing. The largest model has a 'credibility score' of 6.91 out of 10. That's just a little more than the outputs from the 774M model (6.72) and significantly more than the medium model 355M (6.07). The difference between the large and super large model is therefore relatively small (goodness, what a sentence:)). This was probably the last proverbial straw that led OpenAI to release the XL model.
Read
Archive 2019FBLess than a month ago, the AI Salesforce team released a new text generation model, CTRL.
Less than a month ago, the AI Salesforce team released a new text generation model, CTRL. The algorithm works by allowing you to input a web link, and it attempts to generate an article that could be found there. This model is truly massive.
Read
Archive 2019FBAmong the Best Artificial Intelligence Models for Natural Language Processing (Bert, …
Among the best artificial intelligence models for natural language processing (Bert, Robert, GPT-2, or Megatron), another player has entered the field: ALBERT! ALBERT is brought to us by Google Research and the Toyota Technological Institute. What’s interesting is not just that the model delivers fantastic results on classic tasks like GLUE, RACE, or SQuAD, but also that it is smaller than its predecessors!
Read