Machine learning
The Bitter Lesson
The biggest lesson that can be read from 70 years of AI research is that general methods that leverage computation are ultimately the most effective, and by a large margin.
- 5min read
- 10min listen
- 12questions
EdenMind is a flashcard app you answer out loud. A model on your phone grades what you said. You don’t mark your own work, and no audio leaves the device.
Machine learning
The biggest lesson that can be read from 70 years of AI research is that general methods that leverage computation are ultimately the most effective, and by a large margin.
Machine learning
Transformer (deep learning)In deep learning, the transformer is a family of artificial neural network architectures based on the multi-head attention mechanism, in which input data such as text, images, or audio, is converted to a sequence of…
Machine learning
Deep learningIn machine learning, deep learning (DL) focuses on utilizing multilayered neural networks to perform tasks such as classification, regression, and representation learning.
Learning
Testing effectThe testing effect (also known as retrieval practice, active recall, practice testing, or test-enhanced learning) suggests long-term memory is increased when part of the learning period is devoted to retrieving…
Learning
Spaced repetitionSpaced repetition is an evidence-based learning technique that is usually performed with flashcards.