Erasing key information during training allows machine learning models to learn new languages faster and more easily.
A team of computer scientists has created a nimbler, more flexible type of machine learning model. The trick: It must periodically forget what it knows. And while this new approach won’t displace the huge models that undergird the biggest apps, it could reveal more about how these programs understand language. The new research marks “a significant advance in the field,” said Jea Kwon, an AI engineer at the Institute for Basic Science in South Korea.
“By doing this, the entire model becomes used to resetting,” Artetxe said. “That means when you want to extend the model to another language, it’s easier, because that’s what you’ve been doing.” The researchers took a commonly used language model called Roberta, trained it using their periodic-forgetting technique, and compared it to the same model’s performance when it was trained with the standard, non-forgetting approach.
Canada Latest News, Canada Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Star Wars Keeps Forgetting Just How Dangerous Darth Vader Really IsAll the latest movie news, movie trailers & reviews - and the same for TV, too.
Read more »
Why forgetting things is a key part of the way your brain worksForgetfulness can be frustrating, but cognitive scientists reckon it underpins the brain’s capacity to efficiently process sensory information – and its unique ability to generalise our knowledge
Read more »
Towards the selective and energy-efficient synthesis of ethylene via carbon dioxide reductionThe synthesis of carbon-based chemicals via the electrochemical reduction of carbon dioxide (CO2) has become the key objective of numerous recent energy research efforts.
Read more »
‘Too big to fail’ was bad enough for the banks. Now we have ‘too many to fail.’The danger of forgetting the 2023 banking crisis and SVB’s collapse
Read more »
Can Music Help Us Learn New Languages?Besame Mucho Festival is coming to Texas March 2. The festival is truly one of a kind, jam packed with some of Latin music’s most iconic acts from a span of genres. Los Tigres del Norte (who will soon be playing RodeoHouston) and Ramón Ayala will be there. There will be a...
Read more »
Transforming Finance: Gartner's Expertise and InsightsLearn how Gartner can help finance teams achieve successful transformations with their expertise and insights.
Read more »