An advanced language model may one day be used in game design, experiments with 'Overwatch,' 'Dota 2' and 'Final Fantasy VII' demonstrate.
—an artificial intelligence and machine learning research organization co-founded by Elon Musk, Sam Altman, Ilya Sutskever and Greg Brockman—made the 1.5B model publicly available. But the algorithm's massive size made experimenting with the language modeler a near impossibility with consumer GPUs, constraining GPT-2 experimentation to university researchers and others with the necessary computation.
Designed in response to the particular needs of machine learning and artificial intelligence applications, Google TPU microchips offered one possible solution. Originally used in Google data centers to power Google Translate, Search and other services—48 TPUs were used in the AlphaGo computer that defeated Go world champion Lee Sedol in 2016—the tech giant began offering TPU cloud computing to companies in 2018.
But renting a"TPU pod" for cloud computing can cost millions, making them prohibitively expensive for all but large companies—organizations unlikely to try out playful experiments. So Presser developed a technique he dubbed"swarm training," to employ 80 individual TPUs on a single data set. "In swarm training, we can run dozens or hundreds of TPUs in a loose network which swaps updates on the fly," Presser told."It's chaotic, but it winds up working pretty well: it's much faster than using just a few TPUs, but much cheaper than renting entire TPU pods. We're hopeful that swarm training will be very useful to other researchers."
Canada Latest News, Canada Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Syrian father, protecting daughter from trauma, turns sounds of war into a gameSyrian video journalist Abdallah al-Muhammad has invented a game to protect his three-year-old daughter, Salwa, from the trauma of hearing air strikes and shelling near his home in northwest Syria’s Idlib
Read more »
Can a video game save a life? African refugee puts players in his race for survivalThe goal of Lual Mayen's video game is to survive the horrific ordeal of a ...
Read more »
Mobile Games Hotspot: More 'Kingdom Hearts' for Phones; 'Angry Birds' Take to the Tennis CourtElsewhere in gaming-on-the-go: 'Sonic at the Olympic Games' set to compete on mobile; 'Witcher' card game 'Gwent' gets release date; and Apple Arcade keeps rolling out titles.
Read more »
PlayStation is skipping a major video game conference due to 'increasing concerns' over the coronavirus outbreakSony's PlayStation group is pulling games and staff from the year's first major gaming convention due to the coronavirus outbreak.
Read more »
Ninja Blasts Video Game Haters, Imagine Telling LeBron James to ChillNinja is sick and tired of people treating his sport like it's a joke ... and he's invoking the names of LeBron and Tom Brady to make his point.
Read more »
Facebook and Sony withdraw from GDC 2020 due to the coronavirus - Business InsiderHealth and travel concerns raised by the coronavirus outbreak will prevent Facebook and Sony from attending the 2020 Game Developers Conference.
Read more »