Model ReleasesGoogle's GShard introduces the first massive-scale Mixture of Experts architecture with 600 billion parameters, transforming machine translation capabilities.about 6 years ago5 min read
