Model ReleasesGoogle's GShard introduces the first massive-scale Mixture of Experts architecture with 600 billion parameters, transforming machine translation capabilities.over 6 years ago5 min read