Hugging face transformers

The almighty king of text generation, GPT-2 comes in four available sizes, only three of which have been publicly made available. Feared for its fake news generation capabilities, it currently stands as the most syntactically coherent model. A direct successor to the original GPT, it reinforces the already established pre-training/fine-tuning killer duo. From the paper: Language Models are Unsupervised Multitask Learners by Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei and Ilya Sutskever. Overcoming the unidirectional limit while maintaining an independent masking algorithm based on permutation, XLNet improves upon the state-of-the-art autoregressive model that is TransformerXL. Using a bidirectional context while keeping its autoregressive approach, this model outperforms BERT on 20 tasks while keeping an impressive generative coherence. From the paper: XLNet: Generalized Autoregressive Pretraining for Language Understanding, by Zhilin Yang, Zihang Dai, Yiming Yang, Jaime Carbonell, Ruslan Salakhutdinov and Quoc V. Le. Released by OpenAI, this seminal architecture has shown that large gains on several NLP tasks can be achieved by generative pre-training a language model on unlabeled text before fine-tuning it on a downstream task. From the paper: Improving Language Understanding by Generative Pre-Training, by Alec Radford, Karthik Naraimhan, Tim Salimans and Ilya Sutskever. The student of the now ubiquitous GPT-2 does not come short of its teacher’s expe...

Explore Azure • Discover secure, future-ready cloud solutions—on-premises, hybrid, multicloud, or at the edge • Learn about sustainable, trusted cloud infrastructure with more regions than any other provider • Build your business case for the cloud with key financial and technical guidance from Azure • Plan a clear path forward for your cloud journey with proven tools, guidance, and resources • See examples of innovation from successful companies of all sizes and from all industries • Products Home Products • • Popular • AI + machine learning • Analytics • Compute • Containers • Databases • DevOps • Developer tools • Hybrid + multicloud • Identity • Integration • Internet of Things • Management and governance • Media • Migration • Mixed reality • Mobile • Networking • Security • Storage • Web • Virtual desktop infrastructure Popular Explore some of the most popular Azure products • Provision Windows and Linux VMs in seconds • Enable a secure, remote desktop experience from anywhere • Migrate, modernize, and innovate on the modern SQL family of cloud databases • Build or modernize scalable, high-performance apps • Deploy and scale containers on managed Kubernetes • Add cognitive capabilities to apps with APIs and AI services • Quickly create powerful cloud apps for web and mobile • Everything you need to build and operate a live game on one platform • Execute event-driven serverless code functions with an end-to-end development experience • Jump in and explore a diverse sel...