Hugging Face ❤️ TorchTPU: TPUs, Natively

Google and Meta have open-sourced TorchTPU, which serves as a native PyTorch backend specifically for Cloud TPUs. This new backend operates in eager mode by default and utilizes torch.compile and XLA for compilation. Designed to replace PyTorch/XLA for new workloads, TorchTPU enables native TPU support within the PyTorch ecosystem. This collaboration between the two tech giants aims to streamline the deployment of machine learning models on Cloud TPU infrastructure for developers and researchers.