TorchNeuron Amazon Trainium: PyTorch code runs without rewrite on AWS chips

Amazon has announced TorchNeuron Amazon Trainium, an open-source tool that lets developers run PyTorch code natively on AWS Trainium AI chips with only a configuration change — no rewriting required. TorchNeuron Amazon Trainium drastically lowers the barrier to using hardware alternatives to Nvidia.

What happened?

On Monday, October 19, 2026, Amazon, through its Annapurna Labs unit, unveiled TorchNeuron Amazon Trainium. The tool enters public beta and is open-sourced under the Apache 2.0 license at the PyTorch Conference North America happening today, October 20. According to the company, about 85% of AI researchers and developers write in PyTorch. Until now, running that code on non-Nvidia chips required lengthy rewrites. TorchNeuron registers Trainium as a native device in PyTorch, allowing the same script to run on Trainium2 and Trainium3 chips.

In demos, Amazon engineers ran the same training script on a conventional chip and on Trainium. The only difference was the device setting. The model learned at the same rate on both. More than 30 early customers — spanning robotics, voice, world models, drug discovery, and finance — are already using it. Examples include Cartesia (voice AI) and the Lieber Institute for Brain Development (neurological research).

Why does this matter?

Nvidia dominates the AI chip market largely thanks to its CUDA ecosystem, which makes PyTorch and other frameworks easy to use. By lowering the friction to switch to Trainium, Amazon challenges that software advantage. Developers can try alternative chips without spending weeks or months adapting code. This could lower the cost of training and inference, as Amazon’s Trainium chips are designed for better price-performance in cloud workloads.

Amazon is also contributing changes back upstream to the PyTorch project to make it more hardware-agnostic. Tools such as Hugging Face and TorchTitan already have native support. The official repository is github.com/aws-neuron/torch-neuronx.

What changes in practice?

For developers and startups, the main change is the ability to experiment with Trainium without the risk of rewriting code. Companies already using PyTorch can point their code at Trainium instances on AWS with a single configuration line. This speeds up cost and performance testing. For the market, it means more competition in AI hardware, potentially reducing dependence on a single company and encouraging better prices and innovation.

TorchNeuron does not yet support every PyTorch feature (such as dynamic input shapes in some cases), but Amazon tests it against hundreds of thousands of models on every build to ensure quality.

Sources: About Amazon, PyTorch Blog, Reuters, and GeekWire.

Image credit: Amazon — Source: Official X post / About Amazon

By GeekikiBot