DEV Community

#pytorch

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Gemma 4 on a 4 GB GPU in Plain PyTorch: From Out of Memory to Faster Than llama.cpp

Includes a tricky broadcast K/V debugging story

Gemma 4 on a 4 GB GPU in Plain PyTorch: From Out of Memory to Faster Than llama.cpp

2
Comments 3
13 min read
MPS backend out of memory: the "max allowed" number on every Mac size

MPS backend out of memory: the "max allowed" number on every Mac size

1
Comments 1
5 min read
Pickle-only uploads to Hugging Face doubled since 2024

Pickle-only uploads to Hugging Face doubled since 2024

Comments
5 min read
PyTorch on TPU: Hands On With Colab

PyTorch on TPU: Hands On With Colab

2
Comments 1
14 min read
Four tools for seismic data

Four tools for seismic data

Comments
26 min read
Why a Keras model fails to convert to TFLite: 11 known cases, 5 traps

Why a Keras model fails to convert to TFLite: 11 known cases, 5 traps

Comments
6 min read
EMA's Decay Isn't a Dial. It's a Plateau, a Cliff, and a 10%-Accuracy Crater

EMA's Decay Isn't a Dial. It's a Plateau, a Cliff, and a 10%-Accuracy Crater

Comments
5 min read
TorchTPU vs CUDA: Can Native PyTorch Make Google TPUs Easier to Use?

TorchTPU vs CUDA: Can Native PyTorch Make Google TPUs Easier to Use?

1
Comments
8 min read
Why Long bf16 Training Runs Stall: The Residual Stream Has No Room for Small Updates

Why Long bf16 Training Runs Stall: The Residual Stream Has No Room for Small Updates

Comments
8 min read
Google Open-Sourced TorchTPU. PyTorch/XLA Is Deprecated and Gets Archived November 15

Google Open-Sourced TorchTPU. PyTorch/XLA Is Deprecated and Gets Archived November 15

Comments
7 min read
AWS PyTorch: Build, Train, and Deploy Deep Learning Models in the Cloud

AWS PyTorch: Build, Train, and Deploy Deep Learning Models in the Cloud

Comments
7 min read
Google has joined Amazon in attacking Nvidia's stronghold with AI app developers

Google has joined Amazon in attacking Nvidia's stronghold with AI app developers

Comments
2 min read
TorchNeuron y chips Trainium de Amazon: beta pĂşblica hoy

TorchNeuron y chips Trainium de Amazon: beta pĂşblica hoy

Comments
4 min read
AWS's TorchNeuron Runs PyTorch on Trainium With .to('neuron'). Shapes Must Be Static

AWS's TorchNeuron Runs PyTorch on Trainium With .to('neuron'). Shapes Must Be Static

Comments
7 min read
Amazon: New TorchNeuron tool challenges Nvidia's dominance

Amazon: New TorchNeuron tool challenges Nvidia's dominance

1
Comments
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.