Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
transformers
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
How Hugging Face's Transformers Added UltraBERT with Layer-Specific Rotary Embeddings
Priyadarshan Singh
Priyadarshan Singh
Priyadarshan Singh
Follow
Oct 16
How Hugging Face's Transformers Added UltraBERT with Layer-Specific Rotary Embeddings
#
transformers
#
pytorch
#
nlp
#
modelarchitecture
Comments
Add Comment
2 min read
Your Agent Benchmark Pauses the World. Production Doesn't.
Vikas Srivastava
Vikas Srivastava
Vikas Srivastava
Follow
Oct 18
Your Agent Benchmark Pauses the World. Production Doesn't.
#
transformers
#
agents
#
benchmark
#
testing
Comments
Add Comment
4 min read
Build a Tiny Causal Transformer from Scratch
Vikas Srivastava
Vikas Srivastava
Vikas Srivastava
Follow
Oct 18
Build a Tiny Causal Transformer from Scratch
#
transformers
#
pytorch
#
languagemodels
Comments
Add Comment
7 min read
When AI Reviewers Find More Bugs Than Teams Can Fix
Vikas Srivastava
Vikas Srivastava
Vikas Srivastava
Follow
Oct 18
When AI Reviewers Find More Bugs Than Teams Can Fix
#
transformers
#
rag
#
promptengineering
#
postgres
Comments
Add Comment
4 min read
Detectar volatilidad anĂłmala en los mercados con un Temporal Fusion Transformer
Adrian
Adrian
Adrian
Follow
Sep 17
Detectar volatilidad anĂłmala en los mercados con un Temporal Fusion Transformer
#
deeplearning
#
transformers
#
finanzascuantitativas
#
seriestemporales
Comments
Add Comment
2 min read
They Put 7 Attention Mechanisms on a Latin Square. Then Removed Them One by One.
ai maya
ai maya
ai maya
Follow
Sep 18
They Put 7 Attention Mechanisms on a Latin Square. Then Removed Them One by One.
#
machinelearning
#
architecture
#
transformers
#
research
Comments
Add Comment
5 min read
Masked Self-Attention, Explained Through Avengers: Endgame
Ishita Garg
Ishita Garg
Ishita Garg
Follow
Aug 15
Masked Self-Attention, Explained Through Avengers: Endgame
#
machinelearning
#
deeplearning
#
nlp
#
transformers
1
 reaction
Comments
Add Comment
6 min read
Puzzle Solution Revealed - Transformer: Need for Position Embedding
Tech-Aarvam
Tech-Aarvam
Tech-Aarvam
Follow
Sep 15
Puzzle Solution Revealed - Transformer: Need for Position Embedding
#
llm
#
transformers
#
machinelearning
#
ai
Comments
1
 comment
13 min read
Depth-Attention: Opening an Attention Channel Between Transformer Layers
AICDragon
AICDragon
AICDragon
Follow
Aug 10
Depth-Attention: Opening an Attention Channel Between Transformer Layers
#
deeplearning
#
transformers
#
machinelearning
#
ai
Comments
Add Comment
11 min read
Top 5 Dev Tools Released in Late July 2026
karleeov
karleeov
karleeov
Follow
Jul 31
Top 5 Dev Tools Released in Late July 2026
#
aitools
#
devupdates
#
langchain
#
transformers
Comments
Add Comment
3 min read
How a Baseten Engineer Traced 7 Years of Attention Mechanism Evolution -- From GPT-2 to Kimi K3, in Runable PyTorch
AICDragon
AICDragon
AICDragon
Follow
Jul 31
How a Baseten Engineer Traced 7 Years of Attention Mechanism Evolution -- From GPT-2 to Kimi K3, in Runable PyTorch
#
ai
#
machinelearning
#
transformers
#
architecture
2
 reactions
Comments
4
 comments
7 min read
Attention Is All You Need: The Translation Problem That Led to ChatGPT
Syed Abdullah Saad
Syed Abdullah Saad
Syed Abdullah Saad
Follow
Sep 1
Attention Is All You Need: The Translation Problem That Led to ChatGPT
#
ai
#
machinelearning
#
programming
#
transformers
Comments
2
 comments
8 min read
Self-attention, explained without the heavy math
Divyakush Punjabi
Divyakush Punjabi
Divyakush Punjabi
Follow
Aug 15
Self-attention, explained without the heavy math
#
ai
#
machinelearning
#
transformers
#
deeplearning
3
 reactions
Comments
Add Comment
3 min read
The KV Cache Is the Bottleneck: A 2026 Field Guide to Attention Variants
ai maya
ai maya
ai maya
Follow
Aug 9
The KV Cache Is the Bottleneck: A 2026 Field Guide to Attention Variants
#
ai
#
llm
#
machinelearning
#
transformers
1
 reaction
Comments
2
 comments
4 min read
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account