DEV Community

Sachin Kr. Rajput profile picture

Sachin Kr. Rajput

AI inference & LLM serving engineer: latency, throughput & cost per token for production LLMs. 15 yrs building low-latency systems. Blog: blog.sachinrajput.dev · LinkedIn: in/skrajput18

Location Gurugram, India Joined Joined on  Personal website https://sachinrajput.dev

Work

Senior Engineering Manager at Guidepoint - QSight

One Request, End to End: Tokenize, Prefill, Decode, Stream
sachin_krrajput profile

One Request, End to End: Tokenize, Prefill, Decode, Stream

#llm #machinelearning #inference #performance
2
Comments 1
12 min read

Want to connect with Sachin Kr. Rajput?

Create an account to connect with Sachin Kr. Rajput. You can also sign in below to proceed if you already have an account.

Create Account
Already have an account? Sign in
Anatomy of a Decode-Step Stall: Where p99 Inter-Token Latency Really Comes From
sachin_krrajput profile

Anatomy of a Decode-Step Stall: Where p99 Inter-Token Latency Really Comes From

#machinelearning #ai #python #performance
Comments
41 min read
Six Posts on Ensembles and Tuning, and the Uncomfortable Thing They All Turned Out to Be About
sachin_krrajput profile

Six Posts on Ensembles and Tuning, and the Uncomfortable Thing They All Turned Out to Be About

#machinelearning #ai #python #programming
2
Comments
6 min read
Bayesian Optimization: The Prospector Who Reads Every Core Sample Before Choosing Where to Drill
sachin_krrajput profile

Bayesian Optimization: The Prospector Who Reads Every Core Sample Before Choosing Where to Drill

#machinelearning #ai #python #programming
1
Comments
12 min read
Grid Search vs Random Search: The Safe With Three Dials Where Only One Was Connected
sachin_krrajput profile

Grid Search vs Random Search: The Safe With Three Dials Where Only One Was Connected

#machinelearning #ai #python #programming
2
Comments
15 min read
The Hyperparameter Search Cheat Sheet: Which Method, What Budget, and When to Stop
sachin_krrajput profile

The Hyperparameter Search Cheat Sheet: Which Method, What Budget, and When to Stop

#machinelearning #ai #python #programming
1
Comments
5 min read
Replace Your Grid Search Tonight: The Optuna Setup That Killed 12 of My 20 Trials
sachin_krrajput profile

Replace Your Grid Search Tonight: The Optuna Setup That Killed 12 of My 20 Trials

#machinelearning #ai #python #programming
1
Comments
5 min read
Blending and Voting: Four Noses, One Bottle, and the Blender Who Graded His Own Homework
sachin_krrajput profile

Blending and Voting: Four Noses, One Bottle, and the Blender Who Graded His Own Homework

#machinelearning #ai #python #programming
1
Comments
13 min read
Stacking: The Editor Who Never Reported a Story and Still Wrote the Best One
sachin_krrajput profile

Stacking: The Editor Who Never Reported a Story and Still Wrote the Best One

#machinelearning #ai #python #programming
1
Comments
12 min read
The Boosting Series in One Page: Ten Posts, and the Six Numbers That Changed How I Tune
sachin_krrajput profile

The Boosting Series in One Page: Ten Posts, and the Six Numbers That Changed How I Tune

#machinelearning #ai #python #programming
1
Comments
6 min read
The Boosting Tuning Cheat Sheet: Which Knob to Turn First, and When to Stop Turning
sachin_krrajput profile

The Boosting Tuning Cheat Sheet: Which Knob to Turn First, and When to Stop Turning

#machinelearning #ai #python #programming
Comments
5 min read
I Gave XGBoost and LightGBM the Same 30 Seconds — The Speed Winner Didn't Win Anything
sachin_krrajput profile

I Gave XGBoost and LightGBM the Same 30 Seconds — The Speed Winner Didn't Win Anything

#machinelearning #ai #python #programming
1
Comments 2
5 min read
Bagging vs Boosting: The Orchestra That Plays Together vs The Relay Team That Runs One at a Time
sachin_krrajput profile

Bagging vs Boosting: The Orchestra That Plays Together vs The Relay Team That Runs One at a Time

#machinelearning #ai #python #programming
Comments
17 min read
CatBoost: The Interpreter Who Refused to Peek at Tomorrow's Newspaper
sachin_krrajput profile

CatBoost: The Interpreter Who Refused to Peek at Tomorrow's Newspaper

#machinelearning #datascience #python #beginners
Comments
12 min read
LightGBM: The Librarian Who Sorted a Million Books by Ignoring Most of Them
sachin_krrajput profile

LightGBM: The Librarian Who Sorted a Million Books by Ignoring Most of Them

#machinelearning #datascience #python #beginners
Comments
16 min read
XGBoost: The Accountant Who Read the Tax Code So Carefully He Found Money Nobody Else Saw
sachin_krrajput profile

XGBoost: The Accountant Who Read the Tax Code So Carefully He Found Money Nobody Else Saw

#machinelearning #datascience #python #beginners
1
Comments
16 min read
Week 2 Recap: The Week Trees Stopped Voting and Started Correcting Each Other
sachin_krrajput profile

Week 2 Recap: The Week Trees Stopped Voting and Started Correcting Each Other

#machinelearning #datascience #python #beginners
5
Comments
5 min read
The Boosting Family Decision Tree: Everything on One Page
sachin_krrajput profile

The Boosting Family Decision Tree: Everything on One Page

#machinelearning #datascience #python #beginners
Comments
5 min read
learning_rate and n_estimators Are One Parameter, Not Two — Here's the Number That Proves It
sachin_krrajput profile

learning_rate and n_estimators Are One Parameter, Not Two — Here's the Number That Proves It

#machinelearning #datascience #python #beginners
Comments
5 min read
Gradient Boosting: The Sculptor Who Fixes the Statue by Carving Only Its Mistakes
sachin_krrajput profile

Gradient Boosting: The Sculptor Who Fixes the Statue by Carving Only Its Mistakes

#machinelearning #datascience #python #beginners
Comments
15 min read
The Random Forest Series in One Page: Six Posts, One Number That Explains All of Them
sachin_krrajput profile

The Random Forest Series in One Page: Six Posts, One Number That Explains All of Them

#machinelearning #datascience #python #beginners
Comments
5 min read
The Random Forest Cheat Sheet: Everything on One Page
sachin_krrajput profile

The Random Forest Cheat Sheet: Everything on One Page

#machinelearning #datascience #python #beginners
Comments
4 min read
Don't Copy 'sqrt' Into Your Regressor: What max_features Actually Costs You, Measured
sachin_krrajput profile

Don't Copy 'sqrt' Into Your Regressor: What max_features Actually Costs You, Measured

#machinelearning #datascience #python #beginners
Comments
5 min read
AdaBoost: The Tutor Who Only Reviews the Questions You Got Wrong
sachin_krrajput profile

AdaBoost: The Tutor Who Only Reviews the Questions You Got Wrong

#machinelearning #datascience #python #beginners
Comments
20 min read
Extra Trees: The Chef Who Stopped Tasting the Soup and Somehow Cooked Faster and Better
sachin_krrajput profile

Extra Trees: The Chef Who Stopped Tasting the Soup and Somehow Cooked Faster and Better

#machinelearning #datascience #python #beginners
Comments
21 min read
Out-of-Bag Error: The Free Exam You Didn't Know You Were Already Taking
sachin_krrajput profile

Out-of-Bag Error: The Free Exam You Didn't Know You Were Already Taking

#machinelearning #datascience #python #beginners
Comments
19 min read
Feature Importance in Random Forests: The Company That Fired the Wrong Employee Because It Measured the Wrong Thing
sachin_krrajput profile

Feature Importance in Random Forests: The Company That Fired the Wrong Employee Because It Measured the Wrong Thing

#machinelearning #datascience #python #beginners
Comments
20 min read
Random Forest: The Jury Where Every Juror Is Also Blindfolded to Different Evidence
sachin_krrajput profile

Random Forest: The Jury Where Every Juror Is Also Blindfolded to Different Evidence

#beginners #machinelearning #datascience #python
1
Comments
12 min read
Bagging: The Jury System That Taught Machine Learning the Wisdom of Crowds
sachin_krrajput profile

Bagging: The Jury System That Taught Machine Learning the Wisdom of Crowds

#machinelearning #datascience #python #beginners
Comments 2
16 min read
Pruning Decision Trees: The Bonsai Master Who Taught ML Engineers When to Stop
sachin_krrajput profile

Pruning Decision Trees: The Bonsai Master Who Taught ML Engineers When to Stop

#machinelearning #datascience #python #beginners
Comments
16 min read
Gini Impurity: The Blindfolded Archer Who Taught Decision Trees How to Split
sachin_krrajput profile

Gini Impurity: The Blindfolded Archer Who Taught Decision Trees How to Split

#machinelearning #datascience #python #beginners
Comments
15 min read
Information Gain & Entropy: The Game Show Host Who Learned to Ask Perfect Questions
sachin_krrajput profile

Information Gain & Entropy: The Game Show Host Who Learned to Ask Perfect Questions

#machinelearning #datascience #python #beginners
Comments
16 min read
Decision Trees: The Detective Who Solves Cases by Asking Yes/No Questions
sachin_krrajput profile

Decision Trees: The Detective Who Solves Cases by Asking Yes/No Questions

#machinelearning #datascience #python #beginners
Comments
16 min read
The Sigmoid Function: The Story of the World's Most Diplomatic Mathematician
sachin_krrajput profile

The Sigmoid Function: The Story of the World's Most Diplomatic Mathematician

#machinelearning #datascience #python #beginners
Comments
10 min read
Why Is It Called 'Logistic Regression' If It's Used for Classification? The Naming Mystery Explained
sachin_krrajput profile

Why Is It Called 'Logistic Regression' If It's Used for Classification? The Naming Mystery Explained

#machinelearning #datascience #python #beginners
Comments
8 min read
Logistic Regression: The Bouncer Who Gives Probability of Entry Instead of Just Yes/No
sachin_krrajput profile

Logistic Regression: The Bouncer Who Gives Probability of Entry Instead of Just Yes/No

#machinelearning #datascience #python #beginners
Comments
13 min read
Elastic Net: The Mediator Who Said 'Let's Take the Best of Both Approaches'
sachin_krrajput profile

Elastic Net: The Mediator Who Said 'Let's Take the Best of Both Approaches'

#machinelearning #datascience #python #beginners
Comments
11 min read
Lasso Regression: The Brutal Manager Who Said 'Some of You Are Getting Fired' — And Actually Did It
sachin_krrajput profile

Lasso Regression: The Brutal Manager Who Said 'Some of You Are Getting Fired' — And Actually Did It

#machinelearning #datascience #python #beginners
Comments
12 min read
Ridge Regression: The Manager Who Said 'Everyone Gets a Small Piece' Instead of 'Winner Takes All'
sachin_krrajput profile

Ridge Regression: The Manager Who Said 'Everyone Gets a Small Piece' Instead of 'Winner Takes All'

#machinelearning #datascience #python #beginners
Comments
12 min read
Multicollinearity: The Three Witnesses Who Told the Same Story — And Why the Jury Got Confused
sachin_krrajput profile

Multicollinearity: The Three Witnesses Who Told the Same Story — And Why the Jury Got Confused

#machinelearning #datascience #python #beginners
Comments
12 min read
When Linear Regression Assumptions Are Violated: The Bridge Engineer Who Ignored the Cracks and Declared It Safe
sachin_krrajput profile

When Linear Regression Assumptions Are Violated: The Bridge Engineer Who Ignored the Cracks and Declared It Safe

#machinelearning #datascience #python #beginners
Comments
12 min read
The Assumptions of Linear Regression: The GPS That Only Works on Straight, Flat Roads in Perfect Weather
sachin_krrajput profile

The Assumptions of Linear Regression: The GPS That Only Works on Straight, Flat Roads in Perfect Weather

#machinelearning #datascience #python #beginners
Comments
13 min read
How Linear Regression Works: The Lazy Architect Who Drew One Line and Called It a Floor Plan
sachin_krrajput profile

How Linear Regression Works: The Lazy Architect Who Drew One Line and Called It a Floor Plan

#machinelearning #datascience #python #beginners
1
Comments
11 min read
Is Your Model Good Enough to Deploy? The Restaurant That Served a 95% Perfect Dish — But the 5% Was Food Poisoning
sachin_krrajput profile

Is Your Model Good Enough to Deploy? The Restaurant That Served a 95% Perfect Dish — But the 5% Was Food Poisoning

#machinelearning #datascience #python #beginners
Comments
13 min read
Validation Set vs Test Set: The Student Who Aced Every Practice SAT But Bombed the Real One
sachin_krrajput profile

Validation Set vs Test Set: The Student Who Aced Every Practice SAT But Bombed the Real One

#machinelearning #datascience #python #beginners
Comments
10 min read
K-Fold Cross-Validation: The Comedian Who Tested Jokes at Only One Comedy Club and Bombed Everywhere Else
sachin_krrajput profile

K-Fold Cross-Validation: The Comedian Who Tested Jokes at Only One Comedy Club and Bombed Everywhere Else

#machinelearning #datascience #python #beginners
Comments
13 min read
Stratified Sampling: The Pollster Who Predicted a Landslide by Accidentally Surveying Only One Neighborhood
sachin_krrajput profile

Stratified Sampling: The Pollster Who Predicted a Landslide by Accidentally Surveying Only One Neighborhood

#machinelearning #datascience #python #beginners
Comments
11 min read
Choosing the Right Metric: The Restaurant Inspector Who Judged Every Kitchen by Decor
sachin_krrajput profile

Choosing the Right Metric: The Restaurant Inspector Who Judged Every Kitchen by Decor

#machinelearning #datascience #python #beginners
Comments
9 min read
Type I vs Type II Errors: The Fire Alarm That Cried Wolf vs The Fire Alarm That Slept Through Arson
sachin_krrajput profile

Type I vs Type II Errors: The Fire Alarm That Cried Wolf vs The Fire Alarm That Slept Through Arson

#machinelearning #datascience #python #beginners
Comments
11 min read
MAE vs MSE vs RMSE: Three Bosses With Very Different Philosophies on Punishing Late Employees
sachin_krrajput profile

MAE vs MSE vs RMSE: Three Bosses With Very Different Philosophies on Punishing Late Employees

#machinelearning #datascience #python #beginners
Comments
10 min read
R-Squared Explained: The Dart Player Who's Somehow WORSE Than Just Aiming at the Center
sachin_krrajput profile

R-Squared Explained: The Dart Player Who's Somehow WORSE Than Just Aiming at the Center

#machinelearning #datascience #python #beginners
Comments
11 min read
Log Loss Explained: The Game Show Where Confidence Costs You — Being Wrong Is Bad, Being CONFIDENTLY Wrong Is Catastrophic
sachin_krrajput profile

Log Loss Explained: The Game Show Where Confidence Costs You — Being Wrong Is Bad, Being CONFIDENTLY Wrong Is Catastrophic

#machinelearning #datascience #python #beginners
Comments 1
12 min read
AUC-ROC Explained: The Smoke Detector With a Sensitivity Dial and the One Number That Tells You If It's Any Good
sachin_krrajput profile

AUC-ROC Explained: The Smoke Detector With a Sensitivity Dial and the One Number That Tells You If It's Any Good

#machinelearning #datascience #python #beginners
Comments
11 min read
The Confusion Matrix: A Courtroom Drama Where Every Verdict Falls Into One of Four Boxes
sachin_krrajput profile

The Confusion Matrix: A Courtroom Drama Where Every Verdict Falls Into One of Four Boxes

#machinelearning #datascience #python #beginners
Comments
11 min read
When Accuracy Is a Lying Metric: The Weather Forecaster Who Was 96% Accurate and Still Got Everyone Killed
sachin_krrajput profile

When Accuracy Is a Lying Metric: The Weather Forecaster Who Was 96% Accurate and Still Got Everyone Killed

#machinelearning #datascience #python #beginners
Comments
10 min read
Accuracy, Precision, Recall, F1: The Four Judges Who Disagree on What Makes a Good Wolf Detector
sachin_krrajput profile

Accuracy, Precision, Recall, F1: The Four Judges Who Disagree on What Makes a Good Wolf Detector

#machinelearning #datascience #python #beginners
Comments
10 min read
Train/Validation/Test Split: Why Your Model Needs Practice, Dress Rehearsals, AND Opening Night
sachin_krrajput profile

Train/Validation/Test Split: Why Your Model Needs Practice, Dress Rehearsals, AND Opening Night

#machinelearning #datascience #python #beginners
Comments
10 min read
PCA Explained: Finding the Perfect Angle to Photograph a Sculpture So You Capture Everything in One Shot
sachin_krrajput profile

PCA Explained: Finding the Perfect Angle to Photograph a Sculpture So You Capture Everything in One Shot

#datascience #python #beginners #programming
Comments
10 min read
Feature Selection vs Feature Extraction: Choosing Your Best Songs vs Remixing Them Into Something New
sachin_krrajput profile

Feature Selection vs Feature Extraction: Choosing Your Best Songs vs Remixing Them Into Something New

#datascience #python #beginners #programming
Comments
11 min read
Feature Engineering: The Dark Art of Teaching Your Model to See What You See
sachin_krrajput profile

Feature Engineering: The Dark Art of Teaching Your Model to See What You See

#datascience #python #beginners #programming
Comments
12 min read
loading...