Skip to content

DEV Community

Edge AI from the Trenches Series' Articles

Back to Jaydeep Shah (JD)'s Series

Cover image for What I Learned by Dissecting gemma-4-E2B-it_qualcomm_sm8750.litertlm

Gemma 4 Challenge: Write about Gemma 4 Submission

Jaydeep Shah (JD)

May 17

What I Learned by Dissecting gemma-4-E2B-it_qualcomm_sm8750.litertlm

#litertlm #gemmachallenge #edgeai #android

8 min read

Cover image for What I Learned Turning a HuggingFace Model Into Something My Phone Can Run

Gemma 4 Challenge: Write about Gemma 4 Submission

Jaydeep Shah (JD)

May 17

What I Learned Turning a HuggingFace Model Into Something My Phone Can Run

#gemmachallenge #edgeai #android #litertlm

9 min read

Cover image for What I Learned Untangling LiteRT, LiteRT-LM, and TFLite

Gemma 4 Challenge: Write about Gemma 4 Submission

Jaydeep Shah (JD)

May 17

What I Learned Untangling LiteRT, LiteRT-LM, and TFLite

#gemmachallenge #edgeai #android #litertlm

4 min read

Cover image for FP32, INT4, and Everything Between - What I Learned About Precision on Mobile

Jaydeep Shah (JD)

May 18

FP32, INT4, and Everything Between - What I Learned About Precision on Mobile

#deeplearning #machinelearning #mobile #performance

7 min read

Cover image for Why My LLM Runs 4x Faster on Hardware I Had Never Heard Of

Jaydeep Shah (JD)

May 18

Why My LLM Runs 4x Faster on Hardware I Had Never Heard Of

#edgeai #android #litertlm

7 min read

Cover image for I opened a .litertlm file. Here is what is actually in there

Jaydeep Shah (JD)

Jun 16

I opened a .litertlm file. Here is what is actually in there

#edgeai #android #litertlm

5 min read

Cover image for The Invisible Layer Between My Prompt and the Model

Jaydeep Shah (JD)

Jun 16

The Invisible Layer Between My Prompt and the Model

#edgeai #android #litertlm

4 min read

Cover image for What I Learned About "On-Device AI": Most of It Is a Promise, Not a Guarantee

Jaydeep Shah (JD)

Jun 16

What I Learned About "On-Device AI": Most of It Is a Promise, Not a Guarantee

#edgeai #android #privacy

5 min read

Cover image for One Model, Three Chips, Two Files: How LiteRT Delegates Really Work

Jaydeep Shah (JD)

Jul 4

One Model, Three Chips, Two Files: How LiteRT Delegates Really Work

#edgeai #android #litert

10 min read

Cover image for What On-Device AI Benchmarks Actually Feel Like

Jaydeep Shah (JD)

Jul 4

What On-Device AI Benchmarks Actually Feel Like

#edgeai #android #litertlm

8 min read

Cover image for Prompt Engineering Beat My Fine-Tuned Model. Here Is Why.

Jaydeep Shah (JD)

Jul 5

Prompt Engineering Beat My Fine-Tuned Model. Here Is Why.

#edgeai #android #litertlm

8 min read

Cover image for What I Learned Getting an NPU to Actually Initialize: Six Silent Failures

Jaydeep Shah (JD)

Jul 5

What I Learned Getting an NPU to Actually Initialize: Six Silent Failures

#edgeai #android #litertlm #npu

13 min read

Cover image for One Prompt Was Not Enough: Building a 4-Step On-Device Redaction Pipeline

Jaydeep Shah (JD)

Jul 5

One Prompt Was Not Enough: Building a 4-Step On-Device Redaction Pipeline

#edgeai #android #litertlm #privacy

14 min read

Cover image for What I Learned Trying to Benchmark On-Device AI Honestly

Jaydeep Shah (JD)

Jul 5

What I Learned Trying to Benchmark On-Device AI Honestly

#edgeai #android #litertlm #benchmarking

18 min read

Cover image for Prompt Engineering on a Small On-Device Model Is a Different Sport

Jaydeep Shah (JD)

Jul 5

Prompt Engineering on a Small On-Device Model Is a Different Sport

#edgeai #android #litertlm #promptengineering

11 min read

Cover image for My Fine-Tuned Gemma 4 Loaded Fine, Then Broke on the First Message

Jaydeep Shah (JD)

Jul 6

My Fine-Tuned Gemma 4 Loaded Fine, Then Broke on the First Message

#edgeai #android #litertlm #finetuning

10 min read

Cover image for What I Learned Benchmarking the Same LLM on My Phone's NPU, GPU, and CPU

Jaydeep Shah (JD)

Jul 6

What I Learned Benchmarking the Same LLM on My Phone's NPU, GPU, and CPU

#edgeai #android #litertlm #npu

9 min read

Cover image for How I Benchmarked an LLM Running Entirely on a Phone (No Cloud, No API)

Jaydeep Shah (JD)

Jul 6

How I Benchmarked an LLM Running Entirely on a Phone (No Cloud, No API)

#edgeai #android #litertlm #benchmarking

16 min read

Cover image for The Deployment Boundary: Why On-Device AI Breaks After Colab

Jaydeep Shah (JD)

Jul 12

The Deployment Boundary: Why On-Device AI Breaks After Colab

#edgeai #android #litertlm #privacy

13 min read

Cover image for Edge AI Skills: From Metal to Model

Jaydeep Shah (JD)

Jul 12

Edge AI Skills: From Metal to Model

#edgeai #android #litertlm #silicon

11 min read

Cover image for "What Happens When 15 Apps Each Ship a 3 GB Model?"

Jaydeep Shah (JD)

Jul 13

"What Happens When 15 Apps Each Ship a 3 GB Model?"

#edgeai #android #litertlm #npu

14 min read

Cover image for What I Learned Trying to Ship a Fine-Tuned Model to the NPU

Jaydeep Shah (JD)

Oct 7

What I Learned Trying to Ship a Fine-Tuned Model to the NPU

#edgeai #android #litertlm #finetuning

10 min read

Cover image for Why Benchmarking On-Device AI Turned Into Its Own Engineering Project

Jaydeep Shah (JD)

Oct 12

Why Benchmarking On-Device AI Turned Into Its Own Engineering Project

#edgeai #android #litertlm #benchmarking

12 min read