git404hub

what is lensrt fr?

datavorous/lensrt — explained in plain English

Analysis updated 2026-07-17 · repo last pushed 2026-05-18

4PythonAudience · developerComplexity · 4/5MaintainedSetup · hard

tl;dr

A diagnostic tool that shows why ML models run slowly or fail on Qualcomm mobile chips, telling you which parts can offload to the neural accelerator.

vibe map

mindmap
  root((lensrt))
    What it does
      Diagnoses model performance
      Static and runtime modes
      Reports unsupported ops
    Tech stack
      Python
      Qualcomm AI Runtime SDK
      LiteRT
    Use cases
      Optimize for Snapdragon
      Debug delegation failures
      Check quantization issues
    Audience
      Mobile AI engineers
    Setup
      Build from source
      Qualcomm account needed

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Check which layers of a model will run on the neural accelerator versus the CPU.

VIBE 2

Find unsupported operations blocking a model from running efficiently on Snapdragon.

VIBE 3

Diagnose quantization mismatches or data type incompatibilities before deployment.

VIBE 4

Run a quick static check on a model file before attempting full compilation.

what's the stack?

Python

how it stacks up fr

datavorous/lensrtadeliox/klein-head-swapats4321/ragit
Stars444
LanguagePythonPythonPython
Last pushed2026-05-18
MaintenanceMaintained
Setup difficultyhardmoderatemoderate
Complexity4/53/52/5
Audiencedeveloperdesignerdeveloper

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · hard time til it works · 1h+

Runtime mode needs building LiteRT from source and a Qualcomm AI Runtime SDK account.

in plain english

LensRT is a diagnostic tool that helps you understand why machine learning models run slowly or fail to run efficiently on Qualcomm mobile processors. When you want to use a model on a Snapdragon phone or chip, the system tries to offload computation to specialized hardware (like a neural processor) to make it faster. This tool tells you exactly which parts of your model can be offloaded, which parts can't, and why. The tool works in two modes. The static mode analyzes your model file without running anything, it just reads the code and checks for common problems like unsupported operations or incompatible tensor shapes. The runtime mode goes deeper: it actually tries to compile your model using Qualcomm's tools and reports back what succeeded, what failed, and which original operations got grouped together into optimized blocks. Think of static mode as a checklist before you try something, and runtime mode as the real test drive. You'd use this if you're deploying AI models to Qualcomm-powered Android phones or embedded devices and want to squeeze out maximum performance. A concrete example: you built a language model and want it to run on Galaxy phones powered by Snapdragon processors. LensRT tells you which layers will run on the neural accelerator versus the CPU, which operations Qualcomm's SDK doesn't support yet, and sometimes even hints at whether it's a known issue or something in how the model was exported. The README includes a table of common problems like quantization mismatches or data type incompatibilities that block delegation. The tradeoff here is setup complexity. Running the full runtime diagnostics requires building Google's LiteRT framework from source (15, 30 minutes) and downloading Qualcomm's AI Runtime SDK, which needs a Qualcomm account. If you only need the quick static analysis, installation is simple. The tool is relatively new and niche, it's aimed at engineers specifically optimizing for Qualcomm hardware, not general deep learning work.

prompts (copy fr)

prompt 1
Help me run LensRT's static analysis mode on my model to check for unsupported operations.
prompt 2
Explain the quantization mismatch error LensRT reported for my model.
prompt 3
Walk me through building Google's LiteRT framework from source to use LensRT's runtime mode.
prompt 4
What does it mean if LensRT says an operation can't be offloaded to the neural accelerator?

Frequently asked questions

what is lensrt fr?

A diagnostic tool that shows why ML models run slowly or fail on Qualcomm mobile chips, telling you which parts can offload to the neural accelerator.

What language is lensrt written in?

Mainly Python. The stack also includes Python.

Is lensrt actively maintained?

Maintained — commit in last 6 months (last push 2026-05-18).

How hard is lensrt to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is lensrt for?

Mainly developer.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.