rohitmujumdar/locallysells-voice-search — explained in plain English
Analysis updated 2026-05-18
Let customers call in and describe a product vaguely, then get matched to the closest real item in the catalog.
Place a phone order for tobacco or nicotine products and hear the order number and delivery estimate read back.
Study a working example of combining a voice platform, an LLM brain, and a serverless search backend.
| rohitmujumdar/locallysells-voice-search | 0xallam/my-recipe | 0xhassaan/nn-from-scratch | |
|---|---|---|---|
| Stars | 0 | — | 0 |
| Language | Python | Python | Python |
| Last pushed | — | 2022-11-22 | — |
| Maintenance | — | Dormant | — |
| Setup difficulty | hard | moderate | moderate |
| Complexity | 4/5 | 2/5 | 4/5 |
| Audience | developer | general | developer |
Figures from each repo's GitHub metadata at analysis time.
Needs separate accounts and API keys for Vapi, Nebius, and Insforge before a call can be tested.
This project is a voice search and voice ordering assistant built for LocallySells, an online marketplace that delivers tobacco and nicotine products locally. It was created during a hackathon called the Multimodal Midsummer Hackathon, and it lets a caller phone in, describe what they want in plain conversational language, and have the system find matching products and place an order. The core idea is understanding meaning rather than exact keywords. If someone says they want something minty and refreshing, the system can match that description to a specific product like a mint flavored vape, even if the caller never says the brand name. It does this using semantic search: each product in a 198 item catalog has been converted into a numerical representation ahead of time, and when a caller speaks, their words are converted the same way so the system can compare and rank the closest matches. A keyword check is layered on top so that when someone names an exact brand, that brand still comes out on top. Three separate services work together to make a phone call happen: one handles the live voice conversation, turning speech into text and back into speech, a second acts as the reasoning brain that decides whether the caller wants to search for a product or place an order, and a third hosts the actual search and ordering logic as a small serverless function, along with the product catalog and its embeddings. The system includes safety rules: it will not serve anyone who indicates they are under 21, it will not invent products or prices that are not in the catalog, and it avoids giving medical advice. The project also includes automated test suites that simulate callers with different speaking styles, checking that the assistant handles vague requests, misremembered product names, and multi step orders correctly, rather than relying on manual spot checks. The repository includes Python scripts for building and deploying the function, precomputing embeddings, and setting up the voice assistant, along with documentation describing how a call flows through the system. There is no license mentioned in the README.
A voice agent that lets callers order tobacco and nicotine products from LocallySells by describing what they want in natural, everyday language.
Mainly Python. The stack also includes Python, Vapi, Nebius.
Setup difficulty is rated hard, with roughly 1h+ to a first successful run.
Mainly developer.
This repo across BitVibe Labs
double-check against the repo, no cap.