pankajsanger/amazon-rag-assistant — explained in plain English
Analysis updated 2026-05-18
Scrape a set of Amazon product pages and store their details locally.
Ask natural-language questions about collected customer reviews, like which products score lowest.
Learn how a retrieval augmented generation pipeline is built end to end.
Rebuild a searchable index after scraping new products without restarting the app.
| pankajsanger/amazon-rag-assistant | 0xallam/my-recipe | 0xhassaan/nn-from-scratch | |
|---|---|---|---|
| Stars | 0 | — | 0 |
| Language | Python | Python | Python |
| Last pushed | — | 2022-11-22 | — |
| Maintenance | — | Dormant | — |
| Setup difficulty | moderate | moderate | moderate |
| Complexity | 3/5 | 2/5 | 4/5 |
| Audience | developer | general | developer |
Figures from each repo's GitHub metadata at analysis time.
Requires an OpenAI API key and a manually saved Amazon login cookie file to scrape.
This project is a tool that scrapes product listings and customer reviews from Amazon, stores them in a local database, and then lets you ask plain English questions about what it collected. It answers those questions using a technique called retrieval augmented generation, where the system searches through the stored data for the most relevant pieces before asking a language model to write an answer grounded in that information, all wrapped in a simple web interface built with Streamlit. You can feed it a single product page link, upload a spreadsheet with a list of links, or run a live keyword search on Amazon. It collects two kinds of information side by side, product details like title, price, and rating, and customer reviews with their author, star rating, date, and text. Everything is saved into a local SQLite database, so scraping the same product again updates the existing entry instead of creating a duplicate. Products and reviews are each turned into their own searchable index using a vector database called Chroma, and a self query retriever lets the language model translate a question like reviews rated below three stars into the right filters automatically, rather than requiring you to write any filtering logic yourself. A rebuild index button in the app re-embeds new data at any time without needing to restart the whole program. To log into Amazon without dealing with captchas or two factor prompts, the project reuses a saved browser session stored as cookies rather than automating a real login each time. Under the hood it relies on Selenium and BeautifulSoup for browser automation, OpenAI for both the embeddings and the answering language model, and LangChain to tie the retrieval and generation steps together. The author describes this as a personal, educational project for learning how a full retrieval augmented generation system fits together end to end, and notes that anyone using it should respect Amazon's terms of service and robots.txt rules before scraping at any scale. It requires Python, Google Chrome, and an OpenAI API key to run.
A Streamlit app that scrapes Amazon products and reviews, then answers plain English questions about them using RAG.
Mainly Python. The stack also includes Python, Selenium, BeautifulSoup.
No license file is mentioned in the README, so usage rights are unclear.
Setup difficulty is rated moderate, with roughly 1h+ to a first successful run.
Mainly developer.
This repo across BitVibe Labs
double-check against the repo, no cap.