Project Overview
Objective
Built room-scoped semantic search and RAG question answering over multilingual chat history, images, and OCR-extracted content.
Stack
FastAPINext.jsPostgreSQLQdrantSentenceTransformerCLIPBLIPGoogleTranslatorTyphoon OCROpenAI
Delivery highlights
- Developed a proof-of-concept chat application where users create or join rooms, send text and image messages, search conversation history, and ask natural-language questions grounded in retrieved messages. Stored structured room and message data in PostgreSQL and indexed multilingual text, CLIP image embeddings, BLIP captions, and Typhoon OCR output in Qdrant. Combined semantic and keyword retrieval with an OpenAI LLM to answer questions within one room, across rooms, or about shared images through a FastAPI backend and Next.js chat interface.