Python toolkit for Chinese LLMs, with flexible batch capacity, structured real-time visulization and automated accumulation for streaming, and explicit feedback on vendor-native parameter validation.

Learn GenAI and Agentic AI from Zero to Production

Advanced RAG pipelines for medical (HealthBench, MedCaseReasoning, MetaMedQA, PubMedQA) and financial (FinanceBench, Earnings Calls) QA. LangGraph orchestration + BAML structructed generation, Milvus Hybrid search (Dense + BM25 + RRF), three-layer Metadata Enrichment, Contextual AI instruction-following reranker, and DeepEval evaluation.

Advanced RAG pipeline optimization framework using DSPy. Implements modular RAG pipelines with Query-Rewriting, Sub-Query Decomposition, and Hybrid Search via Weaviate. Automates prompt tuning and few-shot selection using GEPA, SIMBA, MIPRO, COPRO, and BootstrapFewShot optimizers on datasets like FreshQA, HotpotQA, TriviaQA, Wikipedia and PubMedQA.

Self-Reflective Question Answering for Biomedical Reasoning. GRPO fine-tuning via QLoRA & Unsloth with rewards for correctness, relevance, groundness, utility & XML structure. Structured think → answer → self-reflection with context grading, relevance assessment & groundness evaluation. DeepEval LLM-as-a-Judge (GEval, Faithfulness, Relevancy).

🚀 Production-ready modular RAG monorepo: Local LLM inference (vLLM) • Hybrid retrieval with Qdrant • Semantic caching • Docling document parsing • Cross-encoder reranking • DeepEval evaluation • Full observability with Langfuse • Open WebUI chat interface • OpenAI-compatible API • Fully Dockerized

Multi-agent LangGraph app turning raw requirements into backlog-ready user stories, ACs, and test cases. Live Gemini-Flash CI eval gate + nightly N=10 adversarial regression.

BNS-LexAI is an AI-powered legal information and case understanding assistant.

A hands-on exploration of Deepeval — an open-source framework for evaluating and red-teaming large language models (LLMs). This repository documents my journey of testing, benchmarking, and improving LLM reliability using custom prompts, metrics, and pipelines.

Step-by-step guide to building a local RAG system from scratch. Learn hybrid search, reranking, HyDE, and evaluation... 100% free, no cloud required.

A hybrid RAG system that answers complex questions about the UI GreenMetric Sustainable University Rankings by combining unstructured narrative guidelines with structured tabular data.

AI research assistant for prosthetics, orthotics & rehabilitation robotics papers. RAG pipeline with streaming citations, structured summaries, terminology extraction, and paper comparison. Built with Next.js 15, Claude, pgvector. Includes observability tracing and DeepEval evaluation pipeline.

Production RAG system in Python: Haystack pipelines, FastAPI SSE streaming, Qdrant hybrid retrieval, OpenAI embeddings, DeepEval golden-set evaluation, and Langfuse tracing. Includes latency benchmarks (P50/P95 TTFT), retrieval failure-mode analysis, and chunking-strategy decision logs.

pytest lab for testing LLMs: RAG eval, red teaming, guardrails, drift monitoring — 14 modules, 382 tests, zero API calls needed

Multi-agent enterprise market intelligence platform using LangGraph, OpenAI, Tavily, Qdrant, FastEmbed, and DeepEval.

Drop in deal documents → get an onboarding plan, draft invoice, and stakeholder summary. Multi-agent LangGraph pipeline with RAG, human approval, and self-correcting retries.

Production-grade LLM evaluation pipeline for RAG chatbot — DeepEval + RAGAS + Garak + CI/CD | Financial domain | 7 metrics | Adversarial testing

Automated RAG pipeline evaluation framework that scores faithfulness, hallucination rate, and retrieval quality with GitHub Actions CI/CD and React dashboard

[UNDER DEVELOPMENT] Clinical-RAG is a production-grade, citation-backed AI system designed to bridge the "Trust Gap" in medical information retrieval.