Projects | Manish Tiwari — AI Systems, MLOps & Open Source

ME

mesh

Capacity planner for heterogeneous GPU fleets — computes the real training ceiling per node instead of summing pooled VRAM. On 100 consumer GPUs, only 8 can hold a 7B model.

PythonPyTorchDiLoCo

GitHub PyPI

SR

SafeRun AI

Secure sandbox that executes untrusted AI-generated Python in isolated Docker containers — AST scanner + YAML policy engine, four risk levels, and a full audit log. Published as saferun-ai on PyPI.

PythonFastAPIDocker

GitHub Live PyPI

LS

Little Sparks

Slack-integrated product-design platform used by 100+ designers and managers across 200+ projects at Smartivity Labs — OAuth, per-project channels, reminders and analytics.

JavaScriptSlack APIFull-stack

GitHub Live

JD

JanDrishti

Government transparency platform covering every Central department and all 28 states + 8 UTs — budgets, expenditure vs budget, CAG findings, live PIB feed, behind 15 FastAPI endpoints.

PythonFastAPIAPScheduler

GitHub

LM

LocalMind

CLI that scans your hardware, estimates what actually fits, and recommends local LLMs worth running — VRAM-aware comparison with Ollama chat built in.

PythonCLIOllama

GitHub PyPI

LY

Laya on a GTX 1650

Honest benchmark of a 421M-parameter LLM on 4GB consumer hardware — CUDA-synchronised timing, p50/p95, and measured numbers kept separate from published ones.

PyTorchCUDABenchmarking

GitHub Blog

TL

Trimurti-LM

4.2M-parameter multilingual (EN/HI/PA) GPT trained from scratch in PyTorch — perplexity 3.32 in 2.38 hours on a GTX 1650 4 GB, with a custom SentencePiece tokenizer.

PyTorchTransformersHuggingFace

GitHub Demo

MD

ML Drift Monitor

End-to-end MLOps prototype — FastAPI async logging pipeline, KS-based concept-drift detection, Plotly dashboard and Discord alerts, under 500 ms inference.

FastAPIDockerCI/CD

GitHub Demo

BB

Bharat Benefits

Voice-first agent for Indian government welfare scheme discovery — STT → Retrieval → LLM → TTS — merged into Moss, with eligibility matching and vernacular support.

PythonFastAPILLMRAG

GitHub

EC

Energix Copilot

Energy optimization platform using predictive analytics and real-time monitoring to reduce industrial power consumption. Won the Industrial Automation hackathon category.

PythonStreamlitProphet

GitHub

SS

Swasthya Saathi

Health assistant for rural areas — symptom checker, medicine reminders and a nearby clinic locator with offline-first support.

FlaskSQLite

GitHub

Things I’ve built

Selected projects

More projects & experiments