LangFuse
langfuse.com
An open-source LLM engineering platform for tracing, evaluating, and monitoring AI applications in production, with prompt versioning, A/B testing, and user feedback collection.
Why it is useful
Fills the observability gap that appears when you move LLM apps to production — you can see exactly what prompts ran, what the model returned, how long it took, and how users rated it. Prompt versioning means you can roll back bad changes without digging through git history. The open-source self-hosted version has most features of the cloud tier, making it practical for teams with data residency concerns.
More in Developer Utilities
Other developer utilities you might not have heard of.
- HoppscotchOpen-source API development ecosystem that runs entirely in your browser.
- RAGFlowAn open-source RAG engine with deep document understanding — extracts structured content from PDFs, presentations, spreadsheets, and images using OCR and layout analysis before chunking.
- Webhook.siteInstantly generate a unique URL to inspect, test, and debug webhooks and HTTP requests.
- RailwayDeploy a database, backend, or full app straight from a GitHub repo with almost no configuration — Postgres, Redis, Node, Python, and more.
- UnslothA fine-tuning library that makes QLoRA and LoRA training 2x faster and use 50% less memory than standard implementations, enabling fine-tuning of large models on consumer GPUs.
- readme.soA drag-and-drop editor for building a GitHub README, with ready-made sections you can reorder, edit and export as Markdown.