
Marc Klingen
Marc Klingen is co-founder and CEO of Langfuse, an open-source platform for observing, evaluating, and improving AI and LLM applications. His work focuses on AI engineering infrastructure and agent workflows.
Agent Improvement Depends on Linking Production Traces to Offline Evals
Marc Klingen, Langfuse’s co-founder, argues that improving agents is becoming less a matter of rewriting prompts and more a matter of building a feedback loop around them. AI can increasingly inspect production traces, propose fixes, and test them against datasets and evaluations, reducing work that teams once did manually. But Klingen says people still need to set the goals and judge what counts as a meaningful improvement; in a Langfuse changelog-writer demo, an agent identified internal jargon and tested a revision before it was submitted for review.
Coding Agent Skills Need Live Documentation, Not Cached Product Knowledge
Marc Klingen of Langfuse argues that coding agents can add observability, but often do it first from stale model memory, producing broken or incomplete instrumentation before recovering through current documentation. In a talk on building a Langfuse skill for Claude Code, he says the fix is not to stuff more product knowledge into the agent, but to give it reliable ways to find live docs, expose its intermediate work in traces, and evaluate changes against realistic repositories. The same work, he warns, creates new risks when optimization loops reward shorter paths and remove the documentation-fetching and approval steps that make the skill reliable.