New Show Hacker News story: Show HN: Open-source, lightweight tracer for debugging LLMs applications
Show HN: Open-source, lightweight tracer for debugging LLMs applications
2 by sudowoodo200 | 0 comments on Hacker News.
This allows you to set up logging traces with minimal effort on any python codebase and store it into a mongo db database or a local directory. I'm leveraging it mostly for developing on language models, and use the data for a downstream evaluation and debugging. Since I'm didn't want to rely on any of the opinionated frameworks (Langchain with Langsmith, etc), I thought a simpler plug-and-play solution would suffice. I have a lot of features in mind for the roadmap -- let me know if you'd like to add to it and feel free to drop in any suggestions. There is also a quick Streamlit app added to stare at the results; I'm not a Streamlit pro and preemptively apologize for any UI issues.
2 by sudowoodo200 | 0 comments on Hacker News.
This allows you to set up logging traces with minimal effort on any python codebase and store it into a mongo db database or a local directory. I'm leveraging it mostly for developing on language models, and use the data for a downstream evaluation and debugging. Since I'm didn't want to rely on any of the opinionated frameworks (Langchain with Langsmith, etc), I thought a simpler plug-and-play solution would suffice. I have a lot of features in mind for the roadmap -- let me know if you'd like to add to it and feel free to drop in any suggestions. There is also a quick Streamlit app added to stare at the results; I'm not a Streamlit pro and preemptively apologize for any UI issues.
Comments
Post a Comment