Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Comprehensive Python API for Google NotebookLM. Full programmatic access to NotebookLM's features—including capabilities the web UI doesn't expose—from Python or the command line. 📚 Research ...

Abstract: Bayesian inference provides a methodology for parameter estimation and uncertainty quantification in machine learning and deep learning methods. Variational inference and Markov Chain ...

Python JSON Logger enables you produce JSON logs when using Python's logging package. JSON logs are machine readable allowing for much easier parsing and ingestion into log aggregation tools.