Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Learn how to improve coding assignments with clear documentation, better structure, and professional formatting for higher grades and clarity.

$ CUDA_VISIBLE_DEVICES=0 python train.py --args 1 2 3 ~~~~~ this is a traditional way to run a function on a GPU. but, it's hassle to check the available GPU and set the CUDA_VISIBLE_DEVICES ...