November 18, 2024: Simplifying Generative AI Evaluation with AutoEval - LastMile AI Inc. has introduced AutoEval, a pioneering platform for creating customized evaluator models to optimize generative AI applications. Designed to tackle the last mile problem of AI evaluation, AutoEval allows enterprises to generate synthetic data labels, enhancing training datasets and reducing expert intervention. With alBERTa, a small language model, AutoEval assesses key metrics like relevance and toxicity, offering real-time evaluation. This enables an Eval-Driven Development approach, facilitating improvements in AI models. Lightweight and CPU-compatible, AutoEval will soon be available on major cloud marketplaces, aiding safer and more efficient AI deployments.
