Using Large Language Model Sandboxes to Evaluate Generative AI for Unstructured Text

OpenWebUI is an open source Large Language Model (LLM) chatbot sandbox for exploring generative AI models and prompts. By providing a common interface to both proprietary and open source models, OpenWebUI makes it easy to compare and optimize both locally-hosted and cloud vendor AI tools. Mark McCahill's presentation will cover differences in LLM models, using OpenWeb UI to evaluate RAG (Retrieval Augmented Generation) LLM on your documents, and an architecture for providing scalable LLM services while avoiding vendor lock-in.