Moxin is an open source tool that makes it easy for users to explore and experiment with open source LLMs on their own computers. It is assembled from a collection of loosely coupled building blocks of Rust and Wasm components. * A Rust-native chatbot UI * A cross-platform LLM inference engine based on LlamaEdge. * A Rust native UI for managing, filtering, and displaying open source LLM models. * A database and web service for a catalog of open source LLMs. The database provides an admin dashboard for the community to update those models. * An in-process Rust messaging channel for the frontend widgets to communicate with the LlamaEdge model service and the model meta data service. In this talk, we will showcase the Moxin app, discuss its architecture, and demonstrate how it serves as a template and component library for Rust developers to create their own cross-platform LLM applications. We will also discuss the roadmap for this project, including timelines for the model database and plans for advanced features such as multimodal models and RAG apps. Attendees will learn how to build rich UI applications and LLM services using Rust and Wasm, and discover how Moxin is revolutionizing the way users interact with LLMs on their personal computers. #rust #gosim #ai
- Күн бұрын
GOSIM 2024 Europe AI & Agents Jorge Bejar: Moxin - A pure Rust Explorer for Open Source LLMs
- Рет қаралды 172
Пікірлер