Disclaimer: with subjective preference

• BentoML: Build model inference APIs and multi-model serving systems with any open-source or custom AI models.
• BoltDB: Bolt is a pure Go key/value store inspired by Howard Chu's LMDB project. The goal of the project is to provide a simple, fast, and reliable database for projects that don't require a full database server such as Postgres or MySQL.
• Tauri - Rust: Build an optimized, secure, and frontend-independent application for multi-platform deployment.
• transformer-explainer: Transformer Explainer is an interactive visualization tool designed to help anyone learn how Transformer-based models like GPT work. It runs a live GPT-2 model right in your browser, allowing you to experiment with your own text and observe in real time how internal components and operations of the Transformer work together to predict the next tokens.
• crew AI: https://github.com/crewAIInc/crewAI Cutting-edge framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.
• serper dev: https://serper.dev/ . The World's Fastest & CheapestGoogle Search API. Experience unparalleled speed with our industry-leading SERP API, delivering lightning-fast Google search results in 1-2 seconds, at an unbeatable price.
• https://github.com/mlc-ai/mlc-llm：MLC LLM is a machine learning compiler and high-performance deployment engine for large language models. The mission of this project is to enable everyone to develop, optimize, and deploy AI models natively on everyone's platforms.
• exo: Forget expensive NVIDIA GPUs, unify your existing devices into one powerful GPU: iPhone, iPad, Android, Mac, Linux, pretty much any device! https://github.com/exo-explore/exo