Highlights
- Pro
Stars
An extremely fast Python package and project manager, written in Rust.
FlashInfer: Kernel Library for LLM Serving
AI benchmark runtime framework that allows you to integrate and evaluate AI tasks using Docker-based benchmarks.
Democratizing Reinforcement Learning for LLMs
Open Source framework for voice and multimodal conversational AI
Build real-time multimodal AI applications 🤖🎙️📹
A react-based starter app for using the Multimodal Live API over websockets with Gemini
Pydantic model and dataclasses.dataclass generator for easy conversion of JSON, OpenAPI, JSON Schema, and YAML data sources.
LLM based autonomous agent that conducts deep local and web research on any topic and generates a long report with citations.
Fully open reproduction of DeepSeek-R1
Make websites accessible for AI agents
Scale from single vLLM instance to distributed vLLM deployment without changing any application code.
The Multi-Faceted Optimizer for GenAI Workflows
My learning notes/codes for ML SYS.
An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & RingAttention & RFT)
Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, sparsely activated memory layers complement compute-heavy dense f…
Simple, unified interface to multiple Generative AI providers
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, Du…
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Cosmos is a world model development platform that consists of world foundation models, tokenizers and video processing pipeline to accelerate the development of Physical AI at Robotics & AV labs. C…
This repository provides an advanced Retrieval-Augmented Generation (RAG) solution for complex question answering. It uses sophisticated graph based algorithm to handle the tasks.
Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasoning elevation🍓 and hallucination alleviation🍄.