Projects Recently Starred by Experts

Starred 3 hours ago by

Wing Lian(Founder of Axolotl AI). Also starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"),

Woosuk Kwon(Coauthor of vLLM), and

4 more.

punica by punica-ai

0.3%

LoRA serving system (research paper) for multi-tenant LLM inference

Serves multiple LoRA-finetuned models with the overhead of running one.
Achieves batching via custom CUDA kernel (Segmented Gather Matrix-Vector multiplication).
Claims 12x throughput vs. HuggingFace Transformers, DeepSpeed, FasterTransformer, vLLM.

Created 2 years ago

Updated 1 year ago

Starred 12 hours ago by

Ying Sheng(Coauthor of SGLang).

TileRT by tile-ai

30.4%

277

Ultra-low-latency LLM inference runtime

Delivers extreme responsiveness for interactive AI, agents, and real-time applications.
Utilizes a tile-level compiler engine for fine-grained task scheduling and overlap.
Achieves millisecond-level TPOT for large models on multi-GPU systems.
Maximizes hardware utilization by overlapping compute, I/O, and communication.

Created 4 weeks ago

Updated 3 days ago

Starred 19 hours ago by

Alex Johansson(Author of tRPC).

sandbox-sdk by cloudflare

14.1%

558

I am sorry, but I cannot access the content of the README file without a direct URL. Please provide the URL for the README file you would like me to summarize

Created 5 months ago

Updated 11 hours ago

Starred 21 hours ago by

Theo Browne(Founder of Ping.gg). Also starred by

Hiroshi Shibata(Core Contributor to Ruby),

Bryan Helmig(Cofounder of Zapier),

Luis Capelo(Cofounder of Lightning AI), and

23 more.

goose by block

3.7%

23k

Open-source AI agent for automating complex engineering tasks

Automates project builds, code writing/execution, debugging, and workflow orchestration.
Integrates with any LLM and MCP servers for flexibility.
Available as a desktop app and CLI tool.

Created 1 year ago

Updated 12 hours ago

Starred 1 day ago by

Yaowei Zheng(Author of LLaMA-Factory). Also starred by

Woosuk Kwon(Coauthor of vLLM).

vllm-omni by vllm-project

31.3%

803

Omni-modality model inference and serving framework

Efficiently serves text, image, video, and audio models with high throughput.
Extends vLLM to support non-autoregressive architectures like Diffusion Transformers.
Leverages KV cache, pipelined execution, and parallelism for optimized performance.
Offers an OpenAI-compatible API server for seamless integration and multimodal outputs.

Created 3 months ago

Updated 17 hours ago

Starred 1 day ago by

Omar Sanseviero(DevRel at Google DeepMind). Also starred by

Addy Osmani(Head of Chrome Developer Experience at Google).

agent-starter-pack by GoogleCloudPlatform

8.0%

GenAI agent templates for Google Cloud, addressing deployment, evaluation, customization, and observability

Pre-built ReAct, RAG, multi-agent, and live multimodal API agent templates.
Supports Vertex AI evaluation, interactive playground, and Agent Engine deployment.
Includes CI/CD automation and data pipeline for RAG with Terraform/CI-CD.
Implements agents using Google's ADK, LangGraph, and CrewAI frameworks.

Created 10 months ago

Updated 22 hours ago

Starred 1 day ago by

Yaowei Zheng(Author of LLaMA-Factory). Also starred by

Elvis Saravia(Founder of DAIR.AI).

Mini-Agent by MiniMax-AI

15.4%

863

Minimalist agent framework for complex task execution

Full agent execution loop with file system and shell tools for robust task handling.
Leverages MiniMax M2 and Anthropic-compatible API with interleaved thinking for advanced reasoning.
Intelligent context management summarizes history, enabling infinitely long tasks with persistent memory.
Integrates 15 professional Claude Skills and MCP tools for web search and knowledge graphs.

Created 1 month ago

Updated 16 hours ago

Starred 1 day ago by

Gabriel Almeida(Cofounder of Langflow). Also starred by

Jordan Burgess(Cofounder of Humanloop),

Travis Fischer(Founder of Agentic),

Tobi Lutke(Cofounder of Shopify), and

2 more.

vibe-kanban by BloopAI

4.6%

Kanban board for AI coding agents

Orchestrate multiple AI coding agents in parallel or sequence for efficient task management.
Streamlines planning, reviewing, and execution of AI-generated code.
Supports switching between and centralizing configurations for agents like Claude, Gemini, and Codex.
Enables quick review of agent work and tracking of task statuses.

Created 6 months ago

Updated 1 day ago

Starred 1 day ago by

Gabriel Almeida(Cofounder of Langflow). Also starred by

Dan Guido(Cofounder of Trail of Bits).

agents by wshobson

2.5%

22k

Collection of specialized AI subagents for Claude Code

56 domain-specific agents for development, operations, data, and business tasks.
Supports automatic or explicit invocation, with model selection (Haiku, Sonnet, Opus).
Orchestrates agents sequentially, in parallel, or conditionally for complex workflows.
Integrates with Claude Code commands for advanced multi-agent task execution.

Created 4 months ago

Updated 22 hours ago

Starred 1 day ago by