llama.cpp logo

llama.cpp

Inference / Orchestration·infrastructure·open·#12 of 886·+2·Rising

90.6

Excellent

High confidence

Project Details

License
MIT
Topics
llminferencecppggmlquantizationllama
Install
brew install llama.cpp

C/C++ inference engine for LLaMA-family language models. Supports CPU, GPU, and Apple Silicon; provides quantization that lets large models run on consumer hardware.

C/C++ LLM inference engine with broad quantization support

Repo Score Comparison

Strong in Both

Tool Score

90.6

Rank #11

Repo Score

90.9

Repo Rank #4

Score Gap-0.3

Both the tool and its underlying repo score 75+ - a well-rounded, healthy project.

Pillar Breakdown

Adoption

35%

96.5

Maintenance

30%

95.7

Friction

20%

99.2

Ecosystem

15%

79.2

Momentum

0.53Rising
7d change +0.21
High confidence

In Inference / Orchestration

Ranked #2 of 77

Similar Tools