Skip to content
@ggml-org

ggml

AI inference at the edge
README.md 
graph TD;
ggml --> whisper.cpp
ggml --> llama.cpp
llama.cpp --> llama.vim
llama.cpp --> llama.vscode

ggml[<a href="https://github.com/ggml-org/ggml"                 style="text-decoration:none;">ggml</a>          <br><span style="font-size:10px;">Machine learning library</span>];
whisper.cpp[<a href="https://github.com/ggml-org/whisper.cpp"   style="text-decoration:none;">whisper.cpp</a>   <br><span style="font-size:10px;">speech-to-text</span>];
llama.cpp[<a href="https://github.com/ggml-org/llama.cpp"       style="text-decoration:none;">llama.cpp</a>     <br><span style="font-size:10px;">LLM inference</span>];
llama.vim[<a href="https://github.com/ggml-org/llama.vim"       style="text-decoration:none;">llama.vim</a>     <br><span style="font-size:10px;">Vim/Neovim plugin</span>];
llama.vscode[<a href="https://github.com/ggml-org/llama.vscode" style="text-decoration:none;">llama.vscode</a>  <br><span style="font-size:10px;">VSCode plugin</span>];
Loading

Testimonials

Use cases

Chat STT Mobile Infra Cloud Code
LM Studio MacWhisper PocketPal AI RamaLama Hugging Face llama.vim
KoboldCpp VLC media player LLMFarm paddler llama.vscode
LocalAI wchess ChatterUI llama-swap VSCode
Jan superwhisper

Jobs

  • ggml/llama.cpp maintainer, full-time

    apply at jobs@ggml.ai (only active contributors will be considered)

Partners

Pinned Loading

  1. ggml ggml Public

    Tensor library for machine learning

    C++ 12.4k 1.2k

  2. llama.cpp llama.cpp Public

    LLM inference in C/C++

    C++ 78.7k 11.5k

  3. llama.vim llama.vim Public

    Vim plugin for LLM-assisted code/text completion

    Vim Script 1.4k 44

  4. llama.vscode llama.vscode Public

    VS Code extension for LLM-assisted code/text completion

    TypeScript 679 52

  5. ci ci Public

    CI for ggml and related projects

    Shell 28 10

  6. p1 p1 Public

    LLM-based code completion engine

    183 1

Repositories

Showing 10 of 11 repositories
View all repositories

Most used topics

Loading…