fildesh/fildesh

Commits: 452

rendezqueue/rendezllama

CLI for llama.cpp with various commands to guide, edit, and regenerate tokens on the fly.

Commits: 125

AutonomicPerfectionist/PipeInfer

PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation

Commits: 4

SJTU-IPADS/PowerInfer

High-speed Large Language Model Serving for Local Deployment

Commits: 4

guoriyue/LangCommand

LangCommand is a local inference command-line tool that transforms natural language descriptions into shell commands.

Commits: 4

0xibra/llama.cpp

Commits: 4

ggml-org/llama.cpp

LLM inference in C/C++

Commits: 4

ngxson/llama.cpp

Commits: 4

crc-org/llama.cpp

Commits: 4

alienkevin/llama.cpp-fix-grammar

Commits: 4

Nexesenex/croco.cpp

Commits: 4

ggerganov/llama.cpp

LLM inference in C/C++

Commits: 4

haozixu/powerinfer

experiments based on powerinfer

Commits: 4

tiiuae/llama.cpp-falcon-h1

A fork of llama.cpp with added support for the Falcon-H1 architecture. We are actively working on submitting a pull request to merge these changes into the official llama.cpp repository.

Commits: 4

nomic-ai/llama.cpp

Commits: 4

shg8/llama-exp

Commits: 4

LostRuins/koboldcpp

Commits: 4

Tiiny-AI/PowerInfer

Commits: 4

alienkevin/llama.cpp

Commits: 3

itsPreto/baby-code

100% Private & Simple. OSS 🐍 Code Interpreter for LLMs 🦙

Commits: 3

chooper1/llama.cpp-fork

Commits: 3

alpinelinux/aports

[MIRROR] Alpine packages build scripts

Commits: 1

melkor333/oily-pine

Alpine but /bin/sh and /bin/bash are replaced with oils-for-unix

Commits: 1

bazelbuild/bazel-central-registry

Commits: 1

andrewjc/llama.cpp

Andrew C's branch of LLAMA.CPP - ROCM + x86 optimisations

Commits: 1