llama-cpp: LLM inference in C/C++¹

The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.

... part of T2, get it here

URL: https://github.com/ggerganov/llama.cpp

Author: llama-cpp Authors
Maintainer: The T2 Project <t2 [at] t2-project [dot] org>

License: MIT
Status: Stable
Version: b5002

Download: https://github.com/ggerganov/ llama.cpp.git b5002llama-cpp-b5002.tar.gz

T2 source: llama-cpp.cache
T2 source: llama-cpp.conf
T2 source: llama-cpp.desc

Build time (on reference hardware): 760% (relative to binutils)²

Installed size (on reference hardware): 125.71 MB, 110 files

Dependencies (build time detected): bash binutils cmake coreutils diffutils gawk grep gzip linux-header make pkgconfig sed sysfiles tar tbb

Installed files (on reference hardware): n.a.

¹) This page was automatically generated from the T2 package source. Corrections, such as dead links, URL changes or typos need to be performed directly on that source.

²) Compatible with Linux From Scratch's "Standard Build Unit" (SBU).