Python

1913 readers

3 users here now

A community for talking about the Python programming language.

founded 1 year ago

MODERATORS

csm10495@sh.itjust.works

Python Bindings for llama.cpp (github.com)

submitted 5 months ago by desmosthenes@lemmy.world to c/python@sh.itjust.works

0 comments fedilink hide all child comments

Simple Python bindings for @ggerganov's llama.cpp library. This package provides:

Low-level access to C API via ctypes interface.
High-level Python API for text completion
    OpenAI-like API
    LangChain compatibility
    LlamaIndex compatibility
OpenAI compatible web server
    Local Copilot replacement
    Function Calling support
    Vision API support
    Multiple Models

Documentation is available at https://llama-cpp-python.readthedocs.io/en/latest.

no comments (yet)

sorted by: hot top controversial new old

there doesn't seem to be anything here