LLamaSharp - .NET Binding for llama.cpp

发布时间 2023-09-09 12:55:30作者: China Soft

https://github.com/SciSharp/LLamaSharp

 

The C#/.NET binding of llama.cpp. It provides APIs to inference the LLaMa Models and deploy it on local environment. It works on both Windows, Linux and MAC without requirment for compiling llama.cpp yourself. Its performance is close to llama.cpp.

Furthermore, it provides integrations with other projects such as BotSharp to provide higher-level applications and UI.

Documentation