Lemmy NZ

899 readers
38 users here now

Rules:

FAQ ~ NZ Community List ~ Join Matrix chatroom ~ Alternate frontends

founded 1 year ago
ADMINS
Dave
idanoo
AutoMod
listing: all - local
search
1
1
A Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML) (github.com)
 
 

The main goal of minigpt4.cpp is to run minigpt4 using 4-bit quantization with using the ggml library.

https://github.com/Maknee/minigpt4.cpp

2
3
[HN] Minigpt4 Inference on CPU (github.com)
 
 

[ comments | sourced from HackerNews ]

3
3
Minigpt4 Inference on CPU (github.com)
 
 

There is a discussion on Hacker News, but feel free to comment here as well.

view more: next ›