DIB repo

EXPERIMENTAL - NO WARRANTY

(it is supposed to work though)

For DIB (Distributed Inference BLOBs) reference documentation and implementation, see
https://salsa.debian.org/mbaudier/dib-progs

For a list of the models served here and how they are packaged, see
https://salsa.debian.org/mbaudier/dib

Debian

Keyring (subject to change): https://dib.djapps.org/dib-archive-keyring.asc

curl -fsSL https://dib.djapps.org/dib-archive-keyring.asc | sudo tee /etc/apt/keyrings/dib-archive-keyring.asc > /dev/null

APT configuration:

cat << 'EOF' | sudo tee /etc/apt/sources.list.d/dib.sources > /dev/null
Enabled: yes
Types: deb
URIs: http://dib.djapps.org/deb
Suites: trixie-dib
Components: non-free-weights-torrents
Signed-By: /etc/apt/keyrings/dib-archive-keyring.asc
EOF

List available torrents:

sudo apt update
sudo apt list "dib-*+torrent"

Prepare standard DIB location:

sudo mkdir -p /var/lib/dib/
sudo chown debian-transmission:debian-transmission /var/lib/dib

Install a small model:

sudo apt install dib-olmo-2-0425-1b-instruct+q8-0+torrent

transmission-remote --add --download-dir /var/lib/dib \
 /etc/dib/torrents/olmo-2-0425-1b-instruct-q8_0.torrent
watch transmission-remote -l

cd /var/lib/dib/olmo-2-0425-1b-instruct/q8_0/ \
 && sha512sum --check /etc/dib/torrents/olmo-2-0425-1b-instruct-q8_0.sha512