Janus

Trends

1
Janus brings GGUF model support to GPUs via Vulkan●Show HN: Janus – Go binary that runs GGUF models via Vulkan on AMD/Intel/NvidiaYhn Technology Semiconductors9740 min ago
A developer has released Janus, an open-source tool written in Go that runs GGUF language models on AMD, Intel and Nvidia graphics cards using Vulkan. Distributed as a single binary, it removes the need for platform-specific builds or CUDA, letting users deploy local AI models across mixed GPU hardware.

Vibra-Ingenn/Janus Janus is a API router for AI models written in Go and has a Vulkan Model runner