MikeTrendsTrends right now
AI: reposAPI

search

local LLM

Trends

  1. 1
    Redis creator launches ds4 for running LLMs locally●From the creator of Redis; run LLM locally with ds4YhnTechnologyAI3481 h ago

    Salvatore Sanfilippo, the creator of Redis, has released ds4, a tool for running large language models on local machines under the Dwarfstar project. Developer communities are discussing the release, with interest driven by Sanfilippo's track record in building widely used open-source infrastructure software.

  2. 2
    Janus: Go binary runs GGUF models via Vulkan on any GPU●Show HN: Janus – Go binary that runs GGUF models via Vulkan on AMD/Intel/NvidiaYhnTechnologySemiconductors1011 h ago

    A developer has released Janus, an open-source Go binary that runs GGUF large language models through Vulkan, removing the need for CUDA and making it compatible with AMD, Intel and Nvidia GPUs. The project is shared on GitHub and is drawing attention on Hacker News, where users are discussing its potential to simplify local model inference across different hardware vendors.

  3. 3
    Multi-Token Prediction Boosts RTX 3090 LLM Speed▼Originally published on my blog. Enabling MTP on this RTX 3090 raised generation throughput from... # ai # llm # programMmastodonTechnologySoftware51 d ago

    A developer reports enabling multi-token prediction (MTP) on an RTX 3090 graphics card raised local LLM generation throughput, while questioning whether the speedup affects coding quality. The write-up, originally published on a personal blog, has drawn attention from AI and open-source software communities interested in getting more performance from consumer GPUs for running large language models locally.

  4. 4
    Writer swaps Grammarly for a local LLM to keep text private●I replaced Grammarly with a local LLM, and none of my writing leaves my laptop anymore✉newsTechnologyAI1 h ago

    A writer says they dropped Grammarly in favour of a locally run large language model, meaning all drafting and grammar checking now happens on their own laptop instead of in the cloud. The move is pitched as a privacy win: no text is uploaded to external servers. It reflects a broader interest in offline AI tools that handle everyday tasks without sending personal data to third parties.

  5. 5
    Redis creator launches ds4 for running LLMs locally●From the creator of Redis; run LLM locally with ds4 Article URL: https:// dwarfstar.sh/ Comments URL: https:// news.ycomMmastodonTechnology221 h ago

    A new tool called ds4, promoted as coming from the creator of Redis, lets users run large language models on their own machines. The project is being shared on developer forums, where early readers are weighing its promise of private, local AI inference. Details on features and licensing remain thin, and discussion is just beginning.

  6. 6
    Using a local LLM to clean up a full hard drive●I gave my local LLM a nearly-full SSD and told it to find everything I could safely delete✉newsTechnologyAI3 d ago

    A tech writer describes running a locally hosted large language model on a nearly full SSD, asking it to identify files that could be safely deleted. The piece highlights a practical, off-cloud use of local AI: letting the model scan the drive and suggest disk cleanup targets, reflecting growing interest in running LLMs directly on personal hardware for everyday tasks.

  7. 7
    AMD driver update boosts Radeon AI performance up to 23%●🤖 AMD boosting AI/LLM performance for Radeon iGPUs as much as 18~23% with Linux 7.4 submitted by /u/Fcking_Chuck [link]MmastodonTechnologySoftware04 d ago

    AMD is delivering significant AI and large language model performance gains for its Radeon integrated graphics, with improvements of roughly 18 to 23 percent arriving via the Linux 7.4 driver. The gains matter for users running AI workloads on budget and portable systems that rely on integrated GPUs rather than discrete graphics cards. Linux users and AI enthusiasts are discussing what the update means for local LLM performance on AMD hardware.

  8. 8
    TensorFold claims up to 3x faster LLM inference on Mac and DGX Spark●シタン先生もpythonについて話していました Mac・DGX SparkでLLM推論を最大3倍高速化する「TensorFold」の概要｜npaka https:// note.com/npaka/n/n3d3e09549bdd # AppMmastodonWorld31 d ago

    A new tool called TensorFold is being described as able to speed up LLM inference by up to three times on Apple Macs and Nvidia's DGX Spark hardware. A Japanese-language explainer by npaka on Note is circulating, and comments reference discussions of Python in relation to the tool. The claim is drawing attention among AI developers interested in running large language models locally.

  9. 9
    Local LLM helps hobbyist code a handy tool●Okay my local LLM helped me yesterday to vibecode something really handy. To be honest it did most of the heavy regex liMmastodonTechnologyAI23 d ago

    A developer says a locally run large language model helped him build a genuinely useful script, handling most of the tricky regex work in what he calls vibecoding. He now wants to release the tool publicly but is unsure how to do so on his Codeberg account without violating its terms, and is asking others for advice on the right way to share it.

  10. 10
    Frustration with AI chief fuels local model push●Because fuck Dario Amadeus Mozart # ai # llm # local # localModels # yarrMmastodonTechnologyAI03 d ago

    A blunt post aimed at Dario Amodei, the head of AI company Anthropic, is circulating alongside hashtags about running large language models locally. The message pairs an insult with calls for local models and piracy ('yarr'), reflecting a sentiment among some users who oppose closed, corporate-controlled AI and prefer open or self-hosted alternatives they can run on their own machines.

  11. 11
    WhisperSubTranslate 2.5.1 turns local AI speech into subtitles●Amazon……バルトさんには言わないほうがよさそうです 動画の音声をローカルAIでテキスト化・翻訳して字幕を作成「WhisperSubTranslate」v2.5.1 ほか【ダイジェストニュース】 https:// forest.watcMmastodonWorld32 d ago

    Japanese tech outlet Impress Watch reports the release of WhisperSubTranslate v2.5.1, a tool that uses local AI to transcribe video audio and translate it into subtitles. The digest news roundup also touches on Amazon-related items, jokingly warning not to tell 'Balt' about them, and covers other Apple and LLM-related developments.

Repos