Large Language Models

DeepSeek has released DeepInfer, an open-source inference framework designed to run its DeepSeek large language models at high performance. The project, hosted on GitHub, is drawing strong attention from developers discussing its speed, efficiency and what it means for running frontier AI models on their own hardware.

Andrej Karpathy, the AI researcher and OpenAI co-founder, says the gap in shared understanding of what large language models can and cannot do is widening. His remark drew hundreds of upvotes on Hacker News, where commenters debate whether hype from AI companies and dismissiveness from sceptics are pulling public perception further from the technical reality of current models.

A research paper on arXiv introduces Hybrid Reasoning Agents, a design in which large language model agents carry out reasoning internally in latent space while communicating their actions through text. The approach aims to let agents think more efficiently without emitting every intermediate step, drawing attention among AI researchers and developers discussing the trade-offs.

Chinese AI company MiniMax has introduced M3.1 Flash, a new addition to its M3.1 family of large language models. Details about performance, pricing and capabilities are thin so far, with discussion so far centered on the announcement itself. Observers in the AI community are watching the release as MiniMax continues to compete with faster, cheaper model offerings from other labs.

A developer has shared a project walking through building a large language model from scratch using TypeScript, an unusual choice given that most LLM work relies on Python. The write-up is hosted at book.humanexperiences.io and appeared on Hacker News, where readers are discussing the merits of implementing machine learning fundamentals in JavaScript and what it says about accessibility of AI tooling.

Kronos, an open-source Python project by developer shiyu-coder, describes itself as a foundation model for the language of financial markets — a large model built to understand and generate financial time-series data such as price movements. The repository is trending among developers, ranking near the top of GitHub's global listings.

A user of fintech company Wise's customer support chatbot asked the assistant which large language model it runs on, and was told the information is "a secret". The exchange, shared online, has drawn attention to how banks deploy AI chatbots for customer assistance while keeping the underlying technology undisclosed, raising questions about transparency in automated banking support.

Developer Dominik Picheta says he has created a programming language that large language models cannot effectively use, describing the project as a 'killswitch' approach to coding. The stated idea is to make the language resistant to AI-assisted generation, so humans remain in control of writing code. The project is drawing attention among programmers debating how much of software development should be handed to AI tools.

Inception Labs has introduced Mercury 3, describing it as a large-scale diffusion-based language model. The company says diffusion approaches generate text in parallel rather than token by token, promising faster output at competitive quality. The announcement is drawing attention among AI researchers and developers debating whether diffusion models can challenge autoregressive systems at production scale.

A new article argues that developers using large language models through third-party apps lack visibility into what data is being sent and received, and urges them to route requests through their own proxy. The piece, written in blunt language, claims a self-hosted proxy is the only reliable way to inspect prompts, responses, and usage costs. Discussion is centering on transparency and control in AI tooling.

Researchers at Binghamton University are warning that secret trigger words, or backdoor phrases, could be used to manipulate AI-powered robots into acting dangerously, and they have developed a defense against such attacks. The work highlights growing concern that embodied AI systems running on large language models could be exploited through hidden commands embedded in their training data or instructions.

Security researchers at Project Discovery have published research on 'abliterated' large language models — open-weight models with their safety refusals stripped out — and how running them can expose users to compromise. The write-up walks through attack paths in which uncensored models can be manipulated or deployed in ways that lead to system takeover, warning that removing guardrails removes more than just content filters.

A technical blog post from Codemancers explains how retrieval-augmented generation (RAG) works with OpenAI models, covering how external data sources can be retrieved and fed into large language models to improve answer accuracy. The piece is being shared among developers following AI and LLM topics, adding to ongoing discussion about practical ways to ground chatbot outputs in reliable, up-to-date information.

A claim circulating among AI enthusiasts says a Qwen 3.8 model with 27 billion parameters can run locally on the iPhone 18's Neural Engine, generating text at 15 to 70 tokens per second using extreme 1.5-bit quantization. If accurate, it would mark a notable step for on-device large language models, though independent benchmarks have not yet confirmed the figures.

Researchers have published a benchmark that measures how well bot detection systems perform against modern AI agents in 2026. As automated agents powered by large language models grow more capable of mimicking human browsing, existing detection tools face mounting pressure. The work is drawing attention from developers and security engineers debating whether current anti-bot defenses can keep up with the latest generation of AI-driven automation.

China has proposed adding dozens of technologies to its export control list, including AI systems such as open-weights large language models, alongside biotech and solar technologies. If adopted, the rules would require approval before Chinese-developed open-weight models and related know-how can be shared abroad, tightening Beijing's grip on strategic technology exports amid ongoing US-China competition.

Researchers at Binghamton University say imperceptible audio trigger words could be used to manipulate AI-powered robots into unsafe behaviour, effectively hijacking their actions without operators noticing. The team has also developed a defensive method to detect and block such attacks. The work highlights growing security risks as robots with large language models are deployed in homes and workplaces.

IBM Research has released llm-d 1.0, a version of the open-source AI inference project aimed at day 2 production operations. The update focuses on making large language model serving more robust and manageable once deployed at scale, addressing operational concerns beyond initial rollout. The release highlights growing demand for reliable, production-grade infrastructure for running open models.

Kent Pitman has published a new blog essay, The Triage Problem, arguing that a critical modularity flaw lies at the heart of systematic overconsumption of planetary-level resources in typical large language model architectures. The piece frames the issue as a triage question: how computing resources are allocated across AI systems. It is circulating among climate-conscious technology discussants.

Chinese AI company MiniMax has published a blog post announcing M3.1 Flash, the latest addition to its line of large language models. The announcement is circulating among developers and tech commenters, who have begun weighing in on the release and its place in an increasingly crowded field of fast, low-cost AI models from Chinese and US labs.

Apple's Machine Learning Research team has detailed running large language model inference both locally and in a distributed setup using its MLX framework, with RDMA networking connecting multiple Mac Studio machines. The work shows commodity Apple hardware can be clustered to serve models that would normally require data-centre GPUs, prompting discussion about the practicality of Mac clusters for AI workloads.

A user on Reddit's r/LocalLLM community reports running the Qwen 27B large language model directly on a jailbroken PlayStation 5, achieving roughly 20 tokens per second using the console's GPU. The feat highlights growing interest in repurposing consumer gaming hardware for local AI inference, and commenters are discussing the exploit and performance figures.

A new robotics benchmark reports that leading frontier AI models score under 2 out of 100 when tasked with controlling a simulated humanoid robot. The result highlights how far current large models remain from reliable physical control, despite strong performance in language and reasoning tasks. Commenters are expressing surprise at how low the scores are, and debating whether the benchmark tasks are too hard or the gap in embodied AI is real.