Large language models

Apple's machine learning research team published work on running distributed large language model inference with MLX, its open-source array framework for Apple silicon, using Mac Studio hardware. The article, highlighted on Hacker News, draws attention to using consumer Mac clusters as an alternative to data center GPUs for serving AI models, and to Apple's growing open-source machine learning tooling.

A new research paper describes hybrid reasoning agents, large language model agents that perform internal reasoning in latent space while communicating actions through text. The approach aims to let models deliberate more efficiently than chain-of-thought text generation, reserving output tokens for actual actions. Discussion online is focused on what this could mean for agent performance and compute cost.

A developer reports that Anthropic's Claude identified 36 bugs, six of them assigned CVE identifiers, in the Pion WebRTC library, and says OpenAI's models failed to catch them. The claim has sparked discussion among developers about the relative strengths of rival AI systems in security auditing and whether large language models can meaningfully contribute to vulnerability discovery.

Security researchers at Wiz have published PHP2Shell, detailing how AI tools helped them find a critical remote code execution vulnerability in PHP. The disclosure highlights a novel way large language models can accelerate vulnerability research in widely used software, drawing significant attention from the developer and security communities.

A new article argues that developers relying on third-party tools to access large language models have little visibility into what data is being sent and returned. The piece makes the case for running your own LLM proxy, letting users log and inspect traffic between their applications and AI providers. Discussion among developers centres on privacy, debugging, and trust in AI tooling.

Inception Labs has introduced Mercury 3, a large-scale language model built on diffusion rather than the standard autoregressive approach. The announcement has drawn attention among AI researchers and developers, with discussion centring on whether diffusion-based generation can match conventional models at scale and what it could mean for speed and cost of text generation.

A developer has launched Llmspeed, a tool that lets people experience how fast a local large language model runs on different hardware before committing to a purchase. The project is drawing attention on Hacker News, where users are discussing the practical challenge of choosing GPUs and machines for running AI models locally without expensive trial and error.

A new essay asks whether large language models can produce high-assurance cryptography — code whose correctness and security must be proven to an extremely high standard, as used in formal verification work like HACL* and Fiat Crypto. The piece examines whether AI-generated code can meet the rigor that verified cryptographic implementations demand, a question drawing attention among security engineers debating how far AI coding tools can be trusted in safety-critical systems.

The AI Lab project anemll reports running Alibaba's Qwen3.8-27B large language model directly on the iPhone 18's Neural Engine, generating 15 to 70 tokens per second at an aggressive 1.5-bit-per-weight quantization. The claim shows flagship-class open models now fitting entirely on consumer phones without cloud servers, drawing attention from developers following on-device AI.

Hugging Face has introduced a new AI biology model designed to let researchers interact with DNA data through natural language, according to WIRED. The tool points to a growing trend of applying large language model techniques to biological sequences, potentially making genomics analysis more accessible. Details on the model's capabilities and intended users remain limited in early coverage.