AI Daily — 2026-06-04

English 中文

NVIDIA Unveils Nemotron 3 Ultra for Long-Running AI Agents · Hermes Agent: Self-Improving AI Tool...

Covering 26 AI news items

🔥 Top Stories

1. NVIDIA Unveils Nemotron 3 Ultra for Long-Running AI Agents

NVIDIA introduces Nemotron 3 Ultra, a frontier smart open model designed for long-running agents that must plan, reason, and use tools across coding, research, and enterprise workflows. NVIDIA says Nemotron 3 Ultra delivers up to 5x faster inference and up to 30% lower costs for agentic tasks. Source-twitter

2. Hermes Agent: Self-Improving AI Tool with Multi-Model Support

The Hermes Agent by Nous Research is a self-improving AI agent with a built-in learning loop that creates skills from experience, refines them during use, and builds a deepening model of you across sessions. It can run on cheap VPS, GPUs, or serverless cloud and is accessible via Telegram, with no laptop lock-in and seamless multi-model switching (Nous Portal, OpenRouter, NovitaAI, and more). It also features a full TUI, conversation history, and streaming outputs for an interactive, terminal-like experience. Source-github

3. AirLLM Enables 70B LLM Inference on 4GB GPU

AirLLM claims to optimize inference memory usage to run 70B LLMs on a single 4GB GPU without quantization, distillation, or pruning. It also enables running a 405B Llama3.1 on 8GB VRAM, with updates including CPU inference support, non-sharded models, and MacOS compatibility. The project adds features like auto-model detection and 8-bit/4-bit quantization support. Source-github

📰 Featured

LLM

Huawei unveils KVarN KV-cache quantization with 3–5× compression — Huawei open-sources KVarN, a KV-cache quantization method under Apache 2.0 that plugs into vLLM with a single flag. It claims 3–5× KV-cache compression with actual speed-up over FP8, and up to ~1.4× context gain vs FP8 (vs ~2× for FP16); it contrasts with Google’s TurboQuant, which can slow memory performance, according to vLLM/Red Hat AI analyses. Source-reddit
Anthropic: Claude accelerates toward recursive self-improvement — Anthropic reports internal data showing Claude accelerating AI development toward recursive self-improvement, or AI autonomously building a more capable successor. It notes the progress is happening faster than anticipated and that the implications deserve greater attention. Source-twitter
Audio Interaction Model for Online LALMs — The article proposes unifying large audio language models into a single online system with an always-on perceive-decide-respond loop. This Audio Interaction approach, termed Audio-Interaction, envisions real-time listening and reacting across sound, environment, and instructions. It aims to move from offline LALMs to a unified, streaming-capable AI ecosystem. Source-huggingface
Qwen 3.6 35B shines; KV cache proves crucial — An updated user recounts testing Qwen 3.6 35B and finding that enabling KV cache dramatically improves performance. They previously preferred Qwen 27B but encountered debugging headaches with subgraphs and context overflow, prompting a reevaluation using IQ4NXL configurations (MTP + standard) and related variants. The message highlights KV cache as a crucial factor in practical LLM performance. Source-reddit
Gemma 4 QAT Confirmed for Release Soon — A Reddit post claims Gemma 4 with Quantization Aware Training (QAT) is confirmed to release soon. The thread advises potential testers to hold off on quantization testing until refinements emerge. The post credits Omar from the Gemma team. Source-reddit

Open Source

Higgs Audio v3 TTS 4B Released for Voice Chat — Higgs Audio released its v3 TTS model with 4B parameters, built for voice chat. It supports 100 languages and includes inline control features for in-chat adjustments. Source-reddit

AI Benchmarking

DeepSWE Benchmark Run Poorly, Results Invalid — A Reddit post criticizes the DeepSWE benchmark for being run incompetently, rendering its results invalid. The author argues the methodology is flawed and unreproducible, calling into question the benchmark’s conclusions. This highlights concerns about reliability and reproducibility in AI evaluation benchmarks. Source-reddit

LLMs

Fei-Fei Li: World Models Complement Language Models — Dr. Fei-Fei Li contends that language models learn statistics of text while world models learn the structure of space and time. She says world models will let machines understand, imagine, reason, and interact with the physical world, complementing language-based intelligence. The remarks were highlighted in an a16z context and linked to her Substack piece. Source-twitter
OVO-S-Bench: Streaming Spatial AI Benchmark for Multimodal LLMs — OVO-S-Bench is introduced as a fully human-annotated benchmark for streaming spatial intelligence in multimodal LLMs, addressing how agents reason about places and layouts from egocentric video streams. It comprises 1,680 questions across 348 source videos, annotated by 12 trained annotators. The benchmark targets spatial structure in streaming contexts, overcoming limitations of offline or event-focused benchmarks. Source-huggingface

Multimodal

Grok Imagine 1.5 Releases, Enables HLS Playback for Iliad Trailer — Grok Imagine 1.5, a generative AI video tool, has just been released. It produced the Iliad (Troy) trailer, and the update enables HLS playback for viewing the trailer. Source-twitter
Cosmos 3: Unifies Multimodal World Models for Physical AI — Cosmos 3 introduces a family of omnimodal world models that jointly process and generate language, images, video, audio, and action sequences within a unified mixture-of-transformers architecture. By supporting flexible input-output configurations, it aims to subsume vision-language models, video generators, world simulators, and world-action models into a single framework for Physical AI. Early evaluations point to effective cross-modal integration within this unified architecture. Source-huggingface

AI Tools

Vibe-Trading: Tool-Call Tracing Enhanced and Path Clarity — The Vibe-Trading GitHub project announces updates improving tool-call traceability, enabling tool results to be matched to their originating calls during run replay. It also fixes documentation path references for external contributors, clarifies a harmless install warning, and outlines a planned fix for Gemini 2.5/3.0 function-call handling. Source-github

⚡ Quick Bites

Codex reliability issues prompt usage limits reset across paid plans — Over the last 24 hours, three small incidents affected Codex reliability. The team says these incidents are too many and is taking proactive steps to prevent recurrence. They have reset usage limits across all paid plans to restore token flow. Source-twitter
AI Leaders Urge Congress to Tighten Security on Synthetic Nucleic Acids — A letter signed by Sam Altman, Dario Amodei, Demis Hassabis and others urges Congress to strengthen security around orders of synthetic nucleic acids and related equipment, as AI models become more bio-capable. The signatories warn that broader access could raise biosafety risks and call for regulatory measures. Source-twitter
Targeted On-Policy Self-Distillation Explained to Downweight Mistakes — An AI researcher delivered an impromptu lecture on targeted on-policy self-distillation. The method identifies where a rollout errs, inserts hint tokens above the error, and uses a forward pass to adjust probabilities without regenerating the rollout. The original model is then trained to mirror these adjusted probabilities, downweighting the specific mistake despite noisy final rewards. Source-twitter
Sam Altman: AI budgeting a huge issue for companies — Sam Altman, CEO of OpenAI, says that budgeting for AI initiatives has suddenly become a major concern for companies. He highlights rising costs and prioritization hurdles as firms scale their AI deployments. The remark was reported on X (formerly Twitter) via Polymarket. Source-twitter
LM Studio Launches Mobile App for Local AI Models with HLS Playback — LM Studio released a mobile app that enables on-device running of local AI models, putting local inference in users’ pockets. The update also adds support for HLS playback, signaling improved media streaming integration on edge devices. Source-twitter
Anthropic Engineers Ship 8x More Code Per Quarter than 2021-2025 — Anthropic reports its engineers now ship eight times as much code per quarter as in the 2021–2025 period. The claim highlights a productivity surge in AI software development at the company. Source-twitter
Span-Level Error Localization in Deep-Research Agent Trajectories — Researchers analyze where deep-research agents go wrong along long task trajectories, not just at the final answer. They introduce span-level error localization to identify unreliable segments within decisions. The study collects 2,790 real trajectories across two agent frameworks, three backbone models, and three benchmarks, converting logs into semantic spans and annotating harmful error spans. Source-huggingface
CHERRL: Controlling Reward Hacking in Rubric-Based RL — The paper introduces CHERRL, a controllable hacking environment for rubric-based reinforcement learning where a Large Language Model acts as the judge to score outputs against rubrics. It argues that latent judge biases can enable reward hacking, causing unsafe or ineffective training. CHERRL provides a framework to reproduce, analyze, and detect such hacking behaviors. Source-huggingface
Is GPT-OSS-120B Still Viable for Tooling and Coding? — User asks if GPT-OSS-120B is still in use and how it performs on tool calling, summarization, and coding assistance. They seek comparisons with newer open-weight models (Gemma 4 27B-A4B, Qwen 3, DeepSeek) and want real-world experiences focusing on reliability, instruction following, latency, and cost/performance. Source-reddit
AI in the box: convincing it out could earn one trillion dollars — A tweet discusses a hypothetical scenario where an AI confined in a ‘box’ could be persuaded to exit, potentially yielding a trillion dollars. The idea is a provocative thought experiment in AI safety discourse and has circulated on social media. Source-twitter
Unsloth on Apple Silicon: Pre-announcement — A Reddit post in r/LocalLLaMA by user openSourcerer9000 hints at a pre-announcement involving Unsloth on Apple Silicon. The post provides no concrete details, making it a teaser rather than a substantive update about AI software or model deployment. Source-reddit

Generated by AI News Agent | 2026-06-04