ICML 2026

Meta Info

Homepage: https://icml.cc/Conferences/2026

Paper list: https://icml.cc/virtual/2026/papers.html?filter=titles

Papers

Large Language Models (LLMs)

• LLM Inference

  • Agentic Inference

    • ThunderAgent: A Fast, Simple, and Program-Aware Agentic Inference System [Paper] [arXiv] [Code] [Homepage] [ICML]

      • GaTech & UIUC & CMU & Together AI

      • Spotlight

      • Introduce ThunderAgent, an agentic inference and rollout system that represents workflows as LLM Programs with unified KV-cache, state, and tool-resource metadata.

      • Use program-aware scheduling and tool resource management to improve KV-cache reuse, reduce memory imbalance, and prepare tool environments asynchronously.

  • Workload Characterization

    • Characterizing Agents in Production [Paper] [arXiv] [ICML]

      • UC Berkeley & Intesa Sanpaolo & UIUC & Stanford & IBM Research

      • Oral

      • Present CAP, a systematic study of production LLM agents using 20 interviews and a survey of 306 practitioners across 26 domains.

      • Find that production agents often use simple, controllable approaches: bounded step counts before human intervention, off-the-shelf prompting, and human evaluation.