As AI Moves from Training to Inference, Optics Moves Closer to the Chip
Imec researchers argue that co-packaged optics will not be enough for future AI systems, pushing the industry toward 2.5D and eventually 3D optical I/O.
By Pat Brans, EE Times | July 9, 2026

For years, the AI infrastructure story has been dominated by training—bigger models, larger GPU clusters, and data centers built to absorb the computational load. But as those models move into large-scale use, inference is turning connectivity into one of the central bottlenecks in AI system design.
“Inference is the moment when users use the model,” Peter Ossieur, portfolio director at imec and professor at Ghent University, told EE Times. “So, it needs to be reactive.”
That makes inference a different problem from training. Training large models is enormously compute-intensive, but it is less directly tied to the end user’s experience of waiting for an answer. Inference must generate tokens quickly and repeatedly, often for many users at once, involving long context windows, retrieval-augmented generation, reasoning steps, multimodal inputs, and multi-agent architectures.
Inference is not just a compute problem. It’s a memory, network, bandwidth, latency, and energy problem.
To read the full article, click here
Related Chiplet
- Optical Chiplet
- Reverse Gearbox Chiplet
- FlexGen Multi-Die Smart Network-on-Chip (NoC) IP
- Ncore Multi-Die Interconnect IP
- Integrated voltage regulator (IVR) chiplet
Related News
- imec: New Methods for 2.5D and 3D Integration
- Intel Demonstrates First Fully Integrated Optical I/O Chiplet
- Ayar CEO: ‘Copper Is Already Broken; Agentic AI Will Require Optical I/O’
- Avicena Announces Modular LightBundle™ Optical Interconnect Platform with > 1Tbps/mm I/O density and < 1pJ/bit
Latest News
- JEDEC® Announces Creation of JC-14.8 Subcommittee on System Level Reliability Testing (SLRT); Invites Industry Participation
- UCIe Consortium Advances from Chiplet Connectivity to System-Level Integration with UCIe 4.0 Specification
- Netherlands and Taiwan Launch Four Joint Photonics R&D Projects
- ASRA and imec release joint architectural requirements for interoperable automotive chiplets
- Crealights’ Self-Developed Silicon Photonics Chip “Greyhound” Makes Its Appearance at CIIE, Showcasing a “Chinese Solution for the Token Economy”