How can in-package optical interconnects enhance chiplet generative AI performance?
By Jeff Shepard, Microcontroller Tips (March 1, 2024)
Generative artificial intelligence (AI) requires rapid and continuous movement of large amounts of data. In a growing number of instances, electrical input/output (I/O) connections between the ICs in chiplets are becoming a bottleneck to higher performance. Key electrical I/O performance barriers include power efficiency, bandwidth, and latency. This FAQ looks at the anticipated benefits of using in-package optical I/O (IOI) in place of today’s electrical I/O in chiplets and closes with a look at emerging IOI solutions and technologies.
IOI solutions represent the latest in a long line of advancements in optical interconnects, beginning with pluggable optical transceivers replacing or supplementing electrical I/Os in data centers (Figure 1). For example, electrical Serializer/Deserializer (SerDes) is a common form of high-speed connectivity. It consists of a pair of blocks that convert data between serial data and parallel interfaces in each direction. However, exceeding 112 gigabits per second (Gbps) is extremely challenging because the large signal losses in copper interconnects make it hard to transmit data further than a few centimeters. The replacement of SerDes with OIO in chiplets is expected to eliminate electrical I/O bottlenecks and dramatically increase data transmission speeds. Critical barriers to increasing I/O performance include power efficiency, latency, and bandwidth density and reach.
To read the full article, click here
Related Chiplet
- Automotive AI Accelerator
- Direct Chiplet Interface
- HBM3e Advanced-packaging chiplet for all workloads
- UCIe AP based 8-bit 170-Gsps Chiplet Transceiver
- UCIe based 8-bit 48-Gsps Transceiver
Related News
- Ayar Labs to Showcase Optical Interconnect Solutions to Redefine AI Infrastructure at OFC 2024
- Chiplet Interconnect Pioneer Eliyan Closes $60 Million Series B Funding Round, Co-led by Samsung Catalyst Fund and Tiger Global Management to Address Most Pressing Challenge in Development of Generative AI Chips
- Chiplet interconnect pioneer Eliyan gains additional financial backing from AI chip ecosystem with strategic investment from VentureTech Alliance
- Optical Chiplet Interconnect Promises to Accelerate Computing Apps
Latest News
- Lightmatter Announces Passage L200, the Fastest Co-Packaged Optics for AI
- Alphawave Semi brings High-Speed Connectivity and Compute Solutions at OFC 2025
- Major Advancement in Applied Research: FMD Launches the Chiplet Application Hub
- Baden-Württemberg attracts imec to lead development of chiplet-based technology for automotive applications
- Marvell Demonstrates Silicon Photonics Light Engine for Low-power, Rack-scale Interconnect in AI Networks