Celestial AI To Showcase Photonic Fabric Optical Interconnect Platform For AI Computing And Memory Infrastructure At OFC 2024
SANTA CLARA, CALIF.--(BUSINESS WIRE)--
Celestial AI™,
the Photonic Fabric™ company for AI infrastructure, today announced the
details of its participation, presentations and panel sessions during
the 2024 Optical Fiber Communication (OFC) Conference March 25-28, 2024, at the San Diego Convention Center.
During the conference, Celestial AI will showcase its Photonic Fabric™ which provides breakthrough optical interconnect for memory and compute to meet the increasingly challenging requirements of AI workloads. Celestial AI’s technology addresses the most critical performance chokepoints for advanced AI models, delivering over 25x greater bandwidth and memory capacity while reducing latency and power consumption by up to 10x compared to existing copper and optical interconnect alternatives.
Celestial AI’s Memory Fabric is the only solution available today that shatters the “Memory Wall,” offering tens of terabytes of optically scalable memory capacity, supporting current HBM3e and future HBM4 bandwidth and latency requirements. The Compute Fabric enables clusters of hundreds of GPUs or AI accelerators to be optically interconnected with industry-leading bandwidth at extremely low latency and energy consumption.
Celestial AI will be at Booth 5739 , March 25-28, 2024, at the San Diego Convention Center.
Celestial AI's Presentations and Panels at OFC:
Workshop: “Beyond the Beachfront: Integration of Silicon Photonic I/Os under a High-Power ASIC”
Date: Monday, March 25, 2024, 8:45 a.m.
Location: Room 6E
Presenter: Subal Sahni, Sr. Director of Photonics
Special Event: Rump Session: “How Much Optics Does AI Need?”
Date: Tuesday, March 26, 2024, 7:30 p.m.
Location: Room 6F
Presenter: David Lazovsky, CEO
Special Event Panel: “Next-Generation Disaggregated Data Centers Using Future Chip to System Photonic Technologies”
Date: Wednesday, March 27, 2024, 8:00 a.m.
Location: Room 6E
Presenter: David Lazovsky, CEO
Market Watch Panel: “Disaggregation Inside the DC”
Date: Thursday, March 28, 2024, 10:15 a.m.
Location: Expo Theater I
Presenter: Uday Poosarla, Sr. Director of Product
About Celestial AI
Celestial AI is the creator of the Photonic Fabric™ , an optical
interconnect technology platform for compute and memory. The Photonic
Fabric™ provides the foundational technology for optically scalable,
disaggregated data center compute and memory to unleash advancements in
AI with sustainable and profitable business models. Celestial AI’s
Photonic Fabric™ delivers a transformative leap in AI system performance
that is ten years more advanced than existing technologies. https://www.celestial.ai.
Celestial AI and Photonic Fabric are trademarks of Celestial AI, Inc, registered in the U.S. and other countries or regions.
View source version on businesswire.com: https://www.businesswire.com/news/home/20240313180640/en/
Copyright Business Wire 2024
Memory Wall
While the amount of compute continues to increase at a regular cadence, the growth in memory capacity per processor and the amount of bandwidth (compute-to-compute and compute-to-memory) are not keeping pace due to limited IO and decreasing signal integrity. This problem is deemed the memory wall. For hyperscalers, this limits how fast the processors (CPUs, GPUs and other AI accelerators) can transfer data compute-to-compute and compute-to-memory and hence the overall throughput and efficiency of the system.
Celestial Photonic Fabric can deliver data at any point on the die, directly at the point of compute. Not limited by any package beachfront restrictions or in-package electrical SERDES, this allows Photonic Fabric to offer fully optical compute-to-compute and compute-to-memory connectivity at Tbps bandwidth with nano-second latencies.
Celestial AI raises $100m for optical interconnect tech
Business news |
By Nick Flaherty
Celestial AI in the US has raised $100m to develop for its optical interconnect technology with venture backing from imec and Porsche.
This comes as Lightelligence is set to show its photonic network on chip (oNOC) in an AI chip on a PCIexpress card.
After close collaboration with hyperscalers, AI compute and memory providers, Celestial AI is introducing the Photonic Fabric, the optical interconnect for disaggregated, exascale compute and memory clusters. The Photonic Fabric is unconstrained by package beachfront limitations and can deliver data to any location on the compute die, directly to the point of consumption.
Celestial AI is building a robust Photonic Fabric ecosystem consisting of AI compute, memory suppliers, hyperscalers and high-volume commercial supply chain partners. The technology is compatible with existing industry standards including CXL, PCIe, UCIe, JEDEC HBM, and proprietary electrical communication links.
Celestial AI is offering its Photonic Fabric optical interconnect technology and silicon proven IP through a technology licensing program. Photonic Fabric has very low latency and does not need re-timers. This allows disaggregation of more processors than is possible with electric interconnects. Workloads that previously would not have been candidates for disaggregation due to latency sensitivities, can now be disaggregated with the higher bandwidth and lower latency.
Developers can use the IP in their own designs or see end-to-end benefits with Celestial AI’s Orion AI accelerator.
- Demo of world’s first optical network-on-chip processor
- ChatGPT craze drives Ayar Labs to add $25m in C1 round
- Ultra-low-energy optical chip-to-chip interconnect demonstrated
The Series B funding round was led by IAG Capital Partners, Koch Disruptive Technologies (KDT) and Temasek’s Xora Innovation fund. Other major investors in the round include Samsung Catalyst, Smart Global Holdings (SGH), Porsche Automobil Holding SE, The Engine Fund, imec.xpand, M Ventures and Tyche Partners.
Stranded memory
The startups in this area, including Ayar Labs, see the era of electrical connectivity ending, with optical interconnectivity becomes the foundational building block for advanced AI models that require exponentially increasing memory capacity and bandwidth. Large Language Models (LLM) including GPT-4 used for ChatGPT and Recommendation Engines are memory bound rather than compute bound and cloud service providers (CSPs) and hyperscale data centres are unable to decouple memory scaling from compute.
These startups have shown that Optical Compute Interconnect (OCI) is a viable approach for the disaggregation of scalable data centre memory and accelerated computing, allowing optically interconnected pooled memory systems to avoid stranded memory.
“Generative AI and Recommendation Engines, which today are running on general purpose computing systems, have already begun to measurably impact business processes, products and services. A rapid transition will take place in the coming years as global data centre infrastructure transitions from general purpose to accelerated computing systems,” said Dave Lazovsky, Celestial AI founder and CEO.
“This next wave of data centre infrastructure is being architected to deliver tremendous advancements in AI workload efficiencies, resulting from disaggregation of memory and compute resources which is enabled by optical interconnectivity. Our technology solutions are lighting the way to the future of accelerated computing.”
“Celestial AI has developed a transformational optical connectivity capability that will deliver step-change advancements in both performance and energy efficiency of high-performance computing, unlocking the potential of Generative AI and other complex workloads,” said Chase Koch, founder and CEO, Koch Disruptive Technologies.
No comments:
Post a Comment