How could the Attention-FFN Disaggregation demonstration affect Astera Labs?
New AI architecture may boost demand for Astera Labs' connectivity This disaggregated approach requires extremely fast, low-latency communication to manage the handoff of data between the two types of hardware. Astera Labs provides critical connectivity and switching solutions designed for high-performance computing platforms, making its technology essential for managing the 400 gigabits per second per cluster communication required by this new architecture.
- Effect
- Mild positive
- How direct
- Brind's reasoning
- When
- Within months
- The story
- Gone quiet
How it reaches Astera Labs
-
At the Open Compute Project Global Summit, a live inference pipeline demonstrated Attention-FFN Disaggregation using Nvidia H100 GPUs and Corsair XPUs. The pipeline routed attention layers to the GPUs and expert feed-forward layers to the XPUs. This configuration reduced time-per-output-token by 50.6 percent compared to a standalone H100 on the GPT-OSS-20B model.
The full event1independent outlet -
Communication between the H100 servers and Corsair cards runs through d-Matrix's JetStream network interface cards at 400 gigabits per second per cluster. This high-speed, low-latency data transfer is necessary for the GPU-to-XPU handoff in the AFD configuration. Astera Labs provides critical connectivity and switching solutions integrated into high-performance computing platforms, which are necessary to manage the complex, high-bandwidth data flow required by disaggregated AI systems.
No report states this step directly. Brind drew it from the reporting on each side of it, so treat it as an informed guess.
-
semiconductor company
Everything about Astera Labs
Tap any step to see the evidence behind it.
The facts so far
As reported. Each one links to where it comes from.
- The AFD configuration cut time-per-output-token from 2.59 milliseconds on a standalone H100 to 1.28 milliseconds, a 50.6 percent reduction.techtimes.com
- Communication between the H100 servers and Corsair cards runs through d-Matrix's JetStream network interface cards at 400 gigabits per second per cluster.techtimes.com
- The live demonstration used GPT-OSS-20B, a publicly released mixture-of-experts model with 20.9 billion total parameters.techtimes.com
- The Corsair XPU uses on-chip SRAM delivering a claimed 150 TB/s, roughly 45 times that figure of NVIDIA's H100 HBM3 at 3.35 terabytes per second.techtimes.com
Why it matters
The validation of Attention-FFN Disaggregation signals a major shift toward disaggregated, mixture-of-experts (MoE) architectures in large language models. This architectural trend moves away from monolithic GPU designs, requiring operators to build complex clusters that integrate multiple specialized hardware components, such as GPUs and dedicated accelerators.
For Astera Labs, this shift is significant because the performance of these new, highly distributed systems is no longer solely dependent on the compute power of the individual chips. Instead, the ability to manage the massive, low-latency data movement between different specialized processors becomes the primary bottleneck, making high-speed connectivity solutions critical for commercial viability.
What we don't know yet
- How quickly will operators adopt this proprietary hardware-software stack?
- Will the industry shift toward dense transformer architectures, negating the benefit of AFD?
What would change this answer
Who else could feel it
Other possible ripples from the same event.
- AMDLikelyNvidia's new architecture increases pressure on AMD's AI hardware
- CoreWeavePossibleCoreWeave may benefit from new AI inference speedup
- TSMCPossibleNew AI architecture may boost TSMC's advanced chip demand
- Micron TechnologyPossibleNew disaggregated AI architecture may boost demand for high-bandwidth memory.
Reporting
- techtimes.comOct 19
Keep going
Brind's analysis is written by AI from the reporting linked above and can be wrong. This explainer is a possibility worth considering, not a forecast: steps marked as Brind's reasoning are not stated in the reporting. It is not investment advice; do your own research.