Mar. 13 at 3:25 PM
$AMZN CEREBRAS
$VICR
AWS, Cerebras announce collaboration over AI inference solutions
Amazon Web Services and Cerebras Systems announced a collaboration that will, in the coming months, deliver the "fastest AI inference solutions available for generative AI applications and LLM workloads." The solution, to be deployed on Amazon Bedrock in AWS data centers, combines AWS Trainium-powered servers, Cerebras CS-3 systems, and Elastic Fabric Adapter networking. Later this year, AWS will also offer leading open-source LLMs and Amazon Nova using Cerebras hardware.
"Inference is where AI delivers real value to customers, but speed remains a critical bottleneck for demanding workloads like real-time coding assistance and interactive applications," said David Brown, Vice President, Compute & ML Services, AWS. "What we're building with Cerebras solves that: by splitting the inference workload across Trainium and CS-3, and connecting them with Amazon's Elastic Fabric Adapter, each system does what it's best at. The result will be inference that's an order of magnitude faster and higher performance than what's available today."
