Wallaroo.AI, a leading provider of machine learning (ML) solutions, has joined forces with Ampere Computing to bring energy-efficient and cost-effective ML inferencing to the cloud. By combining Ampere’s energy-efficient processors with Wallaroo.AI’s optimized software, the collaboration aims to make it easier for enterprises to implement AI initiatives and achieve sustainable AI growth.
One of the key advantages of this collaboration is the integration of Ampere’s AI acceleration technology with Wallaroo.AI’s highly-efficient Inference Server. Benchmarks have shown up to a 6x improvement over containerized x86 solutions on certain models. The optimized solution will be available not only for Ampere’s processors but also for other cloud platforms, making it accessible to a wide range of users.
Reduced energy consumption and greater efficiency are crucial in the rapidly expanding field of AI. With the potential contribution of AI to the global economy estimated at $15.7 trillion by 2030, demand for AI has never been higher. However, the use of graphics processing units (GPUs) for training AI models can be costly and energy-intensive. By leveraging Wallaroo.AI’s inference server and advanced CPUs, enterprises can efficiently run AI and ML workloads while keeping costs down.
Furthermore, the collaboration between Wallaroo.AI and Ampere Computing supports sustainability goals. The energy consumption of running GPUs for AI training can have a significant impact on the power grid and increase facility costs. Many cloud providers and their clients have environmental and sustainability initiatives that could be adversely affected by the extensive use of GPUs. By utilizing optimized inference solutions on CPUs, organizations can achieve greater efficiency for inference workloads while contributing to their sustainability objectives.
The collaboration between Wallaroo.AI and Ampere Computing presents an exciting opportunity for enterprises seeking to deploy AI initiatives cost-effectively and sustainably. By leveraging Ampere’s energy-efficient processors and Wallaroo.AI’s optimized software, organizations can achieve breakthrough performance, reduced infrastructure requirements, and make significant progress towards their sustainability goals. The joint solution opens up new possibilities for AI growth and positions enterprises to harness the power of AI for business value more quickly and efficiently.
In summary, the collaboration between Wallaroo.AI and Ampere Computing brings together optimized hardware and software solutions that enable energy-efficient and cost-effective ML inferencing in the cloud. By combining Ampere’s energy-efficient processors with Wallaroo.AI’s highly-efficient Inference Server, enterprises can deploy AI initiatives easily, improve performance, increase energy efficiency, and balance their ML workloads, all while addressing sustainability goals. This partnership represents a significant step forward in making AI more accessible, efficient, and sustainable for businesses worldwide.
