Startup Optimizes Hardware to Combat GPU Shortage for Generative AI

CentML, a Toronto-based AI startup that optimizes machine learning models to run faster and reduce compute costs, has emerged from stealth mode. The company has set its sights on helping to address the worldwide shortage of GPUs that are being used for training and inference of generative AI models. CentML believes that its offering, which is said to enable access to more efficient use of the supply of AI chips without affecting accuracy, can help improve the broken marketplace for GPUs, where demand far outstrips supply. By using a powerful open-source compiler to automatically tune optimizations to work best for a company’s specific inference pipeline and hardware, CentML is looking to capture market share from more established competitors and unlock more efficient compute for AI development.