Teradata is integrating Nvidia NeMo and Nvidia NIM microservices into the Vantage platform to accelerate AI workloads and support the development of foundation and customised large language models (LLMs), agentic workflows and retrieval-augmented generation (RAG) applications. Customers can also deploy their own custom models through Nvidia AI Enterprise, an end-to-end software platform that offers enterprise-grade security, support and stability, to drive ROI from generative AI use cases.
In addition to multiple Nvidia software integrations, Teradata’s platform will offer Nvidia accelerated computing infrastructure. The first implementation of this effort was announced today as part of Teradata’s new support for both small language models (SLMs) and open LLMs in VantageCloud Lake. The new bring-your-own LLM capability can take advantage of Nvidia AI accelerated computing platform clusters for tasks like LLM inferencing and model fine-tuning.
“Teradata customers are not casual users of their data and analytics, so we’re thrilled to be engaged with Nvidia to leverage our strong and trusted foundation for innovative AI use cases. By integrating Nvidia’s accelerated computing architecture into our Vantage platform, Teradata customers will be able to accelerate their use of AI at scale, in the environment of their choice, delivering unprecedented business value,” said Teradata chief product officer Hillary Ashton.
|
|
Nvidia NeMo Retriever, a collection of Nvidia NIM microservices that enables organisations to seamlessly connect custom models to diverse business data and deliver highly accurate responses, will also be offered on Teradata VantageCloud, enabling accelerated search and RAG applications to leverage existing customer data. Teradata will provide access to Nvidia NIM microservices, part of Nvidia AI Enterprise, for Teradata VantageCloud customers before expanding the offering to hybrid customers globally.
“Data is the foundation of generative AI applications, enabling the development of today’s highly customised applications,” said Nvidia vice president of strategic enterprise partnerships Pat Lee.
“By integrating Nvidia AI Enterprise, Teradata is providing developers a high-performance, full-stack platform that offers the security, stability, and support enterprises require.”
Availability
Teradata VantageCloud Lake Nvidia AI accelerated compute will be generally available first on AWS in November, with inference capabilities being added in Q4 and fine-tuning availability in 1H 2025.
Nvidia AI Enterprise integrations will be coming in 2025.
