Hardware Left Skin

iTWire TV 160x1200notfunny

Hardware Right Skin

iTWire TV 160x1200notfunny

iTWire TV 705x108notfunny

Thursday, 13 September 2018 16:07

Nvidia launches platform for hyperscale inferencing


The Nvidia TensorRT Hyperscale Inference Platform is designed to allow hyperscale data centres more efficiently support inferencing tasks such as speech recognition and image search.

The TensorRT Hyperscale Inference Platform is based on Nvidia's Tesla T4 GPU, which the company claims is the most advanced inference GPU. It is an order of magnitude faster than the Tesla P4 in terms of FP16 TFLOPS (65 vs 5.5 TFLOPS), and is between 20 and 36 times faster when running various inferencing workloads.

Version 5 of the TensorRT inference optimiser and runtime software includes the TensorRT Inference Server, which allows multiple models to scale across multiple GPUs.

The Inference Server is made available as a free, ready-to-run container that integrates with Kubernetes and Docker, and fits into DevOps environments.

The new platform has attracted support from Microsoft, Oracle Cloud, and Google Cloud.

"AI is becoming increasingly pervasive, and inference is a critical capability customers need to successfully deploy their AI models, so we're excited to support Nvidia's Turing Tesla T4 GPUs on Google Cloud Platform soon," said Google Cloud product manager Chris Kleban.

Hardware manufacturers supporting the platform include Cisco, Dell EMC, Fujitsu, HPE, IBM and Supermicro.

"Cisco's UCS portfolio delivers policy-driven, GPU-accelerated systems and solutions to power every phase of the AI lifecycle. With the Nvidia Tesla T4 GPU based on the Nvidia Turing architecture, Cisco customers will have access to the most efficient accelerator for AI inference workloads, gaining insights faster and accelerating time to action," said Cisco data centre group vice-president of product management, Kaustubh Das.

"Dell EMC is focused on helping customers transform their IT while benefitting from advancements such as artificial intelligence. As the world's leading provider of server systems, Dell EMC continues to enhance the PowerEdge server portfolio to help our customers ultimately achieve their goals," said Dell EMC senior vice-president of product management and marketing for servers and infrastructure systems, Ravi Pendekanti.

"Our close collaboration with Nvidia and historical adoption of the latest GPU accelerators available from their Tesla portfolio play a vital role in helping our customers stay ahead of the curve in AI training and inference."

Read 1643 times

Please join our community here and become a VIP.

Subscribe to ITWIRE UPDATE Newsletter here
JOIN our iTWireTV our YouTube Community here


The past year has seen a meteoric rise in ransomware incidents worldwide.

Over the past 12 months, SonicWall Capture Labs threat researchers have diligently tracked the meteoric rise in cyberattacks, as well as trends and activity across all threat vectors, including:

Encrypted threats
IoT malware
Zero-day attacks and more

These exclusive findings are now available via the 2022 SonicWall Cyber Threat Report, which ensures SMBs, government agencies, enterprises and other organizations have the actionable threat intelligence needed to combat the rising tide of cybercrime.

Click the button below to get the report.



It's all about Webinars.

Marketing budgets are now focused on Webinars combined with Lead Generation.

If you wish to promote a Webinar we recommend at least a 3 to 4 week campaign prior to your event.

The iTWire campaign will include extensive adverts on our News Site itwire.com and prominent Newsletter promotion https://itwire.com/itwire-update.html and Promotional News & Editorial. Plus a video interview of the key speaker on iTWire TV https://www.youtube.com/c/iTWireTV/videos which will be used in Promotional Posts on the iTWire Home Page.

Now we are coming out of Lockdown iTWire will be focussed to assisting with your webinars and campaigns and assistance via part payments and extended terms, a Webinar Business Booster Pack and other supportive programs. We can also create your adverts and written content plus coordinate your video interview.

We look forward to discussing your campaign goals with you. Please click the button below.


Stephen Withers

Stephen Withers is one of Australia¹s most experienced IT journalists, having begun his career in the days of 8-bit 'microcomputers'. He covers the gamut from gadgets to enterprise systems. In previous lives he has been an academic, a systems programmer, an IT support manager, and an online services manager. Stephen holds an honours degree in Management Sciences and a PhD in Industrial and Business Studies.

Share News tips for the iTWire Journalists? Your tip will be anonymous




Guest Opinion

Guest Interviews

Guest Reviews

Guest Research

Guest Research & Case Studies

Channel News