Cloudera Unveils AI Inference Service with Embedded NVIDIA NIM Microservices to Accelerate GenAI Development and Deployment

Cloudera's AI Inference service boosts LLM performance speeds by 36x using NVIDIA accelerated computing and NVIDIA NIM microservices, providing enhanced performance, robust security, and scalable flexibility for enterprises

Combined capability brings together companies’ differentiators in a single offering: Cloudera’s trusted data as the foundation for trusted AI with NVIDIA accelerated computing and the NVIDIA AI Enterprise software platform to deploy secure and performant AI applications privately on Cloudera

SANTA CLARA, Calif and NEW YORK, Oct. 08, 2024 (GLOBE NEWSWIRE) -- Cloudera, the only true hybrid platform for data, analytics, and AI, today launched Cloudera AI Inference powered by NVIDIA NIM microservices, part of the NVIDIA AI Enterprise platform. As one of the industry’s first AI inference services to provide embedded NIM microservice capability, Cloudera AI Inference uniquely streamlines the deployment and management of large-scale AI models, allowing enterprises to harness their data’s true potential to advance GenAI from pilot phases to full production.

Recent data from Deloitte reveals the biggest barriers to GenAI adoption for enterprises are compliance risks and governance concerns, yet adoption of GenAI is progressing at a rapid pace, with over two-thirds of organizations increasing their GenAI budgets in Q3 this year. To mitigate these concerns, businesses must turn to running AI models and applications privately - whether on premises or in public clouds. This shift requires secure and scalable solutions that avoid complex, do-it-yourself approaches.

Cloudera AI Inference protects sensitive data from leaking to non-private, vendor-hosted AI model services by providing secure development and deployment within enterprise control. Powered by NVIDIA technology, the service helps to build trusted data for trusted AI with high-performance speeds, enabling the efficient development of AI-driven chatbots, virtual assistants, and agentic applications impacting both productivity and new business growth.

The launch of Cloudera AI Inference comes on the heels of the company’s collaboration with NVIDIA, reinforcing Cloudera’s commitment to driving enterprise AI innovation at a critical moment, as industries navigate the complexities of digital transformation and AI integration.

Developers can build, customize, and deploy enterprise-grade LLMs with up to 36x faster performance using NVIDIA Tensor Core GPUs and nearly 4x throughput compared with CPUs. The seamless user experience integrates UI and APIs directly with NVIDIA NIM microservice containers, eliminating the need for command-line interfaces (CLI) and separate monitoring systems. The service integration with Cloudera’s AI Model Registry also enhances security and governance by managing access controls for both model endpoints and operations. Users benefit from a unified platform where all models—whether LLM deployments or traditional models—are seamlessly managed under a single service.

Additional key features of Cloudera AI Inference include:

  • Advanced AI Capabilities: Utilize NVIDIA NIM microservices to optimize open-source LLMs, including LLama and Mistral, for cutting-edge advancements in natural language processing (NLP), computer vision, and other AI domains.
  • Hybrid Cloud & Privacy: Run workloads on prem or in the cloud, with VPC deployments for enhanced security and regulatory compliance.
  • Scalability & Monitoring: Rely on auto-scaling, high availability (HA), and real-time performance tracking to detect and correct issues, and deliver efficient resource management.
  • Open APIs & CI/CD Integration: Access standards-compliant APIs for model deployment, management, and monitoring for seamless integration with CI/CD pipelines and MLOps workflows.
  • Enterprise Security: Enforce model access with Service Accounts, Access Control, Lineage, and Auditing features.
  • Risk-Managed Deployment: Conduct A/B testing and canary rollouts for controlled model updates.

“Enterprises are eager to invest in GenAI, but it requires not only scalable data but also secure, compliant, and well-governed data,” said industry analyst, Sanjeev Mohan. “Productionizing AI at scale privately introduces complexity that DIY approaches struggle to address. Cloudera AI Inference bridges this gap by integrating advanced data management with NVIDIA's AI expertise, unlocking data's full potential while safeguarding it. With enterprise-grade security features like service accounts, access control, and audit, organizations can confidently protect their data and run workloads on prem or in the cloud, deploying AI models efficiently with the necessary flexibility and governance.”

“We are excited to collaborate with NVIDIA to bring Cloudera AI Inference to market, providing a single AI/ML platform that supports nearly all models and use cases so enterprises can both create powerful AI apps with our software and then run those performant AI apps in Cloudera as well,” said Dipto Chakravarty, Chief Product Officer at Cloudera. “With the integration of NVIDIA AI, which facilitates smarter decision-making through advanced performance, Cloudera is innovating on behalf of its customers by building trusted AI apps with trusted data at scale.”

“Enterprises today need to seamlessly integrate generative AI with their existing data infrastructure to drive business outcomes,” said Kari Briski, vice president of AI software, models and services at NVIDIA. “By incorporating NVIDIA NIM microservices into Cloudera's AI Inference platform, we're empowering developers to easily create trustworthy generative AI applications while fostering a self-sustaining AI data flywheel.”

These new capabilities will be unveiled at Cloudera's premier AI and data conference, Cloudera EVOLVE NY, taking place Oct. 10. Click here to learn more about how these latest updates deepen Cloudera’s commitment, elevating enterprise data from pilot to production with GenAI.

About Cloudera
Cloudera is the only true hybrid platform for data, analytics, and AI. With 100x more data under management than other cloud-only vendors, Cloudera empowers global enterprises to transform data of all types, on any public or private cloud, into valuable, trusted insights. Our open data lakehouse delivers scalable and secure data management with portable cloud-native analytics, enabling customers to bring GenAI models to their data while maintaining privacy and ensuring responsible, reliable AI deployments. The world's largest brands in financial services, insurance, media, manufacturing, and government rely on Cloudera to use their data to solve what seemed impossible—today and in the future.

To learn more, visit Cloudera.com and follow us on LinkedIn and X. Cloudera and associated marks are trademarks or registered trademarks of Cloudera, Inc. All other company and product names may be trademarks of their respective owners.

Contact

Jess Hohn-Cabana
cloudera@v2comms.com


Cloudera Unveils AI Inference Service with Embedded NVIDIA NIM Microservices to Accelerate GenAI Development and Deployment

THỦ THUẬT HAY

Hướng dẫn đặt ảnh tự do để hiển thị trên Always On Displays

Đầu tiên, mời các bạn download Custom AOD từ Play Store, đây là ứng dụng có thể cài đặt mà không cần root máy và miễn phí, tuy nhiên, một số tính năng chỉ dành cho bản cao cấp với mức giá 69.000 VNĐ và bản 'siêu cao

Hiển thị 50 emoji thường xuyên được sử dụng nhất với tweak MoreFrequentlyUsedEmojis

Cụ thể hơn, MoreFrequentlyUsedEmojis sẽ vô hiệu hóa toàn bộ biểu tượng cảm xúc mặc định được Apple thêm vào hệ điều hành iOS, sau đó sử dụng gói 50 emoji thường xuyên được sử dụng nhất do nhà phát triển tổng hợp sẵn.

Hướng dẫn cách tự động xóa thư spam gây phiền nhiễu trong gmail

Bạn cảm thấy khó chịu vì mỗi ngày phải nhận hàng tá thư spam đến từ các công ty quảng cáo, bán hàng khác nhau gây phiền nhiễu cho bạn

Tìm hiểu chế độ chơi Thám Hiểm trong Liên Minh Huyền Thoại 8.18

Chế độ chơi Thám Hiểm trên Liên Minh Huyền Thoại 8.18 với rất nhiều nhân vật mới, bổ trợ và trang phục rất đáng quan tâm.

Trải nghiệm Windows 10 Pro Lite Version 1803 phiên bản rút gọn tính năng

Bộ cài ISO này được tạo ra bởi anh Nguyễn Tuấn - Admin trang congnghe.nhipsong24h.net. Anh Nguyễn Tuấn đã làm ra nhiều bộ ISO uy tín cho các phiên bản Windows, nên các bạn có thể yên tâm nhé.

ĐÁNH GIÁ NHANH

Trên tay iPhone 13 Pro màu Vàng Gold: Cụm camera lớn hơn, màu sắc đậm hơn

Dự kiến, Apple sẽ chính thức bán iPhone 13 Series vào ngày 24/9 tới đây. Tuy nhiên, một số reviewer trên thế giới đã thực hiện video đập hộp, trên tay dòng sản phẩm iPhone 13 và so sánh với những chiếc iPhone thế hệ

Pin Vivo V7 có thể on screen liên tục hơn 6 tiếng rưỡi với các tác vụ thực hiện hỗn hợp

Thử nghiệm thực tế cho thấy viên pin này đủ để V7 có thể on screen liên tục được hơn 6 tiếng rưỡi với các tác vụ thực hiện hỗn hợp. Ước tính cho thấy thời gian chơi game liên tục (cả game offline và game online) vào

Đánh giá OPPO F7: Chiếc smartphone đáng mua trong phân khúc tầm trung

Giữa thế giới điện thoại thông minh đa số làm từ nhôm hoặc nhôm + kính, OPPO lại đi ngược trào lưu với OPPO F5 thân nhựa và bây giờ hãng tiếp tục làm điều tương tự trên OPPO F7. Vì vậy, trọng lượng của máy ở mức vừa