Deepset Introduces Custom AI Agent Solution Architecture

deepset, a provider of artificial intelligence orchestration solutions, at the NVIDIA GTC event in San Jose, Calif., unveiled its Custom AI Agent Solution Architecture that enables companies to deploy AI agents across cloud and on-premises environments.

The solution combines deepset's large language model orchestration capabilities and Haystack open-source framework with NVIDIA AI Enterprise software to help organizations build and manage AI agents while maintaining data security and operational control over AI workflows.

deepset's solution leverages NVIDIA AI Enterprise, including Triton Inference Server for optimized performance, NVIDIA NIM microservices including NeMo Retriever text embedding NIM and NeMo Retriever text reranking NIM, and NVIDIA NeMo to support enterprise-grade security and compliance requirements.

"Enterprises need AI solutions that don't just process information but do so with trust, security, and adaptability," said Milos Rusic, CEO of deepset, in a statement. "With NVIDIA AI Enterprise software, we're delivering a performance-optimized AI agent architecture that gives businesses full control over their AI workflows, whether in the cloud or on their own infrastructure."

"Enterprise AI needs more than just models; it requires robust orchestration, infrastructure and governance," said Amanda Saunders, director of generative AI software at NVIDIA, in a statement. "With NVIDIA AI Enterprise software integrated with the deepset Custom AI Agent Solution Architecture businesses can build and deploy AI agents that are optimized with NVIDIA AI."