Aktuelles
NVIDIA Open-Source Software Helps Developers Add Guardrails to AI Chatbots
April 2023 by Marc Jacob
Newly released open-source software can help developers guide generative AI applications to create impressive text responses that stay on track.
NeMo Guardrails will help ensure smart applications powered by large language models (LLMs) are accurate, appropriate, on topic and secure. The software includes all the code, examples and documentation businesses need to add safety to AI apps that generate text.
Today’s release comes as many industries are adopting LLMs, the powerful engines behind these AI apps. They’re answering customers’ questions, summarizing lengthy documents, even writing software and accelerating drug design.
NeMo Guardrails is designed to help users keep this new class of AI-powered applications safe.
Powerful Models, Strong Rails
Safety in generative AI is an industry-wide concern. NVIDIA designed NeMo Guardrails to work with all LLMs, such as OpenAI’s ChatGPT.
The software lets developers align LLM-powered apps so they’re safe and stay within the domains of a company’s expertise.
NeMo Guardrails enables developers to set up three kinds of boundaries:
Topical guardrails prevent apps from veering off into undesired areas. For example, they keep customer service assistants from answering questions about the weather.
Safety guardrails ensure apps respond with accurate, appropriate information. They can filter out unwanted language and enforce that references are made only to credible sources.
Security guardrails restrict apps to making connections only to external third-party applications known to be safe.
Virtually every software developer can use NeMo Guardrails — no need to be a machine learning expert or data scientist. They can create new rules quickly with a few lines of code.
Riding Familiar Tools
Since NeMo Guardrails is open source, it can work with all the tools that enterprise app developers use.
For example, it can run on top of LangChain, an open-source toolkit that developers are rapidly adopting to plug third-party applications into the power of LLMs.
In addition, NeMo Guardrails is designed to be able to work with a broad range of LLM-enabled applications, such as Zapier. Zapier is an automation platform used by over 2 million businesses, and it’s seen first-hand how users are integrating AI into their work.
