After ChatGPT took the industry by storm, everyone is now working to implement LLM-powered applications and trying to understand how to best apply this incredible innovation within their own business and to benefit their customers. One of the key issues with LLMs is hallucination, the tendency of large language models to make up responses that could be inaccurate or even completely incorrect.

In this talk I will discuss why hallucination occurs, and some of the ways to address it, such as retrieval- augmented generation (aka grounded-generation). Finally I’ll show a demo of an LLM-powered for asking questions about recent news, that uses Vectara Grounded Generation to mitigate hallucinations.