Intuit is building GenAI powered experiences across its entire product portfolio of TurboTax, QuickBooks, Mailchimp and CreditKarma. To achieve this goal, we built GenOS: it provides out of the guardrails for Responsible AI development, enables Rapid Experimentation and an Extensible developer platform that allows for customization across the layers. GenOS is an end-to-end application development platform providing planning across agents and tools, plugin mechanisms to bring in domain capabilities and knowledge bases, out-of-the-box safety guardrails for GenAI, and secure and scalable hosting for vendor based and in house LLMs. It also incorporates developer tools which help teams to iterate by evaluating accuracy as well as assess cost and latency of their GenAI applications.

This session will provide insights into architectural elements, evaluation and debugging tools, prompt management, RAG and Fine tuning use cases as well as processes we developed to empower the engineers at Intuit to leverage GenAI. We will share learnings, best practices and pitfalls incorporating LLMs into customer-facing applications serving Intuit’s millions of customers and expert help systems.