Architecting Generative AI Applications: Build, deploy, and scale production-ready GenAI systems with LLMOps best practices

· Packt Publishing Ltd
Ebook
278
Pages
Tools

About this ebook

Take generative AI applications from prototype to production by mastering LLM architectures, evaluation strategies, LLMOps workflows, and deployment pipelines, using proven approaches to build reliable, secure, and scalable systems Free with your book: DRM-free PDF version + access to Packt's next-gen Reader* Key Features
  • Learn how to take generative AI apps from prototype to production
  • Apply evaluation, LLMOps, and SRE practices for reliable systems
  • Design scalable architectures using modern AI engineering patterns
Book DescriptionBuild production-ready generative AI applications by moving beyond prototypes and applying proven engineering principles. This book shows you how to design, evaluate, deploy, and scale AI systems that remain reliable, secure, and maintainable in real-world environments. Vibe-coding tools and coding assistants make it easy to create prototypes, but taking them into production is where most teams struggle. Written by a Staff AI Engineer at Google, this book guides you through scoping use cases, aligning them with business goals, and scaling generative AI adoption. You’ll learn how to evaluate LLMs using offline metrics, human-in-the-loop approaches, and statistical testing, as well as how to design architectures such as RAG, vector databases, agents, and memory systems. You’ll also understand how to operationalize these systems with production-grade code, testing practices, and DevOps, MLOps, and LLMOps workflows. The book covers deployment, scaling, and key considerations for security, Responsible AI, observability, and reliability. By the end of this book, you will be able to design, deploy, and maintain scalable generative AI applications, run A/B tests to measure impact, and apply durable engineering principles so your systems succeed beyond the prototype stage. *Email sign-up and proof of purchase required What you will learn
  • Design end-to-end generative AI product workflows
  • Build and evaluate AI systems with robust metrics
  • Implement production-ready code and testing practices
  • Apply LLMOps and automation for AI deployments
  • Architect scalable systems using modern AI patterns
  • Improve reliability with observability and SRE practices
  • Run A/B tests to measure product impact effectively
Who this book is for

Technical leaders, AI engineers, data scientists, software engineers, and architects building generative AI applications. Engineering managers, product leaders, and decision-makers seeking to deploy, scale, and maintain production-grade AI systems will also benefit.

Take generative AI applications from prototype to production by mastering LLM architectures, evaluation strategies, LLMOps workflows, and deployment pipelines, using proven approaches to build reliable, secure, and scalable systems Free with your book: DRM-free PDF version + access to Packt's nex...

Discover more

About the author

Leonid Kuligin is a staff AI engineer at Google Cloud, working on generative AI and classical machine learning solutions (such as agentic AI, demand forecasting, and optimization problems). Leonid is also an associate researcher at TUM University Hospital, Technical University of Munich. With over two decades of experience, Leonid has a track record of building B2C and B2B applications and solving users' problems in domains such as search, maps, knowledge extraction, and investment management in industry-leading German and Russian technological, financial, and retail companies.

Leonid Kuligin is a staff AI engineer at Google Cloud, working on generative AI and classical machine learning solutions (such as agentic AI, demand forecasting, and optimization problems). Leonid is also an associate researcher at TUM University Hospital, Technical University of Munich. With ove...

Rate this ebook

Tell us what you think.

Reading information

Smartphones and tablets
Install the Google Play Books app for Android and iPad/iPhone. It syncs automatically with your account and allows you to read online or offline wherever you are.
Laptops and computers
You can listen to audiobooks purchased on Google Play using your computer's web browser.
eReaders and other devices
To read on e-ink devices like Kobo eReaders, you'll need to download a file and transfer it to your device. Follow the detailed Help Center instructions to transfer the files to supported eReaders.