LLM Serving, Observability and Operations | CalQuity Labs

Skip to content

CalQuity LabsBook a discovery call

Reading

Guides in this collection.

Understanding the problemHow enterprise RAG works across two pipelinesEnterprise RAG is two pipelines running on different clocks, an ingestion pipeline that builds and refreshes the index and a query pipeline that serves. Most failures live in the gap between them, and treating retrieval as one request path hides all of them.8 min readRead
Building and operating itWrite a disaster recovery plan for your AI systemRecovery objectives must be stated separately for the index, the weights, the trace store, and the queue, because each has a different rebuild time and a different data loss cost.12 min readRead

Related systems

What we build here

Working on this

Putting this into practice with your team?

Send your name and work email. We will come back with what we would check first and whether it is worth building at all.

or email us directly athello@calquity.com