SREday Amsterdam 2024
Premiere 2024-11-21
Customers are looking for a turnkey solution to integrate LLMs with their existing applications. This session will provide an overview of the operational considerations, architectural patterns, and governance controls needed to operate LLMs at scale.
AWS
In this session we will see how to improve observability of container workloads focusing on the three pillars of monitoring, logging and traceability. In the operational performance, we will discuss how to detect behaviours that deviate from normal operating patterns.
Regulatory customers have multiple guardrails when running workloads on managed compute provided by AWS. This talk will focus on the setting up guardrails, deployment and monitoring of the ML services using Service Catalog Tools.
Priority access to all content
Video hallway track
Community chat
Exclusive promotions and giveaways
