LLMOps

Index

A

• A/A testing (champion/challenger testing), Choosing the Best Model for Your Application
• A/B testing, Evaluating Performance, The Value of Automated Metrics, A/B Testing and Shadow Testing for LLMs
• A2A (Agent-to-Agent) protocol, Agent-to-Agent Protocol-Agent-to-Agent Protocol, LLM-Based Infrastructure Systems Are “Harder”
• ABAC (attribute-based access control), Credential Management
• access control
  • code maturity, Code maturity
  • credential management, Credential Management
  • evaluating, Step 4: Evaluate Security Controls and Compliance
  • metrics for, Security
  • vulnerability management, Vulnerability management
• accidental misuse, Step 3: Perform Risk Analysis and Threat Modeling
• accuracy
  • LLMOps versus MLOps, From MLOps to LLMOps: Why Do We Need a New Framework?
  • spam detection, Measuring a Consumer LLM Application’s Performance
• actor network, in SAC technique, Soft Actor–Critic
• adapters, Adapters (Single, Parallel, and Scaled Parallel)
• adaptive fine-tuning, Adaptive Fine-Tuning
• adversarial attacks, Security Risks
• Agent-to-Agent (A2A) protocol, Agent-to-Agent Protocol-Agent-to-Agent Protocol, LLM-Based Infrastructure Systems Are “Harder”
• agentic chunking, Step 8: Chunking
• agentic systems
  • difficulties with, LLM-Based Infrastructure Systems Are “Harder”
  • evaluation of, Metrics for Agentic Systems
  • metrics, Metrics for Agentic Systems-Stage 3: Production
  • overview of, Agentic Systems
  • workflows, Agentic Workflows-Agentic Workflows
• AI (artificial intelligence)
  • AI agents, Autonomous AI Agents-Agentic Systems
  • AI engineers ...