audit-agent-background-llm-ops

What problem does it solve?

This Skill streamlines the implementation and operation of the background Audit Agent, ensuring efficient LLM engineering, policy enforcement, and resource management.

Core Features & Use Cases

• LLM Operations Management: Oversee the Audit Agent, Inference Gateway, and ollama host supervisor.
• Policy and Budget Control: Implement and manage inference-gateway policies, job pipelines, and CPU/budget controls.
• Use Case: When a specific LLM consumer is exceeding its CPU budget, use this Skill to diagnose the issue via clientTag policies and apply surgical corrections to prevent service degradation.

Quick Start

Use the audit-agent-background-llm-ops skill to create the audit-agent in PM2 and implement the Inference Gateway with policies by clientTag.