llm-backend-scaffold

What problem does it solve?

This Skill provides a structured process and checklist for integrating new Large Language Model (LLM) backends or frameworks into the LLM-Runner repository, streamlining the development workflow.

Core Features & Use Cases

• Backend Integration: Guides users through adding new LLM frameworks as in-tree wrappers or external dependencies.
• Configuration Management: Details how to wire CMake routing, define configuration options, and manage model configuration files.
• Testing and Documentation: Ensures new backends are properly tested and documented within the repository.
• Use Case: A developer needs to add support for a new LLM inference engine (e.g., a custom-built one) to the LLM-Runner. This Skill provides the exact steps and checklist to ensure seamless integration, including CMake configuration, model file setup, and testing.

Quick Start

Follow the backend integration checklist to add a new LLM framework to the repository.