llm-inference

What problem does it solve?

This Skill provides a unified interface to interact with various Large Language Models (LLMs), simplifying the process of leveraging AI for diverse text-based tasks.

Core Features & Use Cases

• Access to Multiple Models: Supports a range of LLMs including Cerebras, Llama, Qwen, and Zai-GLM, each with different strengths and token limits.
• Flexible Inference: Can be used for standard chat interactions or for arbitrary string processing, allowing for custom formatting and output requirements.
• Use Case: You need to summarize a long document. Use this Skill to send the document text to the gpt-oss-120b model for a concise summary.

Quick Start

Use the llm-inference skill to generate a poem about the ocean using the llama3.1-8b model.