llm4s-scala

What problem does it solve?

This Skill simplifies building LLM applications in Scala by providing functional interfaces and integrating with effect systems like ZIO and Cats Effect, enabling type-safe AI pipelines and robust applications.

Core Features & Use Cases

• Functional LLM Interfaces: Define LLM interactions as effectful operations using ZIO or Cats Effect.
• Type-Safe Pipelines: Compose LLM calls and data transformations using monadic structures and Kleisli composition.
• Structured Output: Leverage JSON codecs for guaranteed structured responses from LLMs.
• Streaming Support: Handle LLM responses token-by-token using FS2 and ZStream.
• Use Case: Develop a Scala application that takes user input, generates a summary using an LLM, extracts keywords from the summary, and then elaborates on those keywords, all within a type-safe, effectful pipeline.

Quick Start

Use the llm4s-scala skill to generate a summary from the provided text.