ruvector-ruvllm-wasm

What problem does it solve?

This Skill enables running powerful Large Language Models (LLMs) directly within a web browser, even on edge devices, without needing a server.

Core Features & Use Cases

• Client-Side LLM Inference: Perform text generation, embedding, and streaming completions directly in the browser.
• WebGPU Acceleration: Leverages WebGPU for fast, hardware-accelerated inference.
• Quantized Models: Supports loading smaller, quantized models for efficient use of memory and bandwidth.
• Use Case: Build offline-capable AI chat applications, add text generation features to web apps, or deploy language models to resource-constrained edge devices.

Quick Start

Use the ruvector-ruvllm-wasm skill to generate text using the 'tinyllama-1.1b-q4' model in the browser.