ais-bench

What problem does it solve?

AISBench Benchmark helps teams evaluate AI models on Ascend NPU across accuracy and performance, including service/local models, latency, throughput, and real-world benchmarking scenarios.

Core Features & Use Cases

• Supports accuracy evaluation for service and local models across text and multimodal datasets.
• Measures performance (latency, throughput, stress testing, steady-state, real-time traffic) and provides 15+ benchmarks.
• Provides quick-start templates and CLI to run end-to-end evaluations and generate reports.

Quick Start

Execute AISBench with your chosen models and datasets to start evaluation.