raydata

Official

Develop, test, and deploy Ray Data jobs at scale.

AuthorSerendipityOneInc
Version1.0.0
Installs0

System Documentation

What problem does it solve?

Automates the development lifecycle of Ray Data jobs.

Core Features & Use Cases

  • Local development on A10 with remote SSH, virtual environments, and code storage at /data/srp/raydata/code/.
  • Slurm-based testing on H100/H200 with apptainer for GPU/CPU coordination.
  • Production deployment on RayCluster with runtime-env configuration and ray job submission.
  • Scheduling and orchestration with Airflow for periodic runs.
  • Example workflows include image classification and vision-language pipelines using Ray Data.

Quick Start

Connect to an A10 development machine using SSH. Create a virtual environment: python3 -m venv my_venv; source my_venv/bin/activate Install dependencies: pip install ray[data] transformers Pillow torch Place your code under /data/srp/raydata/code/ Run a local test: python /data/srp/raydata/code/your-job.py

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: raydata
Download link: https://github.com/SerendipityOneInc/srp-claude-code-marketplace/archive/main.zip#raydata

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.