Skills
.Work. You
Rest

beam-dataflow-python

Official

Master Dataflow Python pipelines.

Software Engineering#python#streaming#batch processing#bigquery#dataflow#pipeline optimization#apache beam
Authorway-platform
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill provides comprehensive guidance and best practices for building, optimizing, and deploying robust Apache Beam Python pipelines on Google Cloud Dataflow.

Core Features & Use Cases

  • Best Practices: Covers unified batch/streaming, Protobuf integration, advanced windowing, and stateful processing.
  • Optimization: Details on Runner v2, Streaming Engine, Docker/Flex Templates, and cost-saving strategies.
  • Testing & Deployment: Guidance on modern testing methodologies and CI/CD integration.
  • Use Case: Use this Skill when developing a new Dataflow pipeline to ensure it adheres to the latest architectural patterns, performance optimizations, and deployment standards.

Quick Start

Follow the Dataflow Python best practices outlined in the documentation to build a high-performance pipeline.

Dependency Matrix

Required Modules

None required

Components

scriptsreferences

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: beam-dataflow-python
Download link: https://github.com/way-platform/skills/archive/main.zip#beam-dataflow-python

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.