bigquery-bigframes

Generates Python code using BigQuery DataFrames for pandas-style analysis and ML on BigQuery.

Updated Aug 26, 2026
One-click install
npx skills add https://github.com/SmileAfterBurn/pani-dumka-ai --skill bigquery-bigframes-smileafterburn
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: bigquery-bigframes
Source: https://github.com/SmileAfterBurn/pani-dumka-ai/tree/main/.gemini/skills/bigquery-bigframes
Command: npx skills add https://github.com/SmileAfterBurn/pani-dumka-ai --skill bigquery-bigframes-smileafterburn

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? Writing pandas-style data analysis and machine learning code against BigQuery requires knowing BigFrames-specific APIs, ordering modes, and ML packages, and mistakes like materializing data locally or using Scikit-learn cause out-of-memory errors and broken pipelines. ## Core Features & Use Cases - BigFrames DataFrame Best Practices: Enforces partial ordering mode, peek() previews, accessor-based transformations, and avoidance of to_pandas() and raw SQL via read_gbq(). - Cloud-Native Machine Learning: Guides model training with bigframes.bigquery.ml (linear and logistic regression) so training runs inside BigQuery instead of local memory, plus legacy bigframes.ml guidance for ARIMA Plus forecasting, PCA, and model persistence with to_gbq(). - Use Case: In a notebook, load the public penguins dataset with bpd.read_gbq(), clean it with DataFrame methods, train a logistic regression model via bbq.ml.create_model, and evaluate it without ever downloading data to the client. ## Quick Start Ask the assistant to write BigFrames code that loads a BigQuery table, cleans it with DataFrame methods, and trains a linear regression model using bigframes.bigquery.ml.

Frequently Asked Questions about bigquery-bigframes

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I use BigFrames for pandas-style analysis on BigQuery?▼

Import bigframes.pandas as bpd, set bpd.options.bigquery.ordering_mode to 'partial', and load tables with bpd.read_gbq(). Then use standard DataFrame and Series methods so computation stays inside BigQuery instead of downloading data.

BigFrames vs google-cloud-bigquery client library, which should I use?▼

Use BigFrames when writing pandas-style DataFrame or ML code against BigQuery. Use the google-cloud-bigquery client library for SQL-first workflows, job management, and administrative operations, which are covered by the bigquery-basics skill instead.

Can I use Scikit-learn with BigQuery DataFrames?▼

No, Scikit-learn requires pulling data into local client memory. Import model functions from bigframes.bigquery.ml so training is delegated to BigQuery's ML engine, and only use the legacy bigframes.ml package when explicitly requested.

Why does head() fail in BigFrames partial ordering mode?▼

head(n) requires strict row ordering, which partial ordering mode relaxes for performance. Use peek(n) instead, which randomly samples n rows and is significantly faster, or explicitly sort the DataFrame before calling head().

When is it safe to call to_pandas() in BigFrames?▼

Only call to_pandas() when the dataset is small enough to fit in memory, when an error explicitly requires local materialization, or when a plotting library cannot accept BigFrames objects. Aggregate or sample the data first to reduce download size.