discovering-gcp-data-assets

Searches Dataplex catalog and retrieves schema metadata for Google Cloud data assets.

Updated Jan 8, 2026
One-click install
npx skills add https://github.com/arslan9024/White-Caves --skill discovering-gcp-data-assets-arslan9024
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: discovering-gcp-data-assets
Source: https://github.com/arslan9024/White-Caves/tree/main/.agents/skills/discovering_gcp_data_assets
Command: npx skills add https://github.com/arslan9024/White-Caves --skill discovering-gcp-data-assets-arslan9024

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Locating the right data asset in Google Cloud is difficult when you only have a keyword or business topic, and retrieving schema or governance metadata requires knowing exact resource identifiers. This Skill discovers BigQuery, Spanner, BigLake, and Cloud Storage assets through the Dataplex Universal Catalog and fetches their full metadata. ## Core Features & Use Cases - Semantic and Keyword Search: Find data assets using natural language intent (e.g., "Q4 product sales data") or precise technical queries with filters like system=bigquery, location=us-central1, and column:order_id. - Deep Metadata Lookup: Retrieve schema, business context, and governance details for any discovered asset using the Dataplex Lookup Context command with full entry names. - Guided Disambiguation: Handle no-result, multi-result, and permission-error scenarios with structured fallback rules, including direct bq CLI inspection for public datasets. - Use Case: A data analyst knows a table contains customer orders but not its name. The Skill searches Dataplex semantically, lists candidate tables, and returns the full schema and column descriptions for the confirmed asset. ## Quick Start Find the BigQuery table containing customer order data in my GCP project and show me its schema and metadata.

Frequently Asked Questions about discovering-gcp-data-assets

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I find a BigQuery table when I only know the topic?▼

Use Dataplex semantic search with a natural language description of the data, such as "Q4 product sales data". The search returns candidate entries with full resource names, which you then pass to the context lookup command to retrieve schema and metadata.

How to search Google Cloud data assets with gcloud CLI?▼

Run gcloud dataplex entries search with your query, a --project flag for attribution, and optionally --semantic-search for natural language. Keyword mode supports filters like system=bigquery, location=us-central1, and name:sales for precise matching.

What is the difference between semantic and keyword search in Dataplex?▼

Semantic search interprets natural language intent and handles synonyms and plurals automatically, requiring uppercase AND/OR operators. Keyword search matches exact technical strings, is case-insensitive for operators, and requires singular terms and singular label. prefixes.

Why does Dataplex search return no results for my table?▼

Missing results usually mean the asset is not indexed in the Universal Catalog or the query uses plural keywords. Try up to three query variations, search by fully_qualified_name, or fall back to native tools like bq show if you know the exact resource ID.

Why does Dataplex context lookup fail with NOT_FOUND?▼

Lookup fails when you pass short table IDs instead of full entry names starting with projects/, or when the asset's project has not synchronized metadata with Dataplex. Use the exact entry name from search results, or inspect public datasets directly with the bq CLI.

Can I use Dataplex search for bigquery-public-data datasets?▼

No, Dataplex Lookup Context fails for assets in the bigquery-public-data project. Inspect these public tables directly using the bq CLI or BigQuery MCP tools instead of the catalog search workflow.