Compact and prune LanceDB tables to merge fragments and reclaim storage.
npx skills add https://github.com/zero-yx/static_flow --skill lancedb-optimize-zero-yx
Please help me install this Agent Skill. Skill: lancedb-optimize Source: https://github.com/zero-yx/static_flow/tree/main/skills/lancedb-optimize Command: npx skills add https://github.com/zero-yx/static_flow --skill lancedb-optimize-zero-yx
audit-storage so only tables needing compaction are optimized. - Full Optimization: Runs optimize <table> --all --prune-now to merge fragments, rebuild indexes, and immediately remove old versions. - Post-check Verification: Re-audits fragments and compares row counts before and after to confirm data integrity. - Use Case: After a bulk article import triggers "os error 24" on the backend, run this Skill to compact all affected LanceDB tables and verify row counts remain unchanged. ## Quick Start Optimize all LanceDB tables across the content, comments, and music databases and report before-and-after fragment counts.High-intent search queries and answers about installing and using this skill.
Run `sf-cli db --db-path <db_path> optimize <table> --all --prune-now` for each table. The --all flag compacts fragments and rebuilds indexes, while --prune-now immediately removes old versions.
This error occurs when accumulated fragment files exhaust file descriptors. Compact the affected tables with the optimize command to merge fragments, which reduces open file handles and restores normal operation.
No, optimization is non-destructive. It merges fragments and removes old versions but never deletes current data. Verify integrity by comparing row counts with `count-rows` before and after optimization.
Light writes from normal API traffic are fine, but heavy write activity should be avoided to prevent lock contention. Tables within the same database must be optimized sequentially since they share a lock.
Skip tables with three or fewer fragments, as they are already compact. Use `audit-storage --table <table>` to check fragment counts before deciding which tables need optimization.
lancedbAutomate Lance dependency updates across Rust and Java components with PR generation.
acking-youCompact and prune LanceDB tables to merge fragment files and reclaim storage.
kortix-aiDetects stale tables, row-count anomalies, schema drift, and failed loads in a Postgres warehouse.
penpotSearch codebases and documents for regex patterns while respecting .gitignore.