deduplication-logic-checker

What problem does it solve?

This Skill ensures that the logic for preventing duplicate entries in feed ingestion and signal creation processes is robust and correctly implemented, preventing data redundancy.

Core Features & Use Cases

• Deduplication Guard Validation: Checks for the presence of checks that prevent duplicate URLs, titles, or source identities before data insertion.
• Direct Insert Detection: Identifies instances where data might be inserted without proper duplicate checks.
• Use Case: When modifying the rss-to-signals function or any part of the feed ingestion pipeline, use this skill to automatically verify that no new direct insert paths without deduplication guards are introduced.

Quick Start

Run the deduplication logic checker for the rss-to-signals and feed-orchestrator functions.