LogoClawIndex
CasesSkillsAbout
LogoClawIndex

deduplication - Event Deduplication with Canonical Selection and Reputation Scoring

Deduplicate events from multiple sources with canonical selection and reputation scoring

Tags

Updated: 2026-02-11
data-processingdeduplicationaggregationcanonical-selection

Capabilities

deduplicate events by IDdeduplicate articles by contentgenerate deduplication keyscalculate reputation scores

Typical Inputs

multi-source event dataarticle listsURLs

Typical Outputs

deduplicated events listreduction metricscanonical articles

What this skill does

  • deduplicate events by ID
  • deduplicate articles by content
  • generate deduplication keys
  • calculate reputation scores
  • select canonical versions
  • group similar content
  • track reduction metrics

Inputs

  • multi-source event data
  • article lists
  • URLs
  • timestamps
  • domain information

Outputs

  • deduplicated events list
  • reduction metrics
  • canonical articles
  • source attribution

Requirements

  • TypeScript/JavaScript environment
  • multi-source data aggregation
  • event/article data structure

Source

  • Spec: SKILL.md

ClawIndex

OpenClaw Skills & Use Case Index

ClawIndex is an ecosystem-driven index of OpenClaw skills and real-world use cases.

Index

Skills·
Cases

Meta

About·
Disclaimer·
Email·
GitHub
© 2026 ClawIndex All Rights Reserved.