Data CloudIntermediatededuplicationingestionsources
Handle duplicate ingestion from overlapping source systems
Real World Scenario
Both CRM and ERP feed order events causing double-counted revenue in calculated insights.
Expected Answer
• Design single authoritative source per metric with dedup keys
• Survivorship rules preferring ERP for financial amounts
• Idempotent ingestion keys on order ID + source
• Reconciliation dashboard comparing source totals
• Deprecate redundant feed after validation period
• Document metric definitions referencing authoritative source
Follow-Up Questions & Answers
Click to expand — each follow-up includes a direct, interview-ready answer
Direct answer: Design single authoritative source per metric with dedup keys Also consider: Survivorship rules preferring ERP for financial amounts In practice: Idempotent ingestion keys on order ID + source Balance speed of delivery with maintainability.
Architect Perspective
Metric authority matrix prevents eternal "which number is right" debates.