Skip Navigation
"Data deduplication refers to the elimination of redundant data. In the deduplication process, duplicate data is deleted or linked together, leaving only one copy of the data to be stored" (Ellicium).
"Deduplication and data linkage are important tasks in the preprocessing step for many data mining projects. It is important to improve data quality before data is loaded into a data warehouse (International Journal of Computer Applications).
More from the data glossary
A definitive guide to data definitions and trends, from the team at Stitch.
- Analytics
- Big data
- Business intelligence (BI)
- Common table expression
- Data analytics
- Data architecture
- Data engineering
- Data enrichment
- Data exploration
- Data ingestion
- Data integration
- Data lake
- Data migration
- Data mining
- Data modeling
- Data pipeline
- Data preparation
- Data science
- Data visualization
- Data warehouse
- Data Wrangling: Definition and Examples
- Database
- Deduplication
- ELT
- ESB - What is an Enterprise Service Bus?
- ETL
- ETL pipeline
- Information lifecycle management (ILM)
- Machine learning
- Master data management (MDM)
- SaaS
- Service-oriented architecture (SOA)
Give Stitch a try, on us
Stitch streams all of your data directly to your analytics warehouse.
Set up in minutesUnlimited data volume during trial