The optimization process that Data Deduplication uses is described in detail in How does Data Deduplication work?. The Optimization job deduplicates by chunking data on a volume per the volume policy settings, (optionally) compressing those chunks, and storing chunks uniquely in the chunk store. 'Under-the-hood' tweaks for interop with DPM/DPM-like solutionsĭata Deduplication uses a post-processing strategy to optimize and maintain a volume's space efficiency.Virtualized backup applications, such as Microsoft Data Protection Manager (DPM) 'Under-the-hood' tweaks for Hyper-V interop.Virtualized Desktop Infrastructure (VDI) servers The following Usage Types provide reasonable Data Deduplication configuration for common workloads: Usage Type Modifications to ranges of a deduplicated files get written unoptimized to the disk and are optimized by the Optimization job the next time it runs. The filter redirects the read operation to the appropriate chunks that constitute the stream for that file in the chunk store. When optimized files are read, the file system sends the files with a reparse point to the Data Deduplication file system filter (Dedup.sys). Replace the original file stream of now optimized files with a reparse point to the chunk store.Place chunks in the chunk store and optionally compress.Scan the file system for files meeting the optimization policy.Seamlessly move those portions, or chunks, with special pointers called reparse points that point to a unique copy of that chunk.Identify repeated patterns across files on that volume.Once enabled for a volume, Data Deduplication runs in the background to: Users and applications that access data on an optimized volume are completely unaware that the files they are accessing have been deduplicated.

Optimization should not change access semantics All data is written unoptimized to the disk and then optimized later by Data Deduplication. Optimization should not get in the way of writes to the diskĭata Deduplication optimizes data by using a post-processing model. How does Data Deduplication work?ĭata Deduplication in Windows Server was created with the following two principles: This document describes how Data Deduplication works. Applies to: Windows Server 2022, Windows Server 2019, Windows Server 2016, Azure Stack HCI, versions 21H2 and 20H2

File deduplication software free