Data deduplication with chunking algorithms

In the thesis, first of all, the definition of data deduplication summarized above and the methods used in terms of location processing and data processing will be discussed. The concept of chunking will be examined in detail as the most important and time consuming part of the deduplication process. In this context, it will be explained how block and file-based chunking are applied so that deduplication can save storage space. We will examine the operation of the BSW and TTTD algorithms, and discuss the advantages and disadvantages of the algorithms and then discuss alternative solutions. By studying the operation of the important algorithms used in the synchronization processes, it will be exemplified by Syncany, the synchronization tool in which an application of the chunking works is found. Sampling will be handled by synchronizing the various files with the device having different operating systems, and by performing this synchronization on the client side as an example.