Center for Research in Storage Systems
Data deduplication is an essential and critical component of backup systems. Essential, because it reduces storage space requirements, and critical, because the performance of the entire backup operation depends on its throughput. Traditional backup workloads consist of large data streams with high locality, which existing deduplication techniques require to provide reasonable throughput.
We have developed Extreme Binning, a scalable deduplication technique for non-traditional backup workloads that are made up of individual files with no locality among consecutive files in a given window of time. Due to lack of locality, existing techniques perform poorly on these workloads. Extreme Binning exploits file similarity, and makes only one disk access for chunk lookup per file, which gives reasonable throughput. Multi-node backup systems built with Extreme Binning scale gracefully with the amount of input data; more backup nodes can be added to boost throughput. Each file is allocated using a stateless routing algorithm to only one node, allowing for maximum parallelization, and each backup node is autonomous with no dependency across nodes, making data management tasks robust with low overhead.
The Center for Research in Storage Systems (CRSS) is a partnership between academia and industry to explore and develop new technologies and techniques to improve the manageability, scalability, security, reliability, longevity, and performance of storage systems. CRSS researchers conduct high-quality, industrially-relevant fundamental research, often in collaboration with CRSS industrial members. CRSS also facilitates collaboration in research and education, and provides pathways to simplify direct transfer of university developed ideas, research results, and technology to its industrial sponsors, helping them to improve their competitive posture in the global marketplace. CRSS also focuses on providing talented graduate and undergraduate students the technical background and industry interaction they will use as they go on to become the next generation of scientists and engineers.
CRSS conducts research in a wide range of storage-related fields, including archival storage, scalable distributed indexing and non-hierarchical file systems, large-scale distributed storage systems, file systems for next-generation storage devices, and data deduplication. We also have particular focus in cross-cutting issues such as security and reliability in file and storage systems. While CRSS was established in 2013, it inherits a long history of advanced storage research from the Storage Systems Research Center in the Jack Baskin School of Engineering. We encourage you to learn about SSRC projects that predate the formation of CRSS.
Please see the CRSS fact sheet for more information on the Center and its organization. You're also encouraged to browse the Web site for more information about research at CRSS. Please note that some parts of the site are restricted to CRSS sponsors.
If you're interested in becoming an industrial member of CRSS, please contact our Executive Director, Dr. Andy Hospodor or one of the CRSS faculty, Prof. Ethan Miller and Prof. Darrell Long. Prospective students interesting in working in the CRSS can contact one of the faculty, and are encouraged to communicate with current students to learn about their experiences working as part of CRSS.
Center for Research in Storage Systems
Engineering 2 Building CRSS Labs:
Last modified 18 Nov 2014
|© 2016 CRSS & UC Santa Cruz||Home | Research | People | Publications | Seminars | Sponsors|
|Site powered by Django|
|This material is based on work supported in part by the National Science Foundation under grant IIP-1266400. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.|