Towards Availability and Maintainability Benchmarks: A Case Study of Software RAID Systems Aaron Brown Computer Science Division University of California at Berkeley
Report No. UCB//CSD-01-1132 January 2001 Computer Science Division (EECS) University of California Berkeley, California 94720
Towards Availability and Maintainability Benchmarks: A Case Study of Software RAID Systems by Aaron Brown
Research Project Submitted to the Department of Electrical Engineering and Computer Sciences, University of California at Berkeley, in partial satisfaction of the requirements for the degree of Master of Science, Plan II.
Approval for the Report and Comprehensive Examination:
Committee
Professor David A. Patterson Research Advisor
(Date)
*******
Professor Katherine Yelick Second Reader
(Date)
Towards Availability and Maintainability Benchmarks: A Case Study of Software RAID Systems† Aaron Brown University of California at Berkeley
[email protected]
19 December 2000
Abstract We introduce general methodologies for benchmarking the availability and maintainability of computer systems. Our methodologies are based on fault injection, used to purposefully compromise availability and to bring systems to a state where maintenance is required. Our availability benchmarks leverage existing performance benchmarks for workload generation and data collection, measure availability in terms of quality of service variation over time, and can produce results in both detail-rich graphical presentations or in distilled numerical summaries. Our maintainability benchmarks characterize several different axes of maintainability, including the time, impact, and learning curve associated with maintenance tasks, and rely on the use of human experiments to capture the subtle interactions between system and administrator. We demonstrate and evaluate our methodologies by applying them to measure the availability and maintainabili