Scholion.ai

The Evolution of Benchmarking as a Computer Performance Evaluation Technique

Lewis, Byron C., Crews, Albert E.

Management Information Systems Quarterly · 1985 · Volume 9 · Issue 1

DOI: 10.2307/249270

Abstract

The practice of benchmarking as an assessment tool in computer performance evaluation is traced in this article from the early 1960s to the present. Included here are discussions of standard benchmark problems (used in Standard EDP Reports), application benchmarks, workload mapping, synthetic jobs, and the standard benchmark library concept. Advantages and disadvantages of the various techniques are given, along with a discussion of critical issues raised during the past two decades.

Keywords

Standard EDP Reports, benchmark problems, application benchmarks, workload modeling, representativeness, synthetic programs, standard benchmark library, C.4, D.2.1, D.2.8, D.4.8, I.6, K.6.2

Enable JavaScript for citation tools and additional paper interactions.