Papers about benchmarking


I. Bongartz, A. R. Conn, N. Gould, and Ph. L. Toint. Cute: Constrained and unconstrained testing environment. ACM Trans. on Mathematical Software, 21(1):123--160, 1995

H. Crowder, R.S. Dembo, J.M. Mulvey. On reporting computational experiments with mathematical software. ACM Transactions on Math. Software, Vol. 5, No. 2, June 1979, pp.193-203.

Elizabeth D. Dolan and Jorge J. Moré. Benchmarking Optimization Software with COPS. Technical Report ANL/MCS-246, November 2000 (revised January 2, 2001)
[compressed PostScript file]

Elizabeth D. Dolan, Jorge J. Moré. Benchmarking optimization software with performance profiles. Mathematical Programming, Vol. 91, No. 2 (2002) pp 201-213

Richard S. Barr, Bruce L. Golden, James P. Kelly, Mauricio G.C. Resende, and William R. Stewart. Designing and Reporting on Computational Experiments with Heuristic Methods. Journal of Heuristics, vol. 1, pp. 9-32, 1995.

Catherine C. McGeoch. A Bibliography of Algorithm Experimentation, 1999

Nicholas I. M. Gould, Dominique Orban and Philippe L. Toint CUTEr (and SifDec ), a Constrained and Unconstrained Testing Environment, revisited. CERFACS Technical Report No. TR/PA/01/04

Bibliography on benchmarks

LaTeX version of a performance benchmark bibliography provided by John Larson at CSRD

Papers on benchmarking (Netlib)

Convexification and Global Optimization in Continuous and Mixed-Integer Nonlinear Programming Theory, Algorithms, Software, and Applications by Mohit Tawarmalani and Nikolaos V. Sahinidis

H. D. Mittelmann, Benchmarking Large-Scale Optimization Software INFORMS Annual Meeting, San Jose, 18 November 2002.

H. D. Mittelmann, An Independent Benchmarking of SDP and SOCP solvers

H. D. Mittelmann, Benchmarking Interior Point LP/QP Solvers

A Theoretician's Guide to the Experimental Analysis of Algorithms by David S Johnson at AT&T Labs (pdf format)

GLOBALLib Bibliography

LINLib Bibliography

MINLPLib Bibliography

Baron's Manual (by N. Sahinidis)

LGO/GAMS manual