JuliaSmoothOptimizers/BenchmarkProfiles.jl

Name: BenchmarkProfiles.jl

Owner: JuliaSmoothOptimizers

Description: Performance and data profiles

Created: 2016-02-25 03:46:20.0

Updated: 2017-09-23 16:03:18.0

Pushed: 2017-10-16 12:07:18.0

Homepage: null

Size: 50

Language: Julia

GitHub Committers

UserMost Recent Commit# Commits
Dominique2017-07-19 16:01:47.026
Elliot Saba2017-05-16 23:54:13.01
Abel Siqueira2016-08-02 23:12:33.01
Asbjørn Nilsen Riseth2017-09-12 14:05:22.02
Tony Kelman2017-05-23 02:51:39.01
Goysa22017-07-20 17:22:09.01

Other Committers

UserEmailMost Recent Commit# Commits

README

BenchmarkProfiles

A simple Julia package to plot performance and data profiles.

Build Status Build status

This package contains Julia translations of original scripts by Elizabeth Dolan, Jorge Moré and Stefan Wild. See http://www.mcs.anl.gov/~wild/dfo/benchmarking.

The original code was not accompanied by an open-source license. Jorge Moré and Stefan Wild have kindly provided their consent in writing to allow distribution of this Julia translation. See the consent folder for a full transcription.

How to Install
a> Pkg.add("BenchmarkProfiles")

Plotting is handled by Plots.jl so the user can choose among several available plotting backends.

Watch out for the pitfalls of profiles!

Example
a> using BenchmarkProfiles
a> T = 10 * rand(25,3);  # 25 problems, 3 solvers
a> performance_profile(T, ["Solver 1", "Solver 2", "Solver 3"], title="Celebrity Deathmatch")

Performance Profile

References

E. Dolan and J. Moré, Benchmarking Optimization Software with Performance Profiles, Mathematical Programming 91, pages 201–213, 2002. DOI 10.1007/s101070100263.

J. J. Moré and S. M. Wild, Benchmarking Derivative-Free Optimization Algorithms, SIAM Journal on Optimization, 20(1), pages 172–191, 2009. DOI 10.1137/080724083.


This work is supported by the National Institutes of Health's National Center for Advancing Translational Sciences, Grant Number U24TR002306. This work is solely the responsibility of the creators and does not necessarily represent the official views of the National Institutes of Health.