Name: BenchmarkProfiles.jl
Owner: JuliaSmoothOptimizers
Description: Performance and data profiles
Created: 2016-02-25 03:46:20.0
Updated: 2017-09-23 16:03:18.0
Pushed: 2017-10-16 12:07:18.0
Homepage: null
Size: 50
Language: Julia
GitHub Committers
User | Most Recent Commit | # Commits |
---|---|---|
Dominique | 2017-07-19 16:01:47.0 | 26 |
Elliot Saba | 2017-05-16 23:54:13.0 | 1 |
Abel Siqueira | 2016-08-02 23:12:33.0 | 1 |
Asbjørn Nilsen Riseth | 2017-09-12 14:05:22.0 | 2 |
Tony Kelman | 2017-05-23 02:51:39.0 | 1 |
Goysa2 | 2017-07-20 17:22:09.0 | 1 |
Other Committers
User | Most Recent Commit | # Commits |
---|
A simple Julia package to plot performance and data profiles.
This package contains Julia translations of original scripts by Elizabeth Dolan, Jorge Moré and Stefan Wild. See http://www.mcs.anl.gov/~wild/dfo/benchmarking.
The original code was not accompanied by an open-source license. Jorge Moré and Stefan Wild have kindly provided their consent in writing to allow distribution of this Julia translation.
See the consent
folder for a full transcription.
a> Pkg.add("BenchmarkProfiles")
Plotting is handled by Plots.jl
so the user can choose among several available plotting backends.
Watch out for the pitfalls of profiles!
a> using BenchmarkProfiles
a> T = 10 * rand(25,3); # 25 problems, 3 solvers
a> performance_profile(T, ["Solver 1", "Solver 2", "Solver 3"], title="Celebrity Deathmatch")
E. Dolan and J. Moré, Benchmarking Optimization Software with Performance Profiles, Mathematical Programming 91, pages 201–213, 2002. DOI 10.1007/s101070100263.
J. J. Moré and S. M. Wild, Benchmarking Derivative-Free Optimization Algorithms, SIAM Journal on Optimization, 20(1), pages 172–191, 2009. DOI 10.1137/080724083.