vega/vega-benchmarks

Name: vega-benchmarks

Owner: Vega

Description: Scripts to benchmark Vega's performance

Created: 2015-07-20 13:26:07.0

Updated: 2016-07-19 13:48:37.0

Pushed: 2016-05-21 15:41:23.0

Homepage: null

Size: 4776

Language: HTML

GitHub Committers

UserMost Recent Commit# Commits

Other Committers

UserEmailMost Recent Commit# Commits

README

vega-benchmarks

Scripts to benchmark Vega's performance.

Results

Streaming benchmarks

Average performance of rendering (non-interactive) streaming visualizations: (top-bottom) scatterplot, parallel coordinates, and trellis plot; (left-right) initialization time, average frame time, and average frame rate. Dashed lines indicate the threshold of interactive updates.

Interaction benchmarks

Average frame rates for three interactive visualizations: (left-right) brushing and linking on a scatterplot matrix; brushing and linking on an overview+detail visualization; panning and zooming on a scatterplot. Dashed lines indicate the threshold of interactive updates.

Benchmark Process
e: ./index.js <visualization> [options]

ons:
benchmark  Benchmark operation to run.                   [string] [required]
renderer   Vega renderer (canvas or svg).       [string] [default: "canvas"]
           Number of repetitions to perform.                   [default: 10]
           Number of data tuples.                             [default: 100]
           Number of data categories.                          [default: 50]
           % of data tuples to stream.                       [default: 0.01]
help       Show help                                               [boolean]
  1. Run npm install in the benchmarks directory, and then npm start.

  2. Individual benchmarks can be run via the index.js script. See usage help text above.

  3. Benchmark suites, as reported in the paper, are available via the streaming.sh and interaction.sh bash scripts.

  4. Results concatenated against existing results found in the results/raw folder. By default, we included the results reported in the paper. Clearing these results will generate new files instead.

  5. A script to summarize raw results is provided for convenience (scripts/summary.js).


This work is supported by the National Institutes of Health's National Center for Advancing Translational Sciences, Grant Number U24TR002306. This work is solely the responsibility of the creators and does not necessarily represent the official views of the National Institutes of Health.