As nobody appreciated the relative factors as a performance metric, here are the absolute times for tiny.
image xlib xvfb gl drm evolution 69.9 74.8 186.4 146.3 103.6 firefox-planet-gnome 217.5 170.8 295.1 359.9 100.1 firefox-talos-gfx 342.1 193.5 305.1 645.3 48.9 firefox-talos-svg 375.3 684.8 621.1 709.7 876.1 gnome-system-monitor 39.6 149.6 64.5 348.8 19.3 gvim 167.8 90.5 295.9 262.0 148.9 poppler 41.5 69.8 50.4 138.9 14.4 swfdec-giant-steps 20.7 25.2 28.1 54.7 13.3 swfdec-youtube 41.3 39.5 52.4 46.0 11.8 vim 97.5 115.6 93.9 160.3 20.8 Times are in seconds.
[image] 1.9.2-564-g1b24626.image.tiny
[xlib] 1.9.2-564-g1b24626.xlib.tiny
[xvfb] 1.9.2-564-g1b24626.xvfb.tiny
[gl] 1.9.2-564-g1b24626.gl.tiny
[drm] 1.9.2-564-g1b24626.drm.tiny
Advertisements
One Comment
Much nicer! I really like having the raw numbers there: they give a good overall sense of what you are doing, they allow me to spot check and make sure my understanding of how the graphs are constructed is correct, and they should allow for rough comparisons between different sets of numbers you post or with numbers people come up with themselves. (Obviously different sets of code being tested can make that deceptive, but taken with the right caveats, it’s very useful.)
The absolute times graph corrects some of the defects of the times-faster times-slower graph (it’s easier to understand, it doesn’t spend half the space just to describe one single data point – the firefox-talos-gfx number for drm – even if that number is impressive.) But it has some problems of it’s own: it implies comparability between the different absolute times, and the test-sequences with small absolute times are compressed to illegibility.
I fooled around with this a bit (another advantage of posting the raw numbers), and came up with:
[ Yeah, the legend is in backwards order: a gnumeric bug apparently ]
Advantages I see: using the simple time/image_time metric puts all the tests runs on an equal footing, but is easier to understand than times-faster-times-slower, and preserves the ability to visually compare pairs of numbers (how do the xlib/xvfb backends compare?). The horizontal bars avoid vertical text. Truncating the x axis at 4 avoided compressing everything down to fit in one outlier number.