[Bioperl-l] Perl Performance Project?

[David Mertens]

Steffen (and BioPerl and PDL folks) -

This looks interesting, and I suspect that the PDL and BioPerl communities
might be interested in this, so I'm CC'ing them. PDL and BioPerl folks -
take a look! At one point I read about somebody who wrote some git plugins
that don't allow commits to the main branch unless they improve the test
coverage. I suspect that one might be interested in implementing a similar
approach for one's own work, focusing also on benchmarking.

Steffen, a couple of suggestions:

   1. You should include a link to perlformance.net in the docs
   2. you should include a link to the graphs from the main web page

You give a skeleton for writing a plugin, but I'm not quite sure how to set
up my own server to test my plugin. Would I install
Benchmark::Perl::Formance, build and install my own plugin, and then run

david> benchmark-perlformance --plugins=MyPlugin

Is it that simple?

Thanks!

David

On Mon, Jan 2, 2012 at 10:32 AM, Steffen Schwigon <ss5 at renormalist.net>wrote:

> Hi all!
>
> I now have my Perl benchmarking infrastructure ready and already some
> coverage over several Perl versions.
>
> The infrastructure consists of a Tapper and Codespeed instance, an own
> *not* regularly updated CPAN mirror (to keep dependencies stable), and a
> dedicated benchmark machine.
>
> One server is running a Tapper raw result database and website
> (http://perlformance.net/), the Codespeed graph rendering website
> (http://speed.perlformance.net/) and the CPAN mirror
> (http://perlformance.net/CPAN/).
>
> The second server (perl64.org [6 core AMD Opteron 4180]) is dedicated to
> only run benchmarks, without any disruption from email, web, or other
> services. I also took care of disabling all OS features that typically
> lead to deviation, like ASLR and Core Performance Boost. And, yes, Perl
> is built using Yet Another Great Perl Bootstrap Script(tm)
> (http://search.cpan.org/~schwigon/App-Bootstrap-Perl)[1].
>
> Read more about the overall vision in my YAPC::EU 2011 slidedeck:
>
>  http://perlformance.net/res/yapc_eu_2011_perlformance-net.pdf
>
> I blogged this also with some more details here:
>
>  http://blogs.perl.org/users/steffen_schwigon/2012/01/perlformance.html
>
> Principally the infrastructure is able to consume benchmarks from other
> providers. Talk to me if you want to track numbers from your machines.
>
> A side effect is a nice collection of many Perl installations. I can
> easily upgrade and rerun new benchmarks over them. So whoever is
> interested in benchmarks, please write a code snippet, ideally a
> Perl::Formance plugin, and talk to me.
>
> Theoretically I also backup the data, let's see how reliable... :-)
>
> Happy New Year!
>
> Kind regards,
> Steffen
>
> Footnotes:
> [1]  mine is better than yours :-), it can distroprefs! ANDK++
>
> PS: I regularly struggle with dependencies when bleadperl breaks CPAN
>    or on 5.8.x, so there is still some maintenance effort and the
>    “automation” is more or less still a while(true) loop -- but who
>    cares...
> --
> Steffen Schwigon <ss5 at renormalist.net>
> Dresden Perl Mongers <http://dresden-pm.org/>
>



-- 
Sent via my carrier pigeon.