Hi,
last time I posted an announcement about ECLS v0.1a I also sent a
table with Gabriel's benchmarks applied to several
implementations. That table was bogus. Here is the excerpt which
appears in the corrected web page
In a couple of days I will upload a new package which includes the
files for performing these benchmarks. Until then you will have to
trust me :)
BTW, the new figures correspond to a PII/300 and are thus larger than
the ones posted yesterday.
Juanjo
-----
Benchmarks should be taken with a grain of salt. ECLS does not aim to
compete with any commercial or open source implementation. The purpose
of these benchmarks are, thus, to show the progress of ECLS itself
from version to version.
It also serves to show how well other implementations perform:
CLISPc, which is based on bytecodes, is astonishingly fast, compared
to other bytecodes implementations (ECLSi, CMUCLi) and to native code
implementations (ECLSc, CMUCLc).
All benchmarks are executed one after another. The
benchmark currently shows just mean execution times in seconds, using
English decimal point (0.03 = 3/100 seconds). This means that
performance of garbage collectors has a deep impact in these numbers.
It would be nice to collect some other information, such as memory
use and garbage collector timings, but that is beyond my reach for
now. Help is always welcome.
Finally, I have decided to distribute Gabriel's benchmarks together
with ECLS. The reason is that this code seems to belong to public
domain and I had to perform several changes in order to let it run
with different implementations. To recreate the benchmark just get
in build/gabriel/ and type make.
CLISPi ECLSi CMUCLi CLISPc ECLSc CMUCLc
boyer 6.509 42.383 34.440 0.911 1.000 0.190
browse 8.042 15.250 34.310 1.012 ***** 0.460
ctak 1.115 1.633 3.710 0.083 0.067 0.010
dderiv 1.089 2.450 4.810 0.211 0.267 0.130
deriv 0.960 2.117 4.220 0.201 0.250 0.110
destru-mod 3.757 2.008 6.420 0.129 0.058 0.035
destru 3.756 2.021 6.352 0.130 0.063 0.035
div2 2.316 3.933 9.750 0.199 0.217 0.120
fprint 0.055 0.167 0.043 0.055 0.162 0.045
fread 0.022 0.042 0.013 0.022 0.042 0.013
frpoly 8.355 35.150 37.280 1.471 8.633 0.410
puzzle 17.745 10.883 39.010 1.308 0.083 0.060
puzzle-mod 18.774 10.867 39.310 1.310 0.083 0.090
puzzle-mod2 17.759 10.933 38.940 1.312 0.083 0.090
stak 1.056 1.571 4.690 0.123 0.054 0.018
tak 9.349 16.533 26.700 0.535 0.100 0.060
tak-mod 9.363 16.600 26.460 0.535 0.100 0.050
takl 3.716 11.450 22.270 0.270 0.033 0.030
takr 0.959 1.712 3.467 0.069 0.013 0.013
tprint 0.070 0.162 0.065 0.072 0.158 0.063
traverse 108.076 125.433 280.950 4.197 1.067 0.550
triang-mod 219.598 303.167 662.640 19.811 4.067 8.300
triang 201.159 271.733 617.040 15.303 1.783 *****
IMPLi = Implementation IMPL interpreted
IMPLc = Implementation IMPL compiled
CLISP = CLISP 2000-03-06 (March 2000)
CMUCL = CMUCL 18c
ECLS = ECLS 0.0g
--
Juan Jose Garcia Ripoll www: http://matematicas.uclm.es/~jjgarcia/
Dpto. de Matematicas job: ········@ind-cr.uclm.es
E.T.S.I. Industriales home: ····@arrakis.es
Univ. de Castilla-La Mancha, Ciudad Real E-13071 (Spain)