Friday, October 16, 2015

Rating List — All engines (best versions only) for 2015

Results matrix

All engines (top 12, best versions only)
#NameElo1 2 3 4 5 6 7 8 9 10 11 12
1Komodo 9.2 64-bit 4CPU3406 43.5 − 40.5
+17−14=53
−10
45.5 − 38.5
+20−13=51
−58
65 − 19
+50−4=30
+40
59.5 − 22.5
+40−3=39
−27
57.5 − 22.5
+39−4=37
−33
66 − 16
+53−3=26
+35
67.5 − 14.5
+55−2=25
+22
71 − 11
+61−1=20
+27
69.5 − 12.5
+61−4=17
+15
70.5 − 10.5
+61−1=19
+26
71.5 − 10.5
+62−1=19
+25
2Stockfish 6 64-bit 4CPU338640.5 − 43.5
+14−17=53
+10
 66.5 − 33.5
+41−8=51
+37
72 − 28
+46−2=52
+8
74.5 − 25.5
+53−4=43
+10
54.5 − 25.5
+33−4=43
−40
69 − 29
+44−4=50
−35
77.5 − 22.5
+58−3=39
−7
87.5 − 16.5
+72−1=31
+12
  85.5 − 14.5
+71−0=29
+14
3Houdini 4 64-bit 4CPU332638.5 − 45.5
+13−20=51
+58
33.5 − 66.5
+8−41=51
−37
 29.5 − 17.5
+17−5=25
+11
62.5 − 37.5
+37−12=51
−11
66.5 − 31.5
+43−8=47
+18
34.5 − 15.5
+23−4=23
+19
35 − 15
+25−5=20
0
71 − 29
+53−11=36
−34
   
4Gull 3 64-bit 4CPU326319 − 65
+4−50=30
−40
28 − 72
+2−46=52
−8
17.5 − 29.5
+5−17=25
−11
 58.5 − 40.5
+29−11=59
+31
54.5 − 41.5
+18−5=73
+11
27 − 20
+13−6=28
+6
31 − 16
+21−6=20
+34
64 − 36
+41−13=46
−23
17.5 − 6.5
+12−1=11
+26
  
5Equinox 3.30 64-bit 4CPU324022.5 − 59.5
+3−40=39
+27
25.5 − 74.5
+4−53=43
−10
37.5 − 62.5
+12−37=51
+11
40.5 − 58.5
+11−29=59
−31
 50 − 50
+15−15=70
−3
48 − 51
+21−24=54
−22
60 − 40
+27−7=66
+11
68.5 − 35.5
+42−9=53
+7
44 − 22
+26−4=36
+2
  
6Fire 4 64-bit 4CPU323822.5 − 57.5
+4−39=37
+33
25.5 − 54.5
+4−33=43
+40
31.5 − 66.5
+8−43=47
−18
41.5 − 54.5
+5−18=73
−11
50 − 50
+15−15=70
+3
 37.5 − 42.5
+14−19=47
−29
45 − 35
+21−11=48
−3
63.5 − 36.5
+40−13=47
−3
19.5 − 12.5
+12−5=15
−23
73 − 39
+46−12=54
−3
51.5 − 27.5
+33−9=37
−3
7Critter 1.6a 64-bit 4CPU322816 − 66
+3−53=26
−35
29 − 69
+4−44=50
+35
15.5 − 34.5
+4−23=23
−19
20 − 27
+6−13=28
−6
51 − 48
+24−21=54
+22
42.5 − 37.5
+19−14=47
+29
 60 − 54
+32−26=56
−16
58 − 42
+33−17=50
−27
63.5 − 40.5
+36−13=55
−15
 65 − 35
+36−6=58
0
8Rybka 4.1 64-bit 4CPU319714.5 − 67.5
+2−55=25
−22
22.5 − 77.5
+3−58=39
+7
15 − 35
+5−25=20
0
16 − 31
+6−21=20
−34
40 − 60
+7−27=66
−11
35 − 45
+11−21=48
+3
54 − 60
+26−32=56
+16
 59.5 − 40.5
+40−21=39
+17
17.5 − 13.5
+9−5=17
−12
  
9Hannibal 1.5 64-bit 4CPU315311 − 71
+1−61=20
−27
16.5 − 87.5
+1−72=31
−12
29 − 71
+11−53=36
+34
36 − 64
+13−41=46
+23
35.5 − 68.5
+9−42=53
−7
36.5 − 63.5
+13−40=47
+3
42 − 58
+17−33=50
+27
40.5 − 59.5
+21−40=39
−17
 51 − 53
+26−28=50
−10
 51 − 49
+31−29=40
−6
10Naum 4.6 64-bit 4CPU314812.5 − 69.5
+4−61=17
−15
  6.5 − 17.5
+1−12=11
−26
22 − 44
+4−26=36
−2
12.5 − 19.5
+5−12=15
+23
40.5 − 63.5
+13−36=55
+15
13.5 − 17.5
+5−9=17
+12
53 − 51
+28−26=50
+10
 59 − 55
+35−31=48
+8
 
11Texel 1.05 64-bit 4CPU314410.5 − 70.5
+1−61=19
−26
    39 − 73
+12−46=54
+3
   55 − 59
+31−35=48
−8
 47.5 − 52.5
+23−28=49
−15
12Strelka 5.5 64-bit314110.5 − 71.5
+1−62=19
−25
14.5 − 85.5
+0−71=29
−14
   27.5 − 51.5
+9−33=37
+3
35 − 65
+6−36=58
0
 49 − 51
+29−31=40
+6
 52.5 − 47.5
+28−23=49
+15
 
Performance color legend:
(Only pairs with at least 30 games)
-120-100-80-60-40-20020406080100120

LOS matrix

All engines (top 12, best versions only)
#NameElo1 2 3 4 5 6 7 8 9 10 11 12
1Komodo 9.2 64-bit 4CPU3406 94.8100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Stockfish 6 64-bit 4CPU33865.2 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
3Houdini 4 64-bit 4CPU33260.00.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0
4Gull 3 64-bit 4CPU32630.00.00.0 99.099.5100.0100.0100.0100.0100.0100.0
5Equinox 3.30 64-bit 4CPU32400.00.00.01.0 56.189.7100.0100.0100.0100.0100.0
6Fire 4 64-bit 4CPU32380.00.00.00.543.9 88.0100.0100.0100.0100.0100.0
7Critter 1.6a 64-bit 4CPU32280.00.00.00.010.312.0 100.0100.0100.0100.0100.0
8Rybka 4.1 64-bit 4CPU31970.00.00.00.00.00.00.0 100.0100.0100.0100.0
9Hannibal 1.5 64-bit 4CPU31530.00.00.00.00.00.00.00.0 66.075.786.4
10Naum 4.6 64-bit 4CPU31480.00.00.00.00.00.00.00.034.0 61.971.0
11Texel 1.05 64-bit 4CPU31440.00.00.00.00.00.00.00.024.338.1 59.5
12Strelka 5.5 64-bit31410.00.00.00.00.00.00.00.013.629.040.5 
LOS color legend:
0102030405060708090100


Complete list (all engines and versions)

Pure list (removes rating distortions)


Selections from the complete rating list:

Custom comparison

Step 1. Select class of engines to compare: 
 Only public releases (no private engines)
 Only stable versions (no beta versions)
 Only engines with default settings
 Only new versions
 Only  best versions from each family
Select additional individual engines or engine families. You can select multiple items in each list by pressing SHIFT or CTRL while selecting. These lists can be used all at the same time, all selections will be simply combined together.
Families
Engines

Step 2. Select output that you want to see.
 Rating list
 Testing profile
  (Step: , Numbers: )

 Results table
 Performance table
 Score table
 LOS table
 Proportion of draws
 Number of games
 Number of connecting games
 Percentage of connecting games
 Score with common opponents
 Score with all opponents
 Performance with common opponents
 Performance with all opponents
 LOS with common opponents
 LOS with all opponents

Maximum size of cross-tables (from 2 to 100): 
Limit crosstables to engines in ELO range:  to 
Match length (Minimum number of games to highlight with color): 
 Cross-tables show only best version of each engine
Sort cross-tables by:    Rating    Name
Highlight diagonal of  cells wide. (0 to highlight everything)
Reference rating list: 
Recalibrate:
   No recalibration (reference and current list are compared as they are)
   Recalibrate reference list to current one using selected engines only
   Recalibrate reference list to current one using all common engines
   Recalibrate current list to reference using selected engines only
   Recalibrate current list to reference using all common engines

Step 3.

Download games in PGN format

All games are compressed with 7-zip.

All games, without comments

1'306'356 games (256.27 MB)

Selection of games

(Please don't use aggressive download managers)

Various statistics



Created in 2005-2013 by CCRL team
Last games added on October 11, 2015
Info retrieved from url
http://www.computerchess.org.uk/ccrl/404/

No comments:

Post a Comment