Android tournament with longer time controls

on Sat Oct 15, 2011 11:55 pm by · on Sat Oct 15, 2011 11:55 pm by

The list of UCI and XBoard engines for Android is getting longer, and I am pondering about a more serious tournament at longer time controls in Chess for Android. As a first step, I tested all available Android binaries. The list is shown below. An "X" indicates that the engine has trouble running in Chess for Android (if you are the engine author and are interested in fixing this, please contact me for details). Next, I probably do a few quick tournaments to divide the engine in groups by strength, followed by tournaments at longer time control. Please feel free to contact me if you are interested in participating, if don't know how to compile your engine for Android (ARM), or if you have good ideas about the format of this tournament. I am not really an experienced tournament manager, but merely do this for fun to get an idea of the relative strength of these engines.

You can follow progress on my blog.

Code:: apilchess-106-ja X U. Lorenz, C. Donninger bikjump1.8 Aart J.C. Bik bikjump2.1 Aart J.C. Bik cassandre-026-ja X Jean-Francois Romang, et al. chess for android Aart J.C. Bik critter-12-arm Richard Vida cyrano-061-b17-ja X Harald Johnsen daydreamer-075-ja Aaron Becker diablo-051b-ja Marcus Prewarski diablo-501-ja Marcus Prewarski dirty-android X Andres Valverde doublecheck1.1 Lucas Braesch doublecheck1.2 Lucas Braesch doublecheck1.3.1 Lucas Braesch fairymax48q H.G. Muller garbochess3 Gary Linscott garbochess-3-ja Gary Linscott gaviota0.80 Miguel A. Ballicora gaviota0.82beta Miguel A. Ballicora gaviota0.83.0.3 Miguel A. Ballicora gaviota-android-v0.83 Miguel A. Ballicora gaviota-android-v0.84 Miguel A. Ballicora gnuchess-5.07.153.3b Michel van den Bergh, et al. gnuchess-5.07.170b.5b Michel van den Bergh, et al. gnuchess-5.07.173b-android Michel van den Bergh, et al. greko8.0 Vladimir Medvedev IvanHoe-999947c Yakov Petrovich Golyadkin, et al. IvanHoe-999947c-robbo Yakov Petrovich Golyadkin, et al. jazz-444-ja Evert Glebbeek jazz-uci-501-ja Evert Glebbeek komodo-13-ja Don Dailey, Larry Kaufman komodo201-ab Don Dailey, Larry Kaufman komodo203-ab Don Dailey, Larry Kaufman komodo-203-ja Don Dailey, Larry Kaufman komodo2-ab Don Dailey, Larry Kaufman komodo3-ab Don Dailey, Larry Kaufman pepito-159-ja Carlos del Cacho redqueen095 Ben-Hur Carlos Vieira Langoni Jr. redqueen098 Ben-Hur Carlos Vieira Langoni Jr. redqueen-098-ja Ben-Hur Carlos Vieira Langoni Jr. robbolito0085e4l Yakov Petrovich Golyadkin, et al robbolito0085g3l Yakov Petrovich Golyadkin, et al rocinante-101-ja X Antonio Torrecillas rotor0.6a Jan Brouwer rotor-04-ja Jan Brouwer simplex-097-ja Antonio Torrecillas sissa-20-ja Christophe J. Mandin stockfish_crab1 modified by Adam Kleng stockfish1.8 Tord Romstad, Marco Costalba, Joona Kiiski stockfish1.9 Tord Romstad, Marco Costalba, Joona Kiiski stockfish2.0 Tord Romstad, Marco Costalba, Joona Kiiski stockfish2.1 Tord Romstad, Marco Costalba, Joona Kiiski stockfish-21-android-ja Tord Romstad, Marco Costalba, Joona Kiiski stockfish-211-android-ja Tord Romstad, Marco Costalba, Joona Kiiski suff-03a-ja X Clemens Pruell sungorous-14-ja X Pablo Vazquez toga2 Thomas Gaksch, Fabien Letouzey umax48w H.G. Muller zct032500 Zach Wegner zeta-dva-0202-ja X Srdja Matovic

on Sun Oct 16, 2011 5:29 am by · on Sun Oct 16, 2011 5:29 am by

Thank you very much Aart Bik.

Greetings

on Mon Oct 17, 2011 4:58 am by · on Mon Oct 17, 2011 4:58 am by

I ran tournaments between different versions of the same engine to determine which one would be their representative. Below I show the results of a fast round-robin tournaments using Chess for Android on a Nexus One, Nexus S, and Galaxy Tab with, where applicable, 8MB hash table and 1MB tablebases cache (Nalimov, Gaviota, Scorpio, and Robbobases reside on SD card). Each version played each other version from both sides of the Nunn opening suite.

The number one engine will play in the longer time control tournament (which is not always the latest version; engine authors let me know if you prefer otherwise since some results were pretty close). Also, Pablo Vazquez and Jim Ablett kindly worked together to fix the issue in the sungorus. It now runs correctly and will participate in the tournament.

Code:: 1 BikJump v2.1P 10.5/20 2 BikJump v1.8 9.5/20 1 Diablo 0.5.1b JA 17.5/20 2 Diablo 0.5.1 2.5/20 1 DoubleCheck 1.3 13.5/20 2 DoubleCheck 1.2 6.5/20 1 gaviota v0.84 47.5/80 2 gaviota v0.83.0.3 45.0/80 3 gaviota v0.83 41.0/80 4 gaviota v0.80.0.107 37.5/80 5 gaviota v0.82-beta2 29.0/80 1 GNU Chess 5.07.153.3b 20.5/40 2 GNU Chess 5.07.170.7b 20.0/40 3 GNU Chess 5.07.173b 19.5/40 1 IvanHoe-Beta v999947c-rob 10.0/20 2 IvanHoe-Beta v999947c 10.0/20 1 Jazz v5.01 JA 14.0/20 2 Jazz v444 JA 6.0/20 1 Komodo32 2AB 60.0/100 2 Komodo32 2.03 AB 59.0/100 3 Komodo32 2.01 AB 58.5/100 4 Komodo32 2.03 JA 58.0/100 5 Komodo32 3 AB 34.5/100 6 Komodo32 1.3 JA 30.0/100 1 RedQueen 0.9.8 JA 24.5/40 2 RedQueen 0.9.8 19.0/40 3 RedQueen 0.9.5 16.5/40 1 RobboLito 0.085g3l 10.5/20 2 RobboLito 0.085e4l 9.5/20 1 Rotor 0.6a 16.0/20 2 Rotor 0.4 4.0/20 1 Stockfish 2.1.1 JA 77.0/120 2 Stockfish 2.1 68.5/120 3 Stockfish 2.1 JA 65.5/120 4 Stockfish 1.8 62.0/120 5 Stockfish 2.0 60.0/120 6 Stockfish 1.9 59.0/120 7 Crab 1.0 beta 28.0/120

on Fri Oct 21, 2011 4:10 am by · on Fri Oct 21, 2011 4:10 am by

The following XBoard and UCI engines now pass a quick test tournament from both sides of the first Nunn position and are ready to enter the Chess for Android tournament too. Next up: qualifier tournament to split the engines into smaller groups for the longer time control matches.

New entries:

Code:: crafty 23.4 Robert Hyatt scorpio 2.7 Daniel Shawul sloppy 0.22 Ilari Pihlajisto tscp1.81 Tom Kerrigan sungorous-14-ja Pablo Vazquez

Cross-table of test tournament:

Code:: 1 2 3 4 5 6 1 scorpio ** 01 11 11 11 11 9.0/10 2 crafty 10 ** ½1 1½ 11 11 8.0/10 3 sloppy 00 ½0 ** ½1 11 11 6.0/10 4 Sungorus 1.4 JA 00 0½ ½0 ** 11 11 5.0/10 5 tscp181 00 00 00 00 ** 11 2.0/10 6 Chess for Android 00 00 00 00 00 ** 0.0/10

on Sat Oct 22, 2011 11:46 pm by · on Sat Oct 22, 2011 11:46 pm by

Below the results of a qualification tournament on Chess for Android from both sides of the first Nunn position at one-second per move on a Nexus One (1GHz Snapdragon). Where applicable, UCI engines were given an 8MB hash table and 1MB endgame tablebases cache (the complete 3- and 4-piece Nalimov, Gaviota, Scorpio, and Robbobases endgame tablebases reside on SD card). XBoard engines play at their default settings. Since the Nexus One is a single-core device, "pondering" was disabled

The qualification results are used to split the engines into separate groups. Engines in each group will play each other at longer time controls, starting with the lowest group. The number one in each group will promote to the next group.

All games can be downloaded from the tournament page.

Code:: 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 1 Critter 1.2 32-bit ** ½0 ½1 10 11 11 11 11 11 1½ 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 50.5/54 2 Stockfish 2.1.1 JA ½1 ** 01 0½ 11 11 11 01 11 11 ½1 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 49.5/54 3 RobboLito 0.085g3l x86 ½0 10 ** 01 10 11 11 11 11 11 01 11 11 11 ½1 11 11 11 11 11 11 11 11 11 11 11 11 11 48.0/54 4 Komodo32 2AB 01 1½ 10 ** 01 ½½ 11 10 11 11 11 11 01 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 47.5/54 5 IvanHoe-Beta version 999947c-r 00 00 01 10 ** 11 11 1½ 10 11 11 ½1 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 46.0/54 6 crafty 00 00 00 ½½ 00 ** 01 11 01 ½1 ½½ ½1 11 ½1 ½1 ½1 11 1½ 11 11 11 11 11 11 11 11 11 11 39.0/54 7 Toga II 1.4.1SE 00 00 00 00 00 10 ** 01 11 11 1½ ½1 1½ 11 01 ½½ ½1 11 11 11 11 11 11 11 11 11 11 11 38.0/54 8 scorpio 00 10 00 01 0½ 00 10 ** 0½ ½½ 11 01 ½1 1½ 11 10 11 10 01 11 11 11 11 ½1 11 11 11 11 35.5/54 9 GarboChess3 00 00 00 00 01 10 00 1½ ** 00 01 10 11 01 ½½ 11 11 1½ 11 ½1 11 11 11 11 11 11 11 11 34.5/54 10 Rotor 0.6a 0½ 00 00 00 00 ½0 00 ½½ 11 ** ½½ 01 11 10 1½ ½½ 01 10 11 11 11 11 11 11 11 11 11 11 33.5/54 11 GNU Chess 5.07.153.3b-32 00 ½0 10 00 00 ½½ 0½ 00 10 ½½ ** 10 11 01 ½½ 11 ½½ 1½ ½1 11 11 1½ 1½ 11 11 11 11 11 33.0/54 12 Pepito v1.59 00 00 00 00 ½0 ½0 ½0 10 01 10 01 ** ½0 ½½ 11 ½0 ½0 1½ 11 11 01 11 11 1½ 11 11 11 11 30.0/54 13 Daydreamer 1.75 JA 00 00 00 10 00 00 0½ ½0 00 00 00 ½1 ** 11 10 11 11 ½0 10 11 ½1 11 11 11 11 11 11 11 29.5/54 14 gaviota v0.84 00 00 00 00 00 ½0 00 0½ 10 01 10 ½½ 00 ** ½½ 10 1½ 11 1½ 01 11 11 11 11 11 11 11 11 29.0/54 15 Diablo 0.5.1b JA 00 00 ½0 00 00 ½0 10 00 ½½ 0½ ½½ 00 01 ½½ ** 10 ½1 ½½ 0½ 11 11 11 11 11 11 11 11 11 28.5/54 16 sloppy 00 00 00 00 00 ½0 ½½ 01 00 ½½ 00 ½1 00 01 01 ** ½0 ½1 11 11 11 1½ 11 11 11 11 11 11 28.5/54 17 RedQueen 0.9.8 JA 00 00 00 00 00 00 ½0 00 00 10 ½½ ½1 00 0½ ½0 ½1 ** 11 01 11 11 1½ 11 11 11 11 11 11 27.0/54 18 Sungorus 1.4 JA 00 00 00 00 00 0½ 00 01 0½ 01 0½ 0½ ½1 00 ½½ ½0 00 ** 11 11 1½ 1½ 11 11 11 11 11 11 26.0/54 19 GreKo 8.0 00 00 00 00 00 00 00 10 00 00 ½0 00 01 0½ 1½ 00 10 00 ** ½1 11 11 10 11 11 11 11 11 22.0/54 20 DoubleCheck 1.3 00 00 00 00 00 00 00 00 ½0 00 00 00 00 10 00 00 00 00 ½0 ** 01 01 1½ 11 11 11 11 11 15.5/54 21 Jazz v5.01 JA 00 00 00 00 00 00 00 00 00 00 00 10 ½0 00 00 00 00 0½ 00 10 ** 11 00 1½ 11 11 11 11 14.5/54 22 BikJump v2.1P 00 00 00 00 00 00 00 00 00 00 0½ 00 00 00 00 0½ 0½ 0½ 00 10 00 ** 11 1½ 11 ½1 11 11 14.0/54 23 ZCT-0.3.2500 00 00 00 00 00 00 00 00 00 00 0½ 00 00 00 00 00 00 00 01 0½ 11 00 ** 11 11 11 11 11 14.0/54 24 tscp181 00 00 00 00 00 00 00 ½0 00 00 00 0½ 00 00 00 00 00 00 00 00 0½ 0½ 00 ** 1½ 11 11 11 9.5/54 25 umax48w 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 0½ ** ½1 10 11 5.0/54 26 fairymax48q 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ½0 00 00 ½0 ** 1½ 11 4.5/54 27 Chess for Android 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 0½ ** 11 3.5/54 28 Simplex 0.9.7 rev 180 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ** 0.0/54

on Tue Oct 25, 2011 8:52 pm by · on Tue Oct 25, 2011 8:52 pm by

Games in group F are running. At 30 seconds-per-move for both sides of all Nunn positions, I suspect running the games for each group of five will take several days at least.

As Steve already kindly posted, an update to Chess for Android with various XBoard improvements (as was needed to enable this "cross-protocol" tournament) is available at the Android market or as direct download

Group A
Critter 1.2
Stockfish 2.1.1 JA
RobboLito 0.085g3l x86
Komodo32 2AB
+ winner B

Group B
IvanHoe-Beta version 999947c
crafty
Toga II 1.4.1SE
scorpio
+ winner C

Group C
GarboChess3
Rotor 0.6a
GNU Chess 5.07.153.3b
Pepito v1.59
+ winner D

Group D
Daydreamer 1.75 JA
gaviota v0.84
Diablo 0.5.1b JA
sloppy
+ winner E

Group E
RedQueen 0.9.8 JA
Sungorus 1.4 JA
GreKo 8.0
DoubleCheck 1.3
+ winner F

Group F
Jazz v5.01 JA
BikJump v2.1P
ZCT-0.3.2500
tscp181
umax48w

on Wed Oct 26, 2011 11:28 am by · on Wed Oct 26, 2011 11:28 am by

Could you send me link to RobboLito 0.085g3l x86. Thanks.

on Wed Oct 26, 2011 2:44 pm by · on Wed Oct 26, 2011 2:44 pm by

You can find links and downloads at UCI and XBoard engines for Android. Specifically, you can find the RobboLito binary at Michel Van den Bergh's website. By the way, just ignore the "x86" which is incorrectly reported in the name string by the UCI engine. This is really an ARM binary :-)

on Wed Oct 26, 2011 2:56 pm by · on Wed Oct 26, 2011 2:56 pm by

An Android version of RobboLito 0.085g3l
http://www.spaadyshare.com/W1NVRBH6DNV3/robbolito-android.rar

on Wed Oct 26, 2011 5:24 pm by · on Wed Oct 26, 2011 5:24 pm by

As requested by the author, I have compiled GreKo 8.2 for Android. This version will replace GreKo 8.0 in the tournament. Both binaries are available at the usual place: UCI and XBoard Engines for Android.

on Thu Oct 27, 2011 5:29 pm by · on Thu Oct 27, 2011 5:29 pm by

AartBik wrote:You can find links and downloads at UCI and XBoard engines for Android. Specifically, you can find the RobboLito binary at Michel Van den Bergh's website. By the way, just ignore the "x86" which is incorrectly reported in the name string by the UCI engine. This is really an ARM binary :-)

Thank you very much!!!!!!!

on Sat Oct 29, 2011 2:30 am by · on Sat Oct 29, 2011 2:30 am by

Group F has just finished a complete thirty seconds-per-move tournament, played from both sides of all positions in the Nunn opening suite under the conditions described earlier.

Congratulations to Evert Glebbeek for Jazz's promotion to Group E.

All games can be downloaded from the tournament page.

Code:: 1 2 3 4 5 1 Jazz v5.01 JA * 15.5-4.5 18.0-2.0 18.5-1.5 19.5-0.5 71.5/80 <= PROMOTED TO E 2 ZCT-0.3.2500 4.5-15.5 * 13.5-6.5 17.0-3.0 16.0-4.0 51.0/80 3 BikJump v2.1 2.0-18.0 6.5-13.5 * 12.5-7.5 12.0-8.0 33.0/80 4 tscp181 1.5-18.5 3.0-17.0 7.5-12.5 * 12.5-7.5 24.5/80 5 umax48w 0.5-19.5 4.0-16.0 8.0-12.0 7.5-12.5 * 20.0/80

on Sun Nov 06, 2011 5:04 pm by · on Sun Nov 06, 2011 5:04 pm by

After burning cycles on my Nexus One for many days, Group E has just finished a complete thirty seconds-per-move tournament in Chess for Android, played from both sides of all positions in the Nunn opening suite under the conditions described earlier.

Congratulations to Ben-Hur Carlos Vieira Langoni Jr for RedQueen's promotion to Group D.

All games can be downloaded from the tournament page.

Code:: 1 2 3 4 5 1 RedQueen 0.9.8 JA * 10.0-10.0 14.5-5.5 17.0-3.0 19.5-0.5 61.0/80 => PROMOTED TO D 2 greko8.2 10.0-10.0 * 14.5-5.5 16.0-4.0 18.5-1.5 59.0/80 3 Sungorus 1.4 JA 5.5-14.5 5.5-14.5 * 13.0-7.0 16.0-4.0 40.0/80 4 Jazz v5.01 JA 3.0-17.0 4.0-16.0 7.0-13.0 * 14.5-5.5 28.5/80 5 DoubleCheck 1.3 0.5-19.5 1.5-18.5 4.0-16.0 5.5-14.5 * 11.5/80

on Wed Nov 16, 2011 1:52 am by · on Wed Nov 16, 2011 1:52 am by

After still many more cycles on my Nexus One, Group D has just finished a complete thirty seconds-per-move tournament in Chess for Android, played from both sides of all positions in the Nunn opening suite under the conditions described earlier. Quite a shuffle-up in the results this time compared to the qualification tournament.

Congratulations to Aaron Becker for Daydreamer's promotion to Group C.

All games can be downloaded from the tournament page.

Code:: 1 2 3 4 5 1 Daydreamer 1.75 JA * 12.0-8.0 11.0-9.0 14.5-5.5 16.0-4.0 53.5/80 => PROMO TO C 2 sloppy 8.0-12.0 * 14.0-6.0 10.5-9.5 16.0-4.0 48.5/80 3 RedQueen 0.9.8 JA 9.0-11.0 6.0-14.0 * 11.5-8.5 14.0-6.0 40.5/80 4 gaviota v0.84 5.5-14.5 9.5-10.5 8.5-11.5 * 15.0-5.0 38.5/80 5 Diablo 0.5.1b JA 4.0-16.0 4.0-16.0 6.0-14.0 5.0-15.0 * 19.0/80

on Thu Nov 24, 2011 5:20 am by · on Thu Nov 24, 2011 5:20 am by

Group C has just finished a complete thirty seconds-per-move tournament in Chess for Android, played from both sides of all positions in the Nunn opening suite under the conditions described earlier.

Congratulations to Gary Linscott for GarboChess' promotion to Group B.

All games can be downloaded from the tournament page.

Code:: 1 2 3 4 5 1 GarboChess3 * 10.5-9.5 9.5-10.5 15.0-5.0 16.0-4.0 51.0/80 => PROMOTED TO B 2 Daydreamer 1.75 JA 9.5-10.5 * 12.0-8.0 14.5-5.5 13.0-7.0 49.0/80 3 GNU Chess 5.07.153.3b-32 10.5-9.5 8.0-12.0 * 11.0-9.0 16.0-4.0 45.5/80 4 Pepito v1.59 5.0-15.0 5.5-14.5 9.0-11.0 * 9.0-11.0 28.5/80 5 Rotor 0.6a 4.0-16.0 7.0-13.0 4.0-16.0 11.0-9.0 * 26.0/80