Android engines tests

Android engines testsThu Feb 25, 2021 5:57 am

Tablet - Teclast P80X_EEA (tPad, android 9) - 64bit - 2GB RAM - 8x Cortex-A55 - 1,6 GHz
GUI: CuteChess-cli / RR / 1 core per engine /TC: 40sec+0.4 / hash 16 / Book=TopGM_4moves.pgn - move order=sequential
/ repeat opening=yes / Concurrency=7 / Resignation=500cp

Code:

# PLAYER            :  RATING  ERROR  PLAYED   (%)    W     D    L  D(%)  CFS(%)
1 CF 030121 64      :    3030      3    3000  58.5  707  2094  199  69.8     100
2 Stockfish 310121  :    2970      3    3000  41.5  199  2094  707  69.8     ---

Games https://pixeldrain.com/u/p5tXmpi3

Re: Android engines testsThu Feb 25, 2021 6:03 am

Initial evaluation set to Critter 1.6a single core (arm5), 3002 elo.
Tablet - Lenovo android 4.4.2 - 32 bit - Quad Core (4x Cortex A7) - 1GB RAM - 1,3 GHz
GUI=c-chess-cli - Hash 8 mb - 1 core per engine - TC: 40sec+0.4sec - Book=noob_5moves.epd order=random
Concurrency 3 - Resign 600 cp

Code:

# PLAYER               :  RATING  ERROR  PLAYED   (%)     W    D     L  D(%)  CFS(%)
1 Stockfish 310121     :    3475     10    2000  72.5  1100  698   202  34.9      88
2 SugaR AI 1.40        :    3466     10    2000  71.1  1061  721   218  36.0     100
3 Critter 1.6a 32-bit  :    3002     14    2000   6.5    50  159  1791   8.0     ---

click :

Code:

Individual statistics:

1 Stockfish 310121    : 3475 2000 (+1100,=698,-202), 72.5 %

SugaR AI 1.40         : 1000 (+199,=630,-171), 51.4 %
Critter 1.6a 32-bit   : 1000 (+901,= 68,- 31), 93.5 %

2 SugaR AI 1.40       : 3466 2000 (+1061,=721,-218), 71.1 %

Stockfish 310121      : 1000 (+171,=630,-199), 48.6 %
Critter 1.6a 32-bit   : 1000 (+890,= 91,- 19), 93.5 %

3 Critter 1.6a 32-bit : 3002 2000 (+ 50,=159,-1791),  6.5 %

SugaR AI 1.40         : 1000 (+ 19,= 91,-890),  6.5 %
Stockfish 310121      : 1000 (+ 31,= 68,-901),  6.5 %

Code:

Games        : 3000 (finished)

White Wins   : 1130 (37.7 %)
Black Wins   : 1081 (36.0 %)
Draws        : 789 (26.3 %)
Unfinished   : 0

White Score  : 50.8 %
Black Score  : 49.2 %

Games https://pixeldrain.com/u/Lh5W2p5i

Re: Android engines testsThu Feb 25, 2021 6:06 am

Initial evaluation set to Critter 1.6a single core (arm5), 3002 elo.
Tablet - Lenovo android 4.4.2 - 32 bit - Quad Core (4x Cortex A7) - 1GB RAM - 1,3 GHz
GUI=c-chess-cli - Hash 8 mb - 1 core per engine - TC: 40sec+0.4sec - Book=noob_5moves.epd order=random
Concurrency 3 - Resign 600 cp

Code:

# PLAYER               :  RATING  ERROR  PLAYED   (%)     W     D     L  D(%)  CFS(%)
1 Ditto 1.0 NEON       :    3535      8    3600  68.3  1656  1607   337  44.6     100
2 Stockfish 13         :    3511      7    3600  64.8  1516  1630   454  45.3     100
3 SugaR AI 1.50        :    3492      8    3600  61.8  1422  1602   576  44.5     100
4 Critter 1.6a 32-bit  :    3002     15    3600   5.2    69   235  3296   6.5     ---

Spoiler :

Individual statistics:

1 Ditto 1.0 NEON : 3535 3600 (+1656,=1607,-337), 68.3 %

SugaR AI 1.50 : 1200 (+280,=771,-149), 55.5 %
Stockfish 13 : 1200 (+252,=775,-173), 53.3 %
Critter 1.6a 32-bit : 1200 (+1124,= 61,- 15), 96.2 %

2 Stockfish 13 : 3511 3600 (+1516,=1630,-454), 64.8 %

SugaR AI 1.50 : 1200 (+266,=756,-178), 53.7 %
Ditto 1.0 NEON : 1200 (+173,=775,-252), 46.7 %
Critter 1.6a 32-bit : 1200 (+1077,= 99,- 24), 93.9 %

3 SugaR AI 1.50 : 3492 3600 (+1422,=1602,-576), 61.8 %

Stockfish 13 : 1200 (+178,=756,-266), 46.3 %
Ditto 1.0 NEON : 1200 (+149,=771,-280), 44.5 %
Critter 1.6a 32-bit : 1200 (+1095,= 75,- 30), 94.4 %

4 Critter 1.6a 32-bit : 3002 3600 (+ 69,=235,-3296), 5.2 %

SugaR AI 1.50 : 1200 (+ 30,= 75,-1095), 5.6 %
Stockfish 13 : 1200 (+ 24,= 99,-1077), 6.1 %
Ditto 1.0 NEON : 1200 (+ 15,= 61,-1124), 3.8 %

Games : 7200 (finished)

White Wins : 2410 (33.5 %)
Black Wins : 2253 (31.3 %)
Draws : 2537 (35.2 %)
Unfinished : 0

White Score : 51.1 %
Black Score : 48.9 %

Games https://pixeldrain.com/u/QEheMGxa

Re: Android engines testsSun Feb 28, 2021 7:09 pm

Hmm.. 42 games ended by time forfeit = engine crash (most of them from Rustfish).

Spoiler :

Android engines tests B34bec87dcff5fe42183533797b58a9b

Initial evaluation 3000 elo.
Tablet - Lenovo android 4.4.2 - 32 bit - Quad Core (4x Cortex A7) - 1GB RAM - 1,3 GHz
GUI=c-chess-cli - Hash 8 mb - 1 core per engine - TC: 40sec+0.4sec - Book=noob_5moves.epd order=random
Concurrency 3 - Resign 600 cp

Code:

# PLAYER                    :  RATING  ERROR  PLAYED   (%)     W     D     L  D(%)  CFS(%)
1 Ditto 1.0 NEON            :    3115      6    3976  70.4  1959  1678   339  42.2     100
2 Stockfish 13              :    3071      6    3982  62.4  1628  1716   638  43.1     100
3 Rustfish 10-dev-201127    :    2814      7    3958  17.0   244   860  2854  21.7     ---

Code:

Individual statistics:

1 Ditto 1.0 NEON         : 3115 3976 (+1959,=1678,-339), 70.4 %

Rustfish 10-dev-201127   : 1976 (+1473,=411,- 92), 84.9 %
Stockfish 13             : 2000 (+486,=1267,-247), 56.0 %

2 Stockfish 13           : 3071 3982 (+1628,=1716,-638), 62.4 %

Rustfish 10-dev-201127   : 1982 (+1381,=449,-152), 81.0 %
Ditto 1.0 NEON           : 2000 (+247,=1267,-486), 44.0 %

3 Rustfish 10-dev-201127 : 2814 3958 (+244,=860,-2854), 17.0 %

Ditto 1.0 NEON           : 1976 (+ 92,=411,-1473), 15.1 %
Stockfish 13             : 1982 (+152,=449,-1381), 19.0 %

Games        : 5958 (finished)

White Wins   : 2014 (33.8 %)
Black Wins   : 1817 (30.5 %)
Draws        : 2127 (35.7 %)
Unfinished   : 0

White Score  : 51.7 %
Black Score  : 48.3 %

Games (cleaned 5958 games) https://pixeldrain.com/u/FFMgKX9t

Re: Android engines testsSun Feb 28, 2021 7:10 pm

Tablet - Teclast P80X_EEA (tPad, android 9) - 64bit - 2GB RAM - 8x Cortex-A55 - 1,6 GHz
GUI: CuteChess-cli / RR / 1 core per engine /TC: 60sec+0.6 / hash 16 / Book=TopGM_4moves.pgn - move order=sequential
/ repeat opening=yes / Concurrency=7 / Resignation=500cp

Code:

# PLAYER             :  RATING  ERROR  PLAYED   (%)     W     D     L  D(%)  CFS(%)
1 CF 030121 64       :    3024      3    6000  55.1  1046  4515   439  75.3     100
2 Ditto 1.0 64 NEON  :    3000      3    6000  49.9   736  4521   743  75.3     100
3 Stockfish 13       :    2976      3    6000  45.0   454  4492  1054  74.9     ---

Code:

Individual statistics:

1 CF 030121 64      : 3024 6000 (+1046,=4515,-439), 55.1 %

Stockfish 13        : 3000 (+579,=2243,-178), 56.7 %
Ditto 1.0 64 NEON   : 3000 (+467,=2272,-261), 53.4 %

2 Ditto 1.0 64 NEON : 3000 6000 (+736,=4521,-743), 49.9 %

CF 030121 64        : 3000 (+261,=2272,-467), 46.6 %
Stockfish 13        : 3000 (+475,=2249,-276), 53.3 %

3 Stockfish 13      : 2976 6000 (+454,=4492,-1054), 45.0 %

CF 030121 64        : 3000 (+178,=2243,-579), 43.3 %
Ditto 1.0 64 NEON   : 3000 (+276,=2249,-475), 46.7 %

Games        : 9000 (finished)

White Wins   : 1622 (18.0 %)
Black Wins   : 614 (6.8 %)
Draws        : 6764 (75.2 %)
Unfinished   : 0

White Score  : 55.6 %
Black Score  : 44.4 %

Games https://pixeldrain.com/u/Lz7CLbyE

Re: Android engines testsThu Mar 11, 2021 7:15 am

Tablet - Teclast P80X_EEA (tPad, android 9) - 64bit - 2GB RAM - 8x Cortex-A55 - 1,6 GHz
GUI: CuteChess-cli / RR / 1 core per engine /TC: 60sec+0.6 / hash 16 / Book=TopGM_4moves.pgn - move order=sequential
/ repeat opening=yes / Concurrency=7 / Resignation=500cp

Code:

# PLAYER              :  RATING  ERROR  PLAYED   (%)    W     D    L  D(%)  CFS(%)
1 Spider 1.1 64 NEON  :    3001      2    6000  50.2  661  4705  634  78.4      77
2 CF 030121 64        :    2999      2    6000  49.8  634  4705  661  78.4     ---

Games https://pixeldrain.com/u/55QtU4C3

Re: Android engines testsSat Mar 20, 2021 10:20 pm

Tablet - Teclast P80X_EEA (tPad, android 9) - 64bit - 2GB RAM - 8x Cortex-A55 - 1,6 GHz
GUI: CuteChess-cli / RR / 1 core per engine /TC: 60sec+0.6 / hash 16 / Book=TopGM_4moves.pgn - move order=sequential
/ repeat opening=yes / Concurrency=7 / Resignation=500cp

Code:

# PLAYER               :  RATING  ERROR  PLAYED   (%)    W     D    L  D(%)  CFS(%)
1 Spider 1.1a 64 NEON  :    3002      2    6000  50.5  712  4636  652  77.3      94
2 CF 030121 64         :    2998      2    6000  49.5  652  4636  712  77.3     ---

Games https://pixeldrain.com/u/akZDAySp

Re: Android engines testsSat Mar 20, 2021 11:16 pm

Great, great engine tests. Thank.

Re: Android engines testsWed Apr 07, 2021 7:19 pm

To be more precise, plus 1.4 elo for the last Cfish.
Tablet - Teclast P80X_EEA (tPad, android 9) - 64bit - 2GB RAM - 8x Cortex-A55 - 1,6 GHz
GUI: CuteChess-cli / RR / 1 core per engine /TC: 60sec+0.6 / hash 16 / Book=TopGM_4moves.pgn - move order=sequential
/ repeat opening=yes / Concurrency=7 / Resignation=500cp

Code:

# PLAYER             :  RATING  ERROR  PLAYED   (%)    W     D    L  D(%)  CFS(%)
1 CF 030421 64 NEON  :    3001      2    6000  50.3  689  4653  658  77.5      79
2 CF 030121 64       :    2999      2    6000  49.7  658  4653  689  77.5     ---

Games https://pixeldrain.com/u/DMv5dLEM

Re: Android engines testsFri Apr 16, 2021 5:17 am

Initial evaluation set to Critter 3082 elo at 4 cores.
Tablet - Lenovo android 4.4.2 - 32 bit - Quad Core (4x Cortex A7) - 1GB RAM - 1,3 GHz
GUI=Cfa - Hash 64 mb - 4 cores per engine - TC: 2min+1sec - Book=8_moves.pgn - Resign 600 cp

Code:

# PLAYER                :  RATING  ERROR  PLAYED   (%)    W    D    L  D(%)  CFS(%)
1 Stockfish 060421      :    3780     36     240  74.4  124  109    7  45.4      63
2 Bluefish NNUE 100321  :    3776     37     240  73.8  123  108    9  45.0     100
3 Critter 1.6a 32-bit   :    3082     69     240   1.9    0    9  231   3.8     ---

Games https://pixeldrain.com/u/C4JaJd2D

Re: Android engines testsFri Apr 16, 2021 2:40 pm

Initial evaluation set to Critter 3082 elo at 4 cores.
Tablet - Lenovo android 4.4.2 - 32 bit - Quad Core (4x Cortex A7) - 1GB RAM - 1,3 GHz
GUI=Cfa - Hash 64 mb - 4 cores per engine - TC: 2min+1sec - Book=8_moves.pgn - Resign 600 cp

Code:

# PLAYER               :  RATING  ERROR  PLAYED   (%)    W    D    L  D(%)  CFS(%)
1 Igel 3.0.0 CUSTOM    :    3272     25     120  74.6   75   29   16  24.2     100
2 Critter 1.6a 32-bit  :    3082     25     120  25.4   16   29   75  24.2     ---

Games https://pixeldrain.com/u/zonPR5Fg

Re: Android engines testsFri Apr 16, 2021 3:38 pm

Skynet wrote:

Tablet - Teclast P80X_EEA (tPad, android 9) - 64bit - 2GB RAM - 8x Cortex-A55 - 1,6 GHz
GUI: CuteChess-cli / RR / 1 core per engine /TC: 60sec+0.6 / hash 16 / Book=TopGM_4moves.pgn - move order=sequential
/ repeat opening=yes / Concurrency=7 / Resignation=500cp
Code:
# PLAYER : RATING ERROR PLAYED (%) W D L D(%) CFS(%) 1 Spider 1.1a 64 NEON : 3002 2 6000 50.5 712 4636 652 77.3 94 2 CF 030121 64 : 2998 2 6000 49.5 652 4636 712 77.3 ---

Spider 1.1a +60 wins over CF 030121
CF 110421 +79 wins over CF 030121.

Code:

# PLAYER              :  RATING  ERROR  PLAYED   (%)    W     D    L  D(%)  CFS(%)
1 CF 110421 64 NEON   :    3002      2    6000  50.7  709  4661  630  77.7      98
2 CF 030121 64        :    2998      2    6000  49.3  630  4661  709  77.7     ---

Games https://pixeldrain.com/u/SaWW81q9

Re: Android engines testsSun Apr 18, 2021 7:30 pm

Darn, I think I jinxed this network, perhaps this network is better for longer time control.
Tablet - Teclast P80X_EEA (tPad, android 9) - 64bit - 2GB RAM - 8x Cortex-A55 - 1,6 GHz
GUI: CuteChess-cli / RR / 1 core per engine /TC: 60sec+0.6 / hash 16 / Book=TopGM_4moves.pgn - move order=sequential
/ repeat opening=yes / Concurrency=7 / Resignation=500cp

Code:

# PLAYER              :  RATING  ERROR  PLAYED   (%)    W     D    L  D(%)  CFS(%)
1 CF 110421a 64 NEON  :    3001      2    6000  50.3  707  4627  666  77.1      86
2 CF 030121 64        :    2999      2    6000  49.7  666  4627  707  77.1     ---

Games https://pixeldrain.com/u/RjZNfVGm

Re: Android engines testsTue Apr 20, 2021 6:54 pm

Initial evaluation set to Critter 3082 elo at 4 cores.
Tablet - Lenovo android 4.4.2 - 32 bit - Quad Core (4x Cortex A7) - 1GB RAM - 1,3 GHz
GUI=Cfa - Hash 64 mb - 4 cores per engine - TC: 2min+1sec - Book=8_moves.pgn - Resign 600 cp

Code:

# PLAYER                    :  RATING  ERROR  PLAYED   (%)    W    D    L  D(%)  CFS(%)
1 Laser 1.8 beta            :    3271     24     240  69.2  118   96   26  40.0     100
2 Arasan 22.2-dev-210323    :    3172     22     240  49.4   62  113   65  47.1     100
3 Critter 1.6a 32-bit       :    3082     21     240  31.5   20  111  109  46.3     ---

Games https://pixeldrain.com/u/kyNTqroq

Re: Android engines testsTue Apr 20, 2021 6:54 pm

Initial evaluation set to Critter 3082 elo at 4 cores.
Tablet - Lenovo android 4.4.2 - 32 bit - Quad Core (4x Cortex A7) - 1GB RAM - 1,3 GHz
GUI=Cfa - Hash 64 mb - 4 cores per engine - TC: 2min+1sec - Book=8_moves.pgn - Resign 600 cp

Code:

# PLAYER                   :  RATING  ERROR  PLAYED   (%)    W    D    L  D(%)  CFS(%)
1 Xiphos 0.6.1-dev-210310  :    3337     63     240  90.2  200   33    7  13.8     100
2 Critter 1.6a 32-bit      :    3082     53     240  59.6  126   34   80  14.2     100
3 CT800 V1.42 32 bit       :    2074    104     240   0.2    0    1  239   0.4     ---

Games https://pixeldrain.com/u/pzQgyKwC

Re: Android engines testsTue Apr 20, 2021 6:56 pm

Initial evaluation set to Critter 3082 elo at 4 cores. Fire compiled by Leo.
Tablet - Lenovo android 4.4.2 - 32 bit - Quad Core (4x Cortex A7) - 1GB RAM - 1,3 GHz
GUI=Cfa - Hash 64 mb - 4 cores per engine - TC: 2min+1sec - Book=8_moves.pgn - Resign 600 cp

Code:

# PLAYER                   :  RATING  ERROR  PLAYED   (%)    W    D    L  D(%)  CFS(%)
1 Fire 8.1 x64 popcnt      :    3407     20     400  71.5  225  122   53  30.5     100
2 Xiphos 0.6.1-dev-210310  :    3359     19     400  63.0  175  154   71  38.5     100
3 Critter 1.6a 32-bit      :    3082     24     400  15.5   14   96  290  24.0     ---

Code:

Individual statistics:

1 Fire 8.1 x64 popcnt      : 3407 400 (+225,=122,- 53), 71.5 %

Critter 1.6a 32-bit        : 200 (+159,= 32,-  9), 87.5 %
Xiphos 0.6.1-dev-210310    : 200 (+ 66,= 90,- 44), 55.5 %

2 Xiphos 0.6.1-dev-210310  : 3359 400 (+175,=154,- 71), 63.0 %

Critter 1.6a 32-bit        : 200 (+131,= 64,-  5), 81.5 %
Fire 8.1 x64 popcnt        : 200 (+ 44,= 90,- 66), 44.5 %

3 Critter 1.6a 32-bit      : 3082 400 (+ 14,= 96,-290), 15.5 %

Xiphos 0.6.1-dev-210310    : 200 (+  5,= 64,-131), 18.5 %
Fire 8.1 x64 popcnt        : 200 (+  9,= 32,-159), 12.5 %

Code:

Games        : 600 (finished)

White Wins   : 229 (38.2 %)
Black Wins   : 185 (30.8 %)
Draws        : 186 (31.0 %)
Unfinished   : 0

White Score  : 53.7 %
Black Score  : 46.3 %

Games https://pixeldrain.com/u/fuiBr8mN

Re: Android engines testsTue Apr 27, 2021 10:25 pm

@ChessFan1 wrote:

Skynet wrote:

Tablet - Teclast P80X_EEA (tPad, android 9) - 64bit - 2GB RAM - 8x Cortex-A55 - 1,6 GHz
GUI: CuteChess-cli / RR / 1 core per engine /TC: 60sec+0.6 / hash 16 / Book=TopGM_4moves.pgn - move order=sequential
/ repeat opening=yes / Concurrency=7 / Resignation=500cp
Code:
# PLAYER : RATING ERROR PLAYED (%) W D L D(%) CFS(%) 1 Spider 1.1a 64 NEON : 3002 2 6000 50.5 712 4636 652 77.3 94 2 CF 030121 64 : 2998 2 6000 49.5 652 4636 712 77.3 ---

Spider 1.1a +60 wins over CF 030121
CF 110421 +79 wins over CF 030121.
Code:
# PLAYER : RATING ERROR PLAYED (%) W D L D(%) CFS(%) 1 CF 110421 64 NEON : 3002 2 6000 50.7 709 4661 630 77.7 98 2 CF 030121 64 : 2998 2 6000 49.3 630 4661 709 77.7 ---

+133 games over CF 030121.
Android engines tests 10653ab77789e5d03bd1c13aaeca9151

Spoiler :

Code:

Games        :   6000 (finished)

White Wins   :   1010 (16.8 %)
Black Wins   :    321 ( 5.3 %)
Draws        :   4669 (77.8 %)
Unfinished   :      0

White Perf.  : 55.7 %
Black Perf.  : 44.3 %

ECO A =   1968 Games (32.8 %)
ECO B =   1138 Games (19.0 %)
ECO C =   1112 Games (18.5 %)
ECO D =    608 Games (10.1 %)
ECO E =   1174 Games (19.6 %)

1 Spider 1.1b 64 NEON       : 3304  6000 (+732,=4669,-599), 51.1 %

CF 030121 64                  : 6000 (+732,=4669,-599), 51.1 %

2 CF 030121 64              : 3296  6000 (+599,=4669,-732), 48.9 %

Spider 1.1b 64 NEON           : 6000 (+599,=4669,-732), 48.9 %

GAMES https://pixeldrain.com/u/a4Qw83dm

Coming soon.

Re: Android engines testsThu Apr 29, 2021 4:09 pm

Looks like network nn-0e698aa9eb8b.nnue is not that good as some people think. popcorm1
Tablet - Teclast P80X_EEA (tPad, android 9) - 64bit - 2GB RAM - 8x Cortex-A55 - 1,6 GHz
GUI: CuteChess-cli / RR / 1 core per engine /TC: 60sec+0.6 / hash 16 / Book=TopGM_4moves.pgn - move order=sequential
/ repeat opening=yes / Concurrency=7 / Resignation=500cp
Android engines tests E820b325719e432af185ac576d8cf95a

Android engines tests E820b325719e432af185ac576d8cf95a

Games https://pixeldrain.com/u/pZuDy7sr

Re: Android engines testsThu Apr 29, 2021 4:11 pm

Initial evaluation set to Critter 3082 elo at 4 cores.
Tablet - Lenovo android 4.4.2 - 32 bit - Quad Core (4x Cortex A7) - 1GB RAM - 1,3 GHz
GUI=Cfa - Hash 64 mb - 4 cores per engine - TC: 2min+1sec - Book=8_moves.pgn - Resign 600 cp

Code:

# PLAYER               :  RATING  ERROR  PLAYED   (%)    W    D    L  D(%)  CFS(%)
1 Komodo 13.1 32-bit   :    3455     25     400  88.1  311   83    6  20.8     100
2 Chiron 4             :    3117     22     400  33.9   72  127  201  31.8      98
3 Critter 1.6a 32-bit  :    3082     18     400  28.0   50  124  226  31.0     ---

Another test.
So, it looks like Komodo's range is about ~3441 (+/-).

Code:

# PLAYER                  :  RATING  ERROR  PLAYED   (%)    W    D    L  D(%)  CFS(%)
1 Raubfisch X44f1_nn_sl   :    3672     30     400  88.3  310   86    4  21.5     100
2 Komodo 13.1 32-bit      :    3428     22     400  53.9  161  109  130  27.3     100
3 Critter 1.6a 32-bit     :    3082     28     400   7.9    2   59  339  14.8     ---

Code:

Individual statistics:

1 Raubfisch X44f1_nn_sl : 3672 400 (+310,= 86,-  4), 88.3 %

Komodo 13.1 32-bit      : 200 (+129,= 68,-  3), 81.5 %
Critter 1.6a 32-bit     : 200 (+181,= 18,-  1), 95.0 %

2 Komodo 13.1 32-bit    : 3428 400 (+161,=109,-130), 53.9 %

Critter 1.6a 32-bit     : 200 (+158,= 41,-  1), 89.3 %
Raubfisch X44f1_nn_sl   : 200 (+  3,= 68,-129), 18.5 %

3 Critter 1.6a 32-bit   : 3082 400 (+  2,= 59,-339),  7.9 %

Komodo 13.1 32-bit      : 200 (+  1,= 41,-158), 10.8 %
Raubfisch X44f1_nn_sl   : 200 (+  1,= 18,-181),  5.0 %

Code:

Games        : 600 (finished)

White Wins   : 248 (41.3 %)
Black Wins   : 225 (37.5 %)
Draws        : 127 (21.2 %)
Unfinished   : 0

White Score  : 51.9 %
Black Score  : 48.1 %

Games https://pixeldrain.com/u/VziviC3S

Re: Android engines testsFri Apr 30, 2021 9:52 pm

Initial evaluation set to Critter 3082 elo at 4 cores.
Tablet - Lenovo android 4.4.2 - 32 bit - Quad Core (4x Cortex A7) - 1GB RAM - 1,3 GHz
GUI=Cfa - Hash 64 mb - 4 cores per engine - TC: 2min+1sec - Book=8_moves.pgn - Resign 600 cp

Code:

 # PLAYER               :  RATING  ERROR  PLAYED   (%)    W    D    L  D(%)  CFS(%)
1 ShashChess 16         :    3627     25     400  85.3  290  102    8  25.5     100
2 Fire 8.1              :    3433     18     400  56.5  171  110  119  27.5     100
3 Critter 1.6a 32-bit   :    3082     30     400   8.3    4   58  338  14.5     ---

Games https://pixeldrain.com/u/KdqduhEu

Re: Android engines testsSat May 01, 2021 11:45 pm

Tablet - Teclast P80X_EEA (tPad, android 9) - 64bit - 2GB RAM - 8x Cortex-A55 - 1,6 GHz
GUI: CuteChess-cli / RR / 1 core per engine /TC: 60sec+0.6 / hash 16 / Book=TopGM_4moves.pgn - move order=sequential
/ repeat opening=yes / Concurrency=7 / Resignation=500cp
Android engines tests 7e1417d04fc0c5f6e743b7b454380db6

Android engines tests 7e1417d04fc0c5f6e743b7b454380db6

Games https://pixeldrain.com/u/3UCxHaC8

Re: Android engines testsSun May 02, 2021 8:16 pm

Finally, the long-awaited moment of truth has come. Komodo's butt was kicked by 2 (non NNUE) engines.

Initial evaluation set to Komodo 13.1 3440 elo at 4 cores.
Tablet - Lenovo android 4.4.2 - 32 bit - Quad Core (4x Cortex A7) - 1GB RAM - 1,3 GHz
GUI=Cfa - Hash 64 mb - 4 cores per engine - TC: 2min+1sec - Book=8_moves.pgn - Resign 600 cp

Code:

# PLAYER               :  RATING  ERROR  PLAYED   (%)    W    D    L  D(%)  CFS(%)
1 Houdini 6.03         :    3485     16     400  54.0  112  208   80  52.0      79
2 Fire 8.11            :    3473     16     400  51.5  101  210   89  52.5      99
3 Komodo 13.1 32-bit   :    3440     15     400  44.5   83  190  127  47.5     ---

Games https://pixeldrain.com/u/ayCVP7X6

Re: Android engines testsMon May 03, 2021 7:54 pm

CF vs clones and SF..
Tablet - Teclast P80X_EEA (tPad, android 9) - 64bit - 2GB RAM - 8x Cortex-A55 - 1,6 GHz
GUI: CuteChess-cli / RR / 1 core per engine /TC: 60sec+0.6 / hash 16 / Book=TopGM_4moves.pgn - move order=sequential
/ repeat opening=yes / Concurrency=7 / Resignation=500cp

Code:

# PLAYER              :  RATING  ERROR  PLAYED   (%)    W     D    L  D(%)  CFS(%)
1 CF 030121 64        :    3032      5    3000  56.0  572  2213  215  73.8     100
2 Precision           :    2991      4    3000  48.3  341  2214  445  73.8      70
3 Legendary the 2nd   :    2989      4    3000  47.9  317  2241  442  74.7      53
4 Stockfish 240421    :    2989      5    3000  47.9  319  2234  447  74.5     ---

Spoiler :

Code:

Individual statistics:

1 CF 030121 64      : 3032 3000 (+572,=2213,-215), 56.0 %

Legendary the 2nd   : 1000 (+189,=741,- 70), 56.0 %
Stockfish 240421    : 1000 (+200,=725,- 75), 56.3 %
Precision           : 1000 (+183,=747,- 70), 55.6 %

2 Precision         : 2991 3000 (+341,=2214,-445), 48.3 %

Legendary the 2nd   : 1000 (+134,=729,-137), 49.9 %
Stockfish 240421    : 1000 (+137,=738,-125), 50.6 %
CF 030121 64        : 1000 (+ 70,=747,-183), 44.4 %

3 Legendary the 2nd : 2989 3000 (+317,=2241,-442), 47.9 %

Stockfish 240421    : 1000 (+110,=771,-119), 49.5 %
Precision           : 1000 (+137,=729,-134), 50.1 %
CF 030121 64        : 1000 (+ 70,=741,-189), 44.0 %

4 Stockfish 240421  : 2989 3000 (+319,=2234,-447), 47.9 %

Legendary the 2nd   : 1000 (+119,=771,-110), 50.5 %
Precision           : 1000 (+125,=738,-137), 49.4 %
CF 030121 64        : 1000 (+ 75,=725,-200), 43.8 %

Games        : 6000 (finished)

White Wins   : 1010 (16.8 %)
Black Wins   : 539 (9.0 %)
Draws        : 4451 (74.2 %)
Unfinished   : 0

White Score  : 53.9 %
Black Score  : 46.1 %

Games https://pixeldrain.com/u/fQWqEaNH

Re: Android engines testsTue May 04, 2021 10:35 pm

The last RDM's version on android also didn't go so well, test was aborted.
Tablet - Teclast P80X_EEA (tPad, android 9) - 64bit - 2GB RAM - 8x Cortex-A55 - 1,6 GHz
GUI: CuteChess-cli / RR / 1 core per engine /TC: 60sec+0.6 / hash 16 / Book=TopGM_4moves.pgn - move order=sequential
/ repeat opening=yes / Concurrency=7 / Resignation=500cp

Code:

# PLAYER               :  RATING  ERROR  PLAYED   (%)    W     D    L  D(%)  CFS(%)
1 CF 020521 64 NEON    :    3000      2    3694  50.1  413  2878  403  77.9      65
2 CF 030121 64         :    3000      2    3694  49.9  403  2878  413  77.9     ---

Games https://pixeldrain.com/u/vt5exFAU

Re: Android engines testsWed May 05, 2021 2:44 pm

@ChessFan1 wrote:

Finally, the long-awaited moment of truth has come. Komodo's butt was kicked by 2 (non NNUE) engines.
Initial evaluation set to Komodo 13.1 3440 elo at 4 cores.
Tablet - Lenovo android 4.4.2 - 32 bit - Quad Core (4x Cortex A7) - 1GB RAM - 1,3 GHz
GUI=Cfa - Hash 64 mb - 4 cores per engine - TC: 2min+1sec - Book=8_moves.pgn - Resign 600 cp
Code:
# PLAYER : RATING ERROR PLAYED (%) W D L D(%) CFS(%) 1 Houdini 6.03 : 3485 16 400 54.0 112 208 80 52.0 79 2 Fire 8.11 : 3473 16 400 51.5 101 210 89 52.5 99 3 Komodo 13.1 32-bit : 3440 15 400 44.5 83 190 127 47.5 ---

Games https://pixeldrain.com/u/ayCVP7X6

Initial evaluation set to Komodo 13.1 (3440 elo at 4 cores).
Second test, book TCEC 17-18 (100 positions). Houdini's elo is about ~3498 (+/-7 elo) on 32 bit with 4 cores.

Code:

# PLAYER               :  RATING  ERROR  PLAYED   (%)    W    D    L  D(%)  CFS(%)
1 Houdini 6.03         :    3526     20     400  58.6  145  179   76  44.8      99
2 Fire 8.11            :    3487     17     400  50.6  121  163  116  40.8     100
3 Komodo 13.1 32-bit   :    3440     18     400  40.8   84  158  158  39.5     ---

Spoiler :

Code:

Individual statistics:

1 Houdini 6.03        : 3526 400 (+145,=179,- 76), 58.6 %

Komodo 13.1 32-bit    : 200 (+ 79,= 87,- 34), 61.3 %
Fire 8.11             : 200 (+ 66,= 92,- 42), 56.0 %

2 Fire 8.11           : 3487 400 (+121,=163,-116), 50.6 %

Komodo 13.1 32-bit    : 200 (+ 79,= 71,- 50), 57.3 %
Houdini 6.03          : 200 (+ 42,= 92,- 66), 44.0 %

3 Komodo 13.1 32-bit  : 3440 400 (+ 84,=158,-158), 40.8 %

Houdini 6.03          : 200 (+ 34,= 87,- 79), 38.8 %
Fire 8.11             : 200 (+ 50,= 71,- 79), 42.8 %

Code:

Games        : 600 (finished)

White Wins   : 205 (34.2 %)
Black Wins   : 145 (24.2 %)
Draws        : 250 (41.7 %)
Unfinished   : 0

White Score  : 55.0 %
Black Score  : 45.0 %

Games https://pixeldrain.com/u/TYLKYhg6

Android engines tests

descriptionAndroid engines testsThu Feb 25, 2021 5:57 am

descriptionRe: Android engines testsThu Feb 25, 2021 6:03 am

descriptionRe: Android engines testsThu Feb 25, 2021 6:06 am

descriptionRe: Android engines testsSun Feb 28, 2021 7:09 pm

descriptionRe: Android engines testsSun Feb 28, 2021 7:10 pm

descriptionRe: Android engines testsThu Mar 11, 2021 7:15 am

descriptionRe: Android engines testsSat Mar 20, 2021 10:20 pm

descriptionRe: Android engines testsSat Mar 20, 2021 11:16 pm

descriptionRe: Android engines testsWed Apr 07, 2021 7:19 pm

descriptionRe: Android engines testsFri Apr 16, 2021 5:17 am

descriptionRe: Android engines testsFri Apr 16, 2021 2:40 pm

descriptionRe: Android engines testsFri Apr 16, 2021 3:38 pm

descriptionRe: Android engines testsSun Apr 18, 2021 7:30 pm

descriptionRe: Android engines testsTue Apr 20, 2021 6:54 pm

descriptionRe: Android engines testsTue Apr 20, 2021 6:54 pm

descriptionRe: Android engines testsTue Apr 20, 2021 6:56 pm

descriptionRe: Android engines testsTue Apr 27, 2021 10:25 pm

descriptionRe: Android engines testsThu Apr 29, 2021 4:09 pm

descriptionRe: Android engines testsThu Apr 29, 2021 4:11 pm

descriptionRe: Android engines testsFri Apr 30, 2021 9:52 pm

descriptionRe: Android engines testsSat May 01, 2021 11:45 pm

descriptionRe: Android engines testsSun May 02, 2021 8:16 pm

descriptionRe: Android engines testsMon May 03, 2021 7:54 pm

descriptionRe: Android engines testsTue May 04, 2021 10:35 pm

descriptionRe: Android engines testsWed May 05, 2021 2:44 pm

descriptionRe: Android engines tests