Not logged inCSS-Forum
Forum CSS-Online Help Search Login
CSS-Shop Impressum Datenschutz
Up Topic Hauptforen / CSS-Forum / Chess benchmark of Windows and Linux
- - By Orlando de la Vega Date 2011-01-03 14:08
Hi all,

I have made a little benchmark of four operating systems, using a UCI engine.
I made four tests for each of the different OS. In the first test I run Stockfish using one thread, in the second I run it with two threads, etc.
The benchmark is based on an infinite search of the engine during ten minutes, from the start position board.
Here is a description of the conditions of the benchmark.

Desktop computer used :
  AMD Phenom(TM) 9750 Quad-Core Processor 2.40 GHz
  2,00 Go DDR2
Engine used :
  Stockfish 1.9.1 JA
  512 Mo Hash
Opering systems tested :
  Windows 7 Ultimate
  Fedora 14 (Laughlin), GNOME 2.32.0
  Ubuntu 10.10 (Maverick), GNOME 2.32.0
  Suse Linux 11.3, GNOME 2.30.0


The first test, Stockfish 1.9.1 JA running with one thread :


On one core, Stockfish performed better on all the Linux distributions than Windows 7.
In fact, it showed an average of 677 Kn/s, with a maximum of 731 Kn/s at 21stsecond.
For Fedora 14 : average 755 Kn/s, maximum 815 Kn/s at 35ths.
For Ubuntu 10.10 : average 755 Kn/s, maximum 816 Kn/s at 34ths.
For Suse 11.3 : average 753 Kn/s, maximum 791 Kn/s at 35ths.

The second test, Stockfish 1.9.1 JA running with two threads :


On two cores, same result. Suse Linux has clearly distinguished itself from the other OS.
Windows 7 : average of 1355 Kn/s, with a maximum of 1442 Kn/s at 25ths.
Fedora 14 : average 1402 Kn/s, maximum 1556 Kn/s at 25ths.
Ubuntu 10.10 : average 1399 Kn/s, maximum 1520 Kn/s at 17ths.
Suse 11.3 : average 1444 Kn/s, maximum 1595 Kn/s at 19ths.

The third test, Stockfish 1.9.1 JA running with three threads :


On three cores, the results starts to be different. Windows shows now the best average, but strangely not the best maximum.
Windows 7 : average of 2113 Kn/s, with a maximum of 2177 Kn/s at 28ths.
Fedora 14 : average 2105 Kn/s, maximum 2263 Kn/s at 13ths.
Ubuntu 10.10 : average 2090 Kn/s, maximum 2273 Kn/s at 10ths.
Suse 11.3 : average 2088 Kn/s, maximum 2242 Kn/s at 13ths.

The last test, Stockfish 1.9.1 JA running with four threads :


On four cores, Ubuntu and Fedora stays behind Windows, which scored equal with Suse. Fedora showed the best maximum.
Windows 7 : average of 2740 Kn/s, with a maximum of 2798 Kn/s at 31sts.
Fedora 14 : average 2726 Kn/s, maximum 2930 Kn/s at 13ths.
Ubuntu 10.10 : average 2720 Kn/s, maximum 2860 Kn/s at 19ths.
Suse 11.3 : average 2741 Kn/s, maximum 2868 Kn/s at 8ths.

Conclusion : Windows 7 seems to better manage the multi-core than the Linux distribution, although it'll be difficult to explain why it always had the worst maximum Kn/s.

NB : I noticed on "average" the Kn/s showed by the engine at the end of the 10 minutes of analysis.

Best regards,
Orlando
Parent - - By Kurt Utzinger Date 2011-01-03 18:15
Hi Orlando
Interesting test. Have you used the Stockfish Linux version
for testing under Linux OS? Or did you let run Stockfish
with wine under Shredder GUI?
Regards
Kurt
Parent - - By Orlando de la Vega Date 2011-01-03 20:40
Hi Kurt,

No I didn't use Wine, I used the Linux version of Stockfish

Best,
Orlando
Parent - - By Kurt Utzinger Date 2011-01-03 20:47
[quote="Orlando de la Vega"]
Hi Kurt,

No I didn't use Wine, I used the Linux version of Stockfish

Best,
Orlando
[/quote]

Hi Orlando
And under what (Linux)-GUI have you made your tests?
Regards
Kurt
Parent - By Orlando de la Vega Date 2011-01-03 21:17
I made all the tests in console mode, and redirected the print into a file.
Parent - - By Austaller Gerhard Date 2011-01-04 11:30
Hi

Quite interesting, but I think one must be careful with conclusions:

1.) Figures 2-4 may mislead the spectator (because of scaling of the y-axis ). If y-axis starts with 0 as you did in figure 1 than the resulting figures show that there is practically no difference between the 4 systems. With the scaling you've done one my think there is a huge difference when you don't look at the absolute numbers.

2.) I used your numbers to draw a excel figure that shows a function  graph comparing nps depending on core number and system. With 2 cores Windows is worse than Linux, with 3 cores it's better and with 4 cores also better than Linux but difference to the Linux systems got smaller than it was with 3 cores. So one may think that the Windows  curve "flattens" faster than the Linux curves so that with 5 or 6 cores the Linux systems could be better again than Windows. Another conclusion could be that with more cores the difference to the Linux systems gets smaller but Windows still stays ahead...

VG
Gerhard
Parent - By Orlando de la Vega Date 2011-01-04 12:16
Hi Austaller,

Thanks for the comments. The "zooming" done in the figures 2-4 gives the impression of a greater difference from the first. You are right !
Given the results, I also think that using all the processors of a computer, the results will be very close.

Best,
Orlando
Up Topic Hauptforen / CSS-Forum / Chess benchmark of Windows and Linux

Powered by mwForum 2.29.3 © 1999-2014 Markus Wichitill