Phoronix Test Suite

Phoronix Test Suite (PTS) is a free and open-source benchmark software for Linux and other operating systems which is developed by Michael Larabel and Matthew Tippett. The Phoronix Test Suite has been endorsed by sites such as Linux.com,[2] LinuxPlanet[3] and has been called "the best benchmarking platform" by Softpedia.[4] The Phoronix Test Suite is also used by Tom's Hardware,[5] ASELabs[6] and other review sites.

Phoronix Test Suite
Phoronix Test Suite 2.0.0 running on GNU/Linux
Developer(s)Michael Larabel, Matthew Tippett
Initial releaseApril 2008
Stable release
9.6.1[1] / May 25, 2020 (2020-05-25)
Preview release
9.8.0 M2[1] / June 24, 2020 (2020-06-24)
Written inPHP
Operating systemLinux, FreeBSD, OpenBSD, NetBSD, OpenSolaris, Mac OS X, Windows
Size703 kB (base program)
Available inEnglish
TypeBenchmark
LicenseGNU General Public License v3
Websitephoronix-test-suite.com

Features
  • Supports over 220 test profiles and over 60 test suites;
  • Uses an XML-based testing architecture. Tests include MEncoder, FFmpeg and lm sensors along with OpenGL games such as Doom 3, Nexuiz, and Enemy Territory: Quake Wars, and many others;[7]
  • Contains a feature called PTS Global where users are able to upload their test results and system information for sharing. Then through executing a single command, other users can compare their test results to a selected system in an easy-comparison mode;[8]
  • Allow report benchmark results to the Phoronix Global online database;
  • Allow compare results side-by-side;
  • Is extensible and new tests can be added easily;
  • Can do anonymous usage reporting;
  • Can do automated Git bisecting on a performance basis to find performance regressions. It features statistical significance verification.

Components

Phoromatic

Phoromatic is a web-based remote test management system for the Phoronix Test Suite. It does automatic scheduling of tests. It is aimed at the enterprise. It can manage multiple test nodes simultaneously within a test farm or distributed environment.

Phoromatic Tracker

Phoromatic Tracker is an extension of Phoromatic that provides a public interface into test farms.[9] Currently their reference implementations autonomously monitor the performance of the Linux kernel on a daily basis,[10] Fedora Rawhide[11] and Ubuntu.[12]

PTS Desktop Live

PTS Desktop Live was a stripped down x86-64 Linux distribution, which included Phoronix Test Suite 2.4. It was designed for testing/benchmarking computers from a LiveDVD / LiveUSB environment.[13]

Phodevi

Phodevi (Phoronix Device Interface) is a library that provides a clean, stable, platform-independent API for accessing software and hardware information.

PCQS

Phoronix Certification & Qualification Suite (PCQS) is a reference specification for the Phoronix Test Suite.

Phoronix website
Phoronix
Phoronix logo and screenshot
Type of site
Review
Available inEnglish
Created byMichael Larabel
URLphoronix.com
CommercialYes
RegistrationRequired (for the forums)
LaunchedJune 5, 2004 (2004-06-05)
Current statusActive

Phoronix is a technology website that offers insights regarding the development of the Linux kernel, product reviews, interviews, and news regarding free and open-source software by monitoring the Linux kernel mailing list or interviews.

Phoronix was started in June 2004 by Michael Larabel, who currently serves as the owner and editor-in-chief.

History

Founded on 5 June 2004,[14] Phoronix started as a website with a handful of hardware reviews and guides,[15][16] moving to articles covering operating systems based on Linux and open source software around the start of 2005, such as Ubuntu, Fedora, SUSE[17] and Mozilla (Firefox/Thunderbird).[18] Phoronix heavily focuses on benchmarking hardware running Linux, with a heavy slant towards graphics articles that monitor and compare free and open-source graphics device drivers and Mesa 3D with AMD's and Nvidia's proprietary graphics device drivers. In June 2006 the website added forums in addition to news content.[19] On 20 April 2007, Phoronix redesigned its website,[20] and began Solaris hardware reviews and news in addition to Linux content.[21]

Phoronix benchmarks have been cited by a number of other technical publications such as CNET News[22][23] and Slashdot.[24]

OpenBenchmarking

OpenBenchmarking.org is a web-based service created to work with the Phoronix Test Suite. It is a collaborative platform that allows users to share their hardware and software benchmarks through an organized online interface.[25]

Release history
Version Codename Date
1.0 Trondheim 5 June 2008
1.2 Malvik 3 September 2008
1.4 Orkdal 3 November 2008
1.6 Tydal 20 January 2009
1.8 Selbu 6 April 2009
2.0 Sandtorg 4 August 2009
2.2 Bardu 16 November 2009
2.4 Lenvik 2 February 2010
2.6 Lyngen 24 May 2010
2.8 Torsken 31 August 2010
3.0 Iveland 26 February 2011
3.2 Grimstad 15 June 2011
3.4 Lillesand 8 September 2011
3.6 Arendal 13 December 2011
3.8 Bygland 19 March 2012
4.0 Suldal 23 July 2012
4.2 Randaberg 20 December 2012
4.4 Forsand 20 February 2013
4.6 Utsira 21 May 2013
4.8 Sokndal 13 August 2013
5.0 Plavsk 12 March 2014
5.2 Khanino 5 June 2014
5.4 Lipki 9 December 2014
5.6 Dedilovo 24 March 2015
6.0 Hammerfest 6 November 2015
6.2 Gamvik 16 February 2016
6.4 Hasvik 2 June 2016
7.0 Ringsaker 7 March 2017
8.0 Aremark 5 June 2018
8.8 Hvaler 13 May 2019
9.0 Asker 16 September 2019
9.2 Hurdal 3 December 2019
9.4 Vestby 23 February 2020

On 5 June 2008, Phoronix Test Suite 1.0 was released under the codename Trondheim.[26] This 1.0 release was made up of 57 test profiles and 23 test suites.[27]

On 3 September 2008, Phoronix Test Suite 1.2 was released with support for the OpenSolaris operating system[28] and a module framework accompanied by tests focusing upon new areas[29] and many new test profiles.

Phoronix Test Suite 1.8 includes a graphical user interface (GUI) using GTK+ written using the PHP-GTK bindings.

3.4 includes MATISK benchmarking module and initial support for the GNU Hurd.

Criticism

Phoronix uses Phoronix Test Suite to compare performance of different operating systems – Linux distributions, OpenSolaris, and FreeBSD. Critics of Phoronix Test Suite argue that some of the third-party tests are unfair towards some platforms.

The compiler used in building the source-based tests has a large impact on the results. Depending on the reader's point of view this is seen as a detriment to the value of the results. However other readers may see that as a realistic expectation of performance for that particular system with that operating system. PTS 3.8 reports compiler options and compiler differences between test runs.

See also

References
  1. "Release History", Phoronix Test Suite, retrieved 24 June 2020
  2. "Phoronix Test Suite brings Linux benchmarking to the desktop", Linux.com
  3. "Benchmarking Linux With the Phoronix Test Suite — Worth Taking a Look", LinuxPlanet (reports)
  4. The Best Benchmarking Platform: Phoronix Test Suite – Linux-based testing platform for software and hardware validation!, Softpedia
  5. AMD, Intel CPU Charts, tetberichte (in German), Tom's Hardware, archived from the original on 2012-09-14
  6. ASE labs
  7. "Suites", Phoronix Test Suite, archived from the original on 2008-06-09, retrieved 2008-06-06
  8. "Global Database", Phoronix Test Suite, archived from the original on 2008-07-23, retrieved 2008-07-03
  9. Phoromatic Tracker Launches To Monitor Linux Performance, Phoronix
  10. "Kernel Performance Tracker", Phoromatic
  11. "Fedora Rawhide Performance Tracker", Phoromatic, archived from the original on 2012-07-11
  12. "Ubuntu Performance Tracker", Phoromatic, archived from the original on 2010-04-15, retrieved 2010-05-04
  13. Announcing PTS Desktop Live 2009.3 "Gernlinden", Phoronix
  14. "Happy 5th Birthday, Phoronix!". Phoronix. 5 June 2009. Retrieved 2015-12-30.
  15. "Intel Celeron D". Phoronix. 13 November 2004. Retrieved 2015-12-30.
  16. "Camo Painting Case Guide". Phoronix. 13 July 2004. Retrieved 2015-12-30.
  17. "Operating Systems Archives". Phoronix. 25 March 2005. Retrieved 2015-12-30.
  18. "Software Archives". Phoronix. 21 February 2005. Retrieved 2015-12-30.
  19. "Forums Launch". Phoronix. 15 June 2006. Retrieved 2010-03-05.
  20. "Welcome To The New Phoronix". Phoronix. 20 April 2007. Retrieved 5 March 2010.
  21. "Phoronix To Support Solaris OS". Phoronix. 20 April 2007. Retrieved 5 March 2010.
  22. Shankland, Stephen. "New Linux look fuels old debate". News.com. Retrieved 5 March 2010.
  23. Shankland, Stephen. "Intel aims for open-source graphics advantage". News.com. Retrieved 5 March 2010.
  24. "The State of ATI Drivers on GNU/Linux". Linux. Slashdot. 20 July 2006. Retrieved 5 March 2010.
  25. "Features". OpenBenchmarking.org. Retrieved 2019-08-06.
  26. "Demystifying Codenames: Trondheim", Phoronix Test Suite, Phoronix
  27. News (press release), Yahoo!
  28. "Phoronix Test Suite 1.2 To Support OpenSolaris", trondheim-pts (mailing list), Jul 2008, archived from the original on 2011-07-15, retrieved 2008-07-14
  29. "Phoronix Test Suite brings Linux benchmarking to the desktop", Linux.com
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.