Sun releases new SPECjAppServer2004 benchmark using completely free and open source software
By tomdaly on May 26, 2006
Sun has just posted a new SPECjAppServer2004 result of 712.87 SPECjAppServer2004 JOPS using a totally open source software stack. Just to make this clear , the application server is open source, the operating system is open source and the database is open source. The hardware is 4 \* SunFire X4100 dual cpu dual core servers (i.e. each server has 4 cores, see the diag below). You can find the benchmark result and all the configuration details on the SPEC site here
It is an all open source result and a good demonstration of how to use open source to put together a system capable of running > 5000 simulated web application users for around $US 52K (which is basically the hardware cost as the software is all free)
It demonstrates the scalability and performance of the free and open source Sun Application Server 9.0 (a.k.a project Glassfish).
It demonstrates that a 4 core SunFire X4100 server running Solaris 10 and MySQL 5 can support > 5000 concurrent web users !
So why do I care about SPECjAppServer2004 ?
Because there is probably something in the workload that can be related to your business
The SPECjAppServer2004 workload is designed to model a typical modern end to end web based application. The workload has several distinct domains which feature complex and different business transactions. The âcustomerâ domain has logic which performs on line order entry with credit check, the Manufacturing domain models a just in time manufacturing operation and the Supplier domain performs inventory management and supply chain functions including xml calls to external simulated suppliers.
If this isn't relating to your business yet then consider that the benchmark itself simulates concurrent on line users connecting to and using the application , these users connect both via HTTP and RMI. In the just released Sun 712.87 JOPS result there were > 5600 simulated concurrent users running against the appplication for the entire measurement period of 1 hour. [You can approximate the simulated users by looking at the benchmark result http=dealer injection rate \* 10 + rmi =dealer injection rate \* 3 ]
Also, all of the transactions are persisted to the relational database and from the perspective of the database the entire application looks like a very heavy and highly contended OLTP workload, which makes SPECjAppServer2004 a very interesting tool to test and tune relational database performance!
Because Sun and other companies are using SPECjAppServer20004 to improve the performance of your application
If the application(s) your company uses or develops need a J2EE or J EE 5.0 application server or perhaps JDBC to connect to a relational database or if it uses java or runs on the web then it is quite likely that the work Sun (and others) are doing with SPECjAppServer2004 is going to bring performance benefits to you. In general the way you take advantage of these benefits is to use the latest version of the infrastructure product, for example a (free) upgrade to the Sun application server 9 may give you significant performance improvement in your system with no change to your application. In fact in our testing we saw a measured increase in performance with SPECjAppServer2004 over equivalent tests with Sun application Server 8.1 and again this is with no changes to the application.
Because Sun is using SPECjAppServer2004 to demonstrate how you can save money !
By utilising the SPECjAppServer2004 benchmark in conjunction with a completely open source software âstackâ and by working with prominent open source providers like MySQL (www.mysql.org) Sun is demonstrating the reliability and enterprise readiness of open source software and is giving web application developers and deployers a good example of how to save money on IT infrastructure. For a good discussion on the price benefits of the open source Sun SPECjAppServer2004 result have a look at Robert Lee's blog However I encourage you also to check out the price of the system yourself, have a look at the âBill of Materialsâ listed in the benchmark result at http://www.spec.org/jAppServer2004/results/res2006q2/jAppServer2004-20060509-00029.html , you can see the part numbers and complete system specifications of what was used then you can go to www.sun.com and price the components and you can check for yourself that the total acquisition cost of the system which supports > 5000 simulated users is around $US 52K !
Pointers and Resources :
There is a lot of very good tuning information on the âfull disclosure reportâ of the benchmark, you can also see all of the configuration information by downloading the âfull disclosure archiveâ.
Check out www.opensolaris.com for details on the open source Solaris operating system
For Sun Application Server 9.0 go to the project Glassfish site at http://glassfish.dev.java.net
System Diagram (also available as part of the benchmark full disclosure archive)
Required Disclosure Statement:
SPECjAppServer2004 3x Sun Fire X4100 appservers (12 cores, 6 chips) and 1 Sun Fire X4100 database (4 cores, 2 chips) 712.87 SPECjAppServer2004 JOPS@Standard. SPECjAppServer 2004 3x Sun Fire V20z appservers (6 cores, 6 chips) and 1 Sun Fire V20z database (2 cores, 2 chips) 266.01 SPECjAppServer2004 JOPS@Standard. All results from www.spec.org as of 05/25/06. SPEC, SPECjAppServer reg tm of Standard Performance Evaluation Corporation