Friday Apr 24, 2009

GF + MySQL + Nehalem = 2925.18 JOPS

ALT DESCR

We have published a new SPECjAppServer 2004 result: 2925.18 JOPS@Standard. Total list price for the configuration, software and hardware together, is $78,834.00, yielding $26.95 per $/JOPS (or, if you are brave enough to go without support, $13.29).

The setup includes GlassFish v2.1 and MySQL 5.1.30 and Sun Fire X2270 and Sun Fire X4170 (both Nehalem-based). Full details in the entries by Madhu, Tom, Kevin and Jennifer.

This is an outstanding result. As Tom describes it:

To give some idea of the actual performance , this configuration of 2 x 8 Core servers and open source , supports a virtual concurrent user load of more than 22,750 web application virtual users and uses > 800 connections to the MySQL 5.1.30 via the Glassfish connection pools!

And this is without the substantial additional improvements from MySQL 5.4, which was not yet available! Stay tuned for further improvements.

The required Disclosure Statement:
SPEC and SPECjAppServer are registered trademarks of Standard Performance Evaluation Corporation. Results from www.spec.org as of 04/20/2009.
Sun GlassFish Enterprise Server v2.1 on Sun Fire X2270 with MySQL 5.1 on OpenSolaris 2008.11. Application Server: 1 x X2270 8 x cores (2 Chips) and Database Server: 1 x X4170 8 x Cores (2 Chips) 2925.18 SPECjAppServer2004 JOPS@Standard

Tuesday Jul 24, 2007

GlassFish Benchmark Results Keep Climbing

Brian Vickers' NASCAR car at NEXTEL Cup race in Texas

When Eduardo highlighted the excellent SPECjAppServer 2004 results for GlassFish v1 and PostgreSQL, he speculated that "GlassFish v2 should enable a better number (or similar number on cheaper hardware)."

Now, just two weeks later, we have a new SPECjAppServer 2004 result which does use GlassFish v2 (while keeping PostgreSQL 8.2.4 for the DB). Its 813.73 JOPS are about 4.5% better than the 778.14 JOPS obtained in the earlier run with GlassFish v1. And, as Jignesh describes, these new results were obtained using about 33% less hardware. So Eduardo's predication was right on both counts--a better number and cheaper hardware.

Disclaimers: SPEC and the benchmark name SPECjAppServer 2004 are registered trademarks of the Standard Performance Evaluation Corporation. Competitive benchmark results stated above reflect results published on www.spec.org as of 07/23/06. The comparison presented is based on GlassFish v2 run on Sun Fire X4200 (4 chips, 8 cores) - 813.73 SPECjAppServer2004 JOPS@Standard and GlassFish v1 run on Sun Fire X4200 (6 chips, 12 cores) - 778.14 SPECjAppServer2004 JOPS@Standard. For the latest SPECjAppServer 2004 benchmark results, visit http://www.spec.org/.

Picture by Bo Nash.

Wednesday Jul 11, 2007

Benchmarking JRuby on GlassFish

JRuby Logo

We're on a bit of a benchmarking kick lately. If you missed it yesterday, be sure to read about the new SPECjAppServer 2004 results for GlassFish v1 and v2. Hint: they're good.

Okay, so GlassFish performs well for traditional Java EE technologies. But how well does it handle scripting languages, such as Ruby? Vishnu Gopal decided to find out, benchmarking the same app when deployed on JRuby/Glassfish versus Mongrel/C. Guess what? More good results for GlassFish. In one portion of his summary, for example, Vishnu notes that the GlassFish deployment provides "twice the reply rate in half the benchmark time."

Tuesday Jul 10, 2007

Another SPECjAppServer 2004 - 778.14 JOPS@Standard on all-OpenSource Configuration

SPEC Logo

Josh reports another SPECjAppServer 2004 result: 778.14 JOPS@Standard based on GlassFish v1. Although the number is lower than the 883.66 JOPS@Standard we just reported, the submission is interesting in that it is all open source, software (GlassFish, PostgreSQL,...) and hardware (T2000).

Playing the leapfrogging game, GlassFish v2 should enable a better number (or similar number on cheaper hardware). Check Josh's writeup for more details.

Disclaimers: SPEC and the benchmark name SPECjAppServer 2004 are registered trademarks of the Standard Performance Evaluation Corporation. Competitive benchmark results stated above reflect results published on www.spec.org as of 07/10/07. The comparison presented is based on GlassFish v1 run on Sun Fire X4200 (6 chips, 12 cores) - 778.14 SPECjAppServer2004 JOPS@Standard and on GlassFish v2 run on Sun Fire T2000 (1 chips, 8 cores) 1.4ghz - 883.66 SPECjAppServer2004 JOPS@Standard. For the latest SPECjAppServer 2004 benchmark results, visit http://www.spec.org/.

Bragging Time: 883.66 JOPS@Standard on GlassFish V2

883.66 JOPS

Bragging time: 883.66 JOPS@Standard - GlassFish v2 now has the best SPECjAppServer 2004 on T2000; better than BEA's, Oracle's and IBM's. Read Scott's writeup for the details and caveats.

The result reflects improvements in many areas including EJBs, JMS, JSP compilation, Servlet connector and container, connection pooling, CMP 2.1 and more. GFv2 has also improved in areas not covered by SPECjAppServer 2004 like Web Services, EJB 3.0, JSF, JPA and others.

As Scott says, benchmarking is a leap-frogging game: tomorrow there may be another T2000 submission that is better than ours, but we have joined the game and we intend to keep hopping in front... And this benchmark is another example that you don't have to choose between Open Source and Enterprise Features: you can have both.

Disclaimers: SPEC and the benchmark name SPECjAppServer 2004 are registered trademarks of the Standard Performance Evaluation Corporation. Sun Fire T2000 (1 chips, 8 cores) 1.4ghz 883.66 SPECjAppServer2004 JOPS@Standard. Competitive benchmark results stated above reflect results published on www.spec.org as of 07/10/06. For the latest SPECjAppServer 2004 benchmark results, visit http://www.spec.org/.

Wednesday Jun 07, 2006

More on SJS AS 9.0 (GlassFish) Peformance

Photo of Thrust SCC

Some additional information on the SPECjAppServer2004 Results... Tom Daly has a very good Overview of the Benchmark Results, describing the configuration in details and explaining the implications of these results based on free and open source software. The actual benchmark announcement was picked up in many places, including at InfoQ, Floyd's new unlaunched community site. And Jenny describes the Connect/J and MySQL's Tuning Tips used.

And Jaime has a very good summary, in spanish.

On the picture - the Thrust SSC is the current land speed holder. Check the ground shockwave for the ThrustSSC! The full sequence is at Richard Meredith Hardy's web site, and I found the link here.