Java SE Out of Box Performance: Any interest in a performance comparison?

Out of box performance, or using no JVM tuning options, has been a focus of Sun HotSpot Engineering for quite some time. Our first major steps came with J2SE 5.0 Ergonomics, and we're taking it further in JDK 6 with many of our performance features enabled by default. I find it quite cool when no tuning yields performance close to or exceeding the best I can muster with command line tuning.

With that, I'd like to publish some "Out of Box" competitive performance comparisions on my blog. As you can imagine this could be a bit of a touchy subject for our competitors. Before I post data I'd like to get a feel of how interesting this would be. So, I'd like to ask for a bit of feedback. Is there interest in a Java SE out of box competitive performance out there? Are there any benchmarks that people would like to see? I was thinking the usual benchmarks I talk about, SPECjbb2005 and SciMark. Any others?

Thanks in advance for the feedback!

Comments:

I would love to see some benchmarks.

Posted by Abraham Tehrani on September 21, 2006 at 06:54 AM EDT #

Yes! Benchmarks with twenty odd options set are all well and good, but they represent a fair amount of cost in the real world (not to mention morale-sapping tedious work).

Just don't do anything daft like the database benchmarks that don't use transactions or allow defaulting to in memory storage.

Posted by Tom Hawtin on September 21, 2006 at 09:44 AM EDT #

No need to compare with competition, just compare hand-tuning with the defaults and explain why the tuning was needed and could not be deducted automatically.

Posted by Bernd Eckenfels on September 24, 2006 at 01:59 PM EDT #

Thanks for the comments! I should have data posted early next week. Bernd, thanks for your suggestion. I'll follow up with a hand-tuned / defaults comparision as well. Thanks for the suggestion. -dave

Posted by dagastine on September 30, 2006 at 01:54 AM EDT #

Post a Comment:
  • HTML Syntax: NOT allowed
About

dagastine

Search

Archives
« April 2014
SunMonTueWedThuFriSat
  
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
   
       
Today