First SPECjvm2008 Result Published!

The first ever SPECjvm2008 result has been published on the SPEC website. The Sun result stands alone, with no other hardware or software vendor stepping forward. This is the example of the confidence we have in HotSpot JVM and OpenJDK, and their abilities to strive in a broad range computing environments.

Also note that this is a SPECjvm2008 Base submission, with No JVM Tuning Required. SPECjvm2008 consists of 11 sub-components, some of which have multiple sub-test, such as crypto, scimark, and xml. As I've said before, this is a bear of a JVM benchmark, so improving the composite score requires significant improvement of its parts. Sun has not only submitted the first SPECjvm2008 result, but did so by submitting a SPECjvm2008 base submission only, hopefully setting the tone for competitive comparison moving forward.


Confident Performance. It has a nice ring to it.


Comments:

Enough bragging already.

Other submissions might have been made if the benchmark actually ran correctly on more systems. I tried it on my 8-core MacOS system and on an Ubuntu box and in both cases there were numerous issues to resolve...and I ultimately gave up as I had better things to work on.

Posted by Alan on July 11, 2008 at 01:45 AM EDT #

Please, without other submission I get unlimited bragging rights. Don't like it? Submit a result. Besides, I thought the bragging is quite subdued considering other competitive performance posts.

Read the FAQ for the benchmark. I'm watching it run on my Macbook Pro without issues as I type. It is not an easy benchmark to run out of the box, so you may need to adjust the heap size (which is legal for a base submission), or run a Sun JVM :-) I'd start with a 64-bit JVM and a 4gb heap for a 8-core box. Or adjust the thread counts.

Posted by guest on July 11, 2008 at 02:08 AM EDT #

Which JVM are you using on the macbook? There were several issues with xml parsing and also some leapard issue as well, the net result of which was that a final result was hard to come by.

Let us know what you had to do to run the benchmark as the release notes with the benchmark were inadequate.

Posted by Alan on July 11, 2008 at 09:32 AM EDT #

Any progress on the Mac? The 1.6 JVM from Apple fails instantly. 1.5 runs and makes some progress but fails on some XML errors which aren't in the known issues documentation.

I'm comfortable guessing that the 1.5 JVM results aren't that interesting, otherwise there would be a result posted. So making the effort to get the 1.5JVM running just isn't worth it.

This is actually kinda lame of a java benchmark that's not clearly "write once run anywhere".

Posted by Alan on July 16, 2008 at 12:59 PM EDT #

Unfortunately its not the benchmark, its Java on Mac. Java 1.5 should run without issue. You'll need to increase the heap size, try running with 1g if you have 4 cores on your box. The 1.6 issue, I get to put my foot in my mouth on that one. It was actually a known issue 2 days before the benchmark was released. We'll work with Apple to address the issue or identify a workaround.

Please try on Solaris, Windows, or Linux. It works without issue on these platforms.

There is no Java benchmark that I'm aware of that is as complete as SPECjvm2008. Yes its not tremendously easy, nor does it completed quickly. We'll continue to work on improving it.

Posted by David Dagastine on July 24, 2008 at 06:37 AM EDT #

Post a Comment:
Comments are closed for this entry.
About

dagastine

Search

Archives
« April 2014
SunMonTueWedThuFriSat
  
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
   
       
Today