AS/400 leads the league in Java performance

IBM's AS/400 server rocks the house in two Java benchmarks

Some people still view IBM's AS/400 as merely a character-based legacy platform, but that's light-years from today's reality. The AS/400's glittering appearance at several recent Java benchmark parties was reminiscent of Cinderella's transformation and arrival at the ball. Stepping in quietly from the background, the AS/400 sparkled amid its Java rivals at the Volano, Specjbb2000, and other recent benchmark galas.

TEXTBOX:

TEXTBOX_HEAD: The Bottom Line

AS/400 Java performance

Business Case

Recent benchmarking of Java performance on the newest release of the AS/400 has proven the platform a stellar performer compared to rivals. This helps make the AS/400 an ideal platform for e-business deployments.

Technology Case

The AS/400 performed an incredible 108,153 messages per second during the VolanoMark test (a chat room emulator) and 80,348 operations per second during the Specjbb2000 benchmark (an order entry test), leaving no doubt that the AS/400 can handle Java's requirements.

Pros

  • Extremely fast Java performance
  • Offers major performance gain over rival platforms
  • Strong support for Java applications

Cons Investment in higher-end AS/400 configuration may be required to process higher transaction volume.

:END_TEXTBOX

The AS/400 always has had a well-respected, though drab, image as a business computer suited to the unglamorous tasks of billing customers, tracking inventory, and balancing the company books. Meanwhile, its stepsisters and other competitors stepped in and grabbed the limelight, at least until now.

If the results of these benchmarks are any indication of how well the AS/400 can perform in a Java-based, Web-serving, e-commerce world, then CTOs and other business leaders should be taking a hard look at the AS/400 as a platform to reliably host their e-business applications.

IBM's AS/400 seemed to arrive at the Java benchmark parties already wearing Cinderella's glass slippers. Running its latest operating system release, OS/400 Version 4, Release 5 (V4R5), it became the first server platform ever to post a six-digit number in the VolanoMark 2.1.2 Java benchmark.

The model tested was a 24-way processor AS/400E Model 840 with 4GB of memory. The configuration clocked an amazing 108,153 messages per second with 200 concurrent connections. This test score was four times the 25,131 messages per second posted by Sun Microsystems for its Solaris E6500 22-way processor server with 30GB of memory).

Volano's VolanoMark benchmark is a 100% pure Java benchmark that emulates a chat room by using long-lasting connections and high thread counts (for more information, see Resources). Clients take turns broadcasting their messages to the group. The benchmark reports the average number of messages transferred by the server per second.

Table 1. VolanoMark 2.1.2 benchmark results

AS/400 Model 840 V4R5

12-way configuration, 8 GB memory

ConnectionsMessages per second
40043,292
3,00042,863
6,00042,105
9,00039,529
12,00039,129
15,00036,125
18,00025,587
20,00023,942

Solaris E6500

22-way configuration, 30 GB memory

ConnectionsMessages per second
6,0006,830
9,0004,847

The most impressive result was a 12-way AS/400 configuration that achieved 23,942 messages per second with an unheard of 20,000 concurrent connections. Nothing else has come close to that score. Also amazing is that the 12-way messages per second remained nearly the same as it scaled up from 400 concurrent connections to beyond 12,000.

The AS/400's stepsisters, IBM's RS/6000 and Netfinity servers, trace their roots to scientific and personal computing. By contrast, the AS/400 was designed from inception to be a solid and reliable business computer. Similar to Cinderella, the AS/400 has morphed from a behind-the-scenes back-office server to a leading-edge e-business platform.

Business app testing

The AS/400 was evaluated recently in a more realistic Java business application test. The Specjbb 2000 benchmark from the Standard Performance Evaluation Corp., or SPEC (for more information, see Resources), evaluates the performance of servers running a simulated order-processing system for a wholesale supplier in a three-tiered environment.

The benchmark simulates order placement, order status requests, payments, and other transactions. The three-tiered benchmark measures both the hardware and software of the server's JVM. The scalability of the hardware platform can be measured as well as the efficiency of the JVM's Just-in-Time (JIT) compilers, thread implementation, and garbage collection.

During the tests, the AS/400, equipped with IBM's new Silicon-on-Insulator (SOI) and copper chip technology, captured the top three finishing spots on the benchmark. In particular, a 24-way Model 840 took the top spot with a stratospheric score of 80,348 operations per second.

When looking closely at the results (see chart, below) for the two-, four-, and eight-way processors, a very unique and important AS/400 architectural fact shows itself. Although the RS/6000, Netfinity, and others posted slightly higher operations-per-second scores, the maximum transaction time statistic differentiates them. In every JVM in the industry, except the AS/400, all processes must come to a complete halt while Java's "memory garbage collection" is performed. On the AS/400, this task runs concurrently with the business transactions.

So while Compaq's four-way processor slightly edged out the AS/400 in operations per second, it had nearly a 3-second maximum transaction time whereas the AS/ 400's time was negligible. As it scaled from a two-way to a 24-way processor configuration, the AS/400 continued to have the lowest maximum transaction time of all competitors.

Table 2. SPEC JBB2000 benchmark results
The SPEC JBB2000 benchmark is a memory resident test, which omits disk I/Os and user key/think time. These results highlight the flexibility of the AS/400, from the smallest to the largest server.
CompanyJVMOS releaseModelOperations per secondMaximum transaction timeNumber of processorsMHz
IBMIBM 1.2.2V4R5AS/400 840-242080,3480.4624500
IBMIBM 1.3.0V4R5AS/40079,3160.3524500
IBMIBM 1.1.8V4R5AS/400 840-242079,2500.3524500
HP1.2.2.05 HotspotHP-UX 11.0N400040,1921.668552
IBMIBM 1.3.0AIX 4.3.3RS/6000 7026-M8036,8061.098500
IBMIBM 1.3.0NT 4.0 SP5Netfinity 8500R35,3141.758540
IBMIBM 1.3.0V4R5AS/400 830-240334,2740.278500
IBMIBM 1.2.2AIX 4.3.3RS/6000 7026-M8030,0321.688500
IBMIBM 1.1.8NT 4.0 SP5Netfinity 8500R28,1671.138700
IBMIBM 1.3.0AIX 4.3.3RS/6000 7026-M8019,5501.154500
CompaqFastVM 1.2.2-1Tru64 5.0AE540 6/66719,2322.784667
IBMIBM 1.3.0V4R5AS/400 830-240217,8640.274540
IBMIBM 1.3.0NT 4.0 SP5Netfinity 7000 M1012,2800.834400
HP1.2.2.05 HotspotHP-UX 11.0J560011,8341.562552
IBMIBM 1.3.0V4R5AS/400 270-22537,5000.332500

Of course, benchmark performance is not the only thing that smart business leaders will want to consider when deciding on their e-business platform. The AS/400 via its support for logical partitioning also has the advantage of being specifically designed to handle organizational growth and change.

As business needs and realities have changed, the AS/400 has changed in kind to meet new demands. Whether it's Java, e-commerce, ERP (enterprise resource planning), or data warehousing, the AS/400 seems to fit the glass slipper with ease. Business leaders who are serious about implementing a solid e-business server strategy should carefully examine the AS/400.

Learn more about this topic

This story, "AS/400 leads the league in Java performance" was originally published by InfoWorld.