Introducing Exadata X9M: Dramatically Faster, More Cost Effective, and Easier to Use

September 28, 2021 | 9 minute read
Gavin Parish
Senior Principal Product Manager
Text Size 100%:

The Exadata Product Management and Development teams are excited to announce the next generation of Exadata Database Machine platform, the Oracle Exadata Database Machine X9M. Built on over a decade of providing the highest performance database hardware and software, Exadata X9M is sure to please!

Who better to hear from than Juan Loaiza, Executive Vice President of Mission Critical Database Technologies.

The Exadata X9M family, including Exadata Database Machine, Exadata Cloud@Customer, and Zero Data Loss Recovery Appliance, continue to take advantage of our latest cutting edge network technology introduced in Exadata X8M, RDMA over Converged Ethernet (RoCE). Also introduced in Exadata X8M, and continuing in X9M, is the shared storage persistent memory acceleration tier. This combination of powerful technologies in Exadata's unique architecture has allowed Exadata System Software, the not-so-secret-sauce of Exadata, to once again increase performance for OLTP and Analytics workloads, improve consolidation abilities, enabling reduced infrastructure spend, and removing management overheads for the X9M release.

We'll get into the details in a second, but let's first look at some workloads running on Exadata X9M:

Firstly, high performance online transaction processing and modern workloads such as IoT, Financial Trading, and eCommerce. For this, the world's fastest OLTP Database machine just got even faster (and not by a little!). Using sophisticated software introduced with Exadata X8M and persistent memory, we saw IOs per second reach 16 million in a single rack. Now, Exadata X9M boasts 27.6 million 8k read IOs per second, a 70% increase! Latency remains at a blistering 19 microseconds for Exadata X9M. As with all Exadata performance metrics, these are real-world, end-to-end database workload numbers, not low-level IO tools using small-sized test workloads typically used by storage vendors.

There is something for the analytics workloads too. Scan throughput (the bandwidth allowing bulk amounts of data to be processed in Exadata Storage Servers) in Exadata X9M tops the 1TB (Terabyte) per second mark in a single rack, up from 560 GB (Gigabytes) per second on Exadata X8M. An 87% increase generation over generation! The fastest analytics database machine - now even faster.

Consolidation on Exadata becomes even more enticing with Exadata X9M. An increase in drive capacity per storage server, and increased CPU cores and memory footprint in the database servers, means you can now run more Oracle database workloads on the Exadata platform. (Did you know that Exadata allows over 4000 pluggable databases per container database? That's a lot of room for consolidation.) Higher consolidation densities mean achieving more with less. Support more users with less infrastructure spending. Combined with lower management overheads, your savings in CAPEX and OPEX begin to multiply. More databases, in fewer floor tiles.

How are these incredible numbers achieved, and how can we satisfy the most dense workloads, you ask? It's through Exadata's unique software and hardware combined architecture, which pushes computing power from the database servers to the smart storage servers. As new technologies like persistent memory are engineered into the caching hierarchy alongside existing NVMe flash cache, Exadata can make the most out of the increases in PCIe and memory bus performance. And, by utilizing local hardware performance of the storage servers, and only sending relevant blocks back to the database server, it means that as storage capacity increases, so too does storage performance. Also, with Exadata, Maximum Availability Architecture is a core tenet, which means redundancy is built-in, not an afterthought.

Let's have a look at the hardware for Exadata X9M.

Exadata Hardware

Exadata X9M-2 Database Server

Exadata X9M two-socket Database Servers use the latest 3rd Generation Intel® Xeon® Scalable Processors. Intel® Xeon® Platinum 8358 Processor, a thirty-two core processor, delivers an increase in cores of 33% over the Exadata X8M generation. Memory size in Exadata X9M-2 has increased in step with the increased CPU core density, allowing customers to maintain memory to core ratios with options of 512 GB, 1 TB, and 2 TB per server. In addition, the memory bandwidth increases by 64%, greatly accelerating memory bandwidth-sensitive operations. To help you get up and running quicker, these memory options are available at ordering time, removing the need to add the memory at installation time. Local storage on the database server has received a performance overhaul, swapping out the 4x 1.2 TB 10K-RPM hard disk drives with 2x 3.84 TB NVMe SSD drives (expandable to 4x 3.84 TB drives), allowing for faster software updates and backups. Exadata X9M sees the inclusion of PCIe4.0, which provides a significant boost to RDMA over Converged Ethernet (RoCE) networking. Speaking of client networking, additional flexibility has been incorporated into the default configuration; you can now order Oracle Exadata X9M-2 Database Servers with up to three network interface cards.

Exadata X9M-2 Database Server

 

Exadata X9M-2 High Capacity Storage Server

Exadata X9M-2 High Capacity Storage Servers adopt the latest sixteen-core 3rd Generation Intel® Xeon® Scalable Processors. Memory gets an upgrade in the storage tier to 256GB, up from 192GB in the X8M. Similar to the Database Server, the memory bandwidth increases 64%. The increased memory bandwidth helps the shared persistent memory caching tier, which moves to the next generation, Intel® Optane™ Persistent Memory Series 200. PCIe4.0 in Exadata X9M boosts the Flash card performance, which also moves to the next generation, the F640v3, capacity is maintained at 6.4 TB. The RoCE Network Fabric receives an increase in performance with PCIe4.0, in step with the database server. Finally, the twelve hard disk drives increase in capacity to 18TB, up 28% from X8M.

Exadata X9M-2 High Capacity Storage Server

 

Exadata X9M-2 Extreme Flash Storage Server

Exadata X9M-2 Extreme Flash Storage Servers keep in step with the High Capacity Storage Server, adopting the latest sixteen-core 3rd Generation Intel® Xeon® Scalable Processors, memory, and persistent memory. As with the X9M High Capacity Storage Server, the inclusion of PCIe4.0 boosts the Flash card performance, which also moves to the next generation, the F640v3. Capacity of the eight flash cards continues at 6.4 TB each. As with the High Capacity Storage Server, RoCE Network Fabric in the Extreme Flash Storage Server receives an increase in performance with PCIe4.0 as well.

Exadata X9M-2 Extreme Flash Storage Server

Exadata X9M-2 Extended Storage Server

Exadata X9M-2 Extended Storage Servers adopts the latest sixteen-core 3rd Generation Intel® Xeon® Scalable Processor. Memory remains at 96GB. Similar to the Database and other Storage Servers, RoCE Network Fabric receives an increase in performance with PCIe4.0. The twelve hard disk drives increase in capacity to 18TB, up from 14TB in X8M, a 28% increase.

Exadata X9M-2 Storage Expansion Rack

Exadata Storage Expansion Rack adopts the latest Exadata X9M-2 High Capacity and Extreme Flash Storage Servers. Additional High Capacity, Extreme Flash, and Extended Storage Servers can be added to existing X8M or X9M Storage Expansion Racks.

Scalable Licensing of Cores

Exadata X9M allows users to limit the number of active cores in the database servers, reducing required database software licenses. At installation time, a minimum of 14 Database Server cores must be enabled on the X9M-2 servers. Oracle Exadata Deployment Assistant (OEDA) is used during installation to implement this reduction. You are then able to increase the active core count when required over time. This feature, called Capacity On Demand, has been available since Exadata X4-2 generation. The minimum number of active cores required has been constant through Exadata X5, X6, X7, X8, X8M, and now X9M.

Exadata System Software 21.2

As we announced in May this year, the Exadata System Software Release 21.2 brings further innovations to the performance and manageability of your Exadata fleet. Exadata 21.2 builds on all the innovations delivered in Exadata 20.1. New features include:

  • Persistent Storage Indexes
  • Persistent Columnar Cache
  • Smart Scan Metadata Sharing
  • ACFS IO Caching

You can read details on these updates in our announcement here and in the Exadata Database Machine System Overview. Some hardware-specific updates that weren't mentioned, but included in 21.2 include:

Support for Exadata X9M Hardware

The Exadata X9M family requires Exadata System Software release 21.2.0.0.0 at a minimum. Additional software support for new hardware servers and components were added to Exadata 21.2.

Smart Scan Fast Decryption

Smart scans on encrypted data require temporary staging buffers to decrypt data from the IO buffer, followed by disk filtering and projection. Previous to Exadata SW 21.2, this temporary buffer is copied back to the data IO buffer for filtering and projection. Now with Exadata Software 21.2 and Exadata X9M hardware that enables new instruction sets, Smart Scan Fast Decryption implements algorithms to use the temporary buffer directly in filtering and projection. This results in 2.4x faster decryption for smart scans in X9M, and works with all currently supported Oracle Database versions.

Exadata 21.2 Smart Scan Fast Decryption

KVM Updates

With the increased hardware specifications in Exadata X9M, it's time to look at virtualization. Memory in Exadata X9M Database Servers has been increased (up to 2TB); therefore, we've upped the maximum memory allocated to virtualized machines to 1,870 GB per database server. So, either a single virtual machine or multiple virtual machines can utilize a combined footprint of up to 1,870 GB per database server. Remember, you cannot over-provision physical memory, and the minimum is 16 GB for a guest (to support OS, GI/ASM, and Database). With CPUs under KVM, we continue to allow over-subscription to 2x (but remember the performance impact that may arise if all guests become fully active). With 32-core CPUs in Exadata X9M-2, that's up to 248 vCPUs available to use per database server. We continue to reserve 4vCPUs (2 cores) for the KVM hypervisor's dedicated usage.

Summary: Exadata X9M - Performance in Spades

With each new generation of hardware and software, our goal is to encapsulate the three areas of our vision statement for Exadata: Provide the Ideal Database Hardware, optimized hardware that scales out by storage, compute, and network specifically for database workloads. Build database-aware system software that takes full advantage of this hardware, providing unique algorithms and features that vastly improve performance, availability, and scalability for every kind of database workload, whether it be OLTP, analytics, consolidation, IoT, blockchain, gaming, and high-speed financial systems. And lastly, to provide a fully automated and optimized design, end-to-end with easy management and monitoring across the entire software stack. 

If you look at Exadata X9M in the light of the vision statement, I believe you'll agree that this new generation of Exadata Hardware X9M, in combination with Exadata Software 21.2, is the integrated solution for all Oracle Database workloads, providing higher performance with more capabilities and integration, delivering the greatest value to our customers.

The increase in performance and capacity of Exadata X9M is missing only one thing, a price increase. However, once again, Exadata X9M is delivered with no change in price. This means that running the same workload on less hardware will lower your costs, as will consolidating databases from multiple systems onto a single system. Everyone’s savings will be different, but we can help you do the math – the savings are significant!

You can read more about the hardware and software used in Exadata X9M and Exadata System Software 21.2 in the Exadata Database Machine System Overview document.

Oracle is also announcing the launch of Oracle Exadata Cloud@Customer X9M and Zero Data Loss Recovery Appliance X9M. Built on the same fundamental vision and superior architecture as Exadata, Oracle provides the World’s Best Database MachineWorld's Best Database Cloud at Customer, and World's Best Data Protection Appliance. Each is faster, easier to manage, more secure, and more cost effective than their respective previous generations. Read more about Exadata Cloud@Customer X9M and Zero Data Loss Recovery Appliance X9M.

For more information on Exadata X9M, please go to oracle.com/exadata, and don't forget to join us at Oracle Database World next month.

We are always interested in your feedback. You're welcome to engage with us via Twitter @ExadataPM@GavinAtHQ or @alex_blyth.

 

 

Gavin Parish

Senior Principal Product Manager

Gavin is a product manager in Oracle’s Exadata team, with a focus on software and hardware roadmap. Prior to the Exadata team, Gavin was a founding member of the team responsible for launching the industry’s first on-premises public cloud technology - Oracle Cloud at Customer. In his 15 years in Oracle Product Management, Presales and Consulting roles, Gavin has developed a robust understanding of all things Oracle, helping customers architect and implement a variety of infrastructure and application technologies.


Previous Post

Exadata System Software Updates - September 2021

Gavin Parish | 2 min read

Next Post


Introducing: Exadata X9M-2 100G Client Network

Gavin Parish | 2 min read