X

File Storage Performance on Oracle Cloud Infrastructure

Mona Khabazan
Principal Product Manager

Oracle Cloud Infrastructure is built to deliver consistent high performance for demanding enterprise workloads.  A recent white paper we published on File Storage performance demonstrates the levels of performance the service can deliver and offers recommendations for achieving optimal performance when using it. Oracle Cloud Infrastructure File Storage is a fully-managed cloud storage service where read and write throughput and IOPs increase proportionally to the size of a file system. This means as you add more data, you can expect a corresponding growth in performance.  File Storage eliminates over-provisioning for performance and low utilization of purchased capacity that are typical in on-premises environments, resulting in significant cost reduction as well as lower management overhead. Oracle Cloud Infrastructure File Storage allows customers to stop managing individual storage appliances and volumes manually.  This frees them up from worry and effort around capacity management, hardware refreshes, software upgrades, and system and component failures.

We believe that Oracle Cloud Infrastructure File Storage is the most cost-effective and easy to manage solution for hosting enterprise applications such as E-Business Suite (EBS), PeopleSoft and Siebel as well as for the deployment and management of clustered file systems that are commonly used for high-performance computing (HPC) workloads. Oracle customer YellowDog enables animation studio and visual effects facilities to access tens of thousands of cores of GPUs to deliver intensive rendering workloads within seemingly impossible deadlines.  Using Oracle Cloud Infrastructure File Storage along with a wide range of compute services, they find us to be consistently faster, cheaper, and easier to manage than other cloud providers or on-premises deployments. As CEO Gareth Williams puts it: "File Storage service is our favourite part of OCI for its simplicity and reliability.

What other use cases can File Storage help you with?

Big data and analytics workloads on Oracle Cloud Infrastructure File Storage benefit from distributed shared file systems for storing persistent data, and for accessing to an unlimited pool of file system capacity for managing growth of both structured and unstructured data, as well as for running Test and Dev workloads such as Ravello, MySQL or other databases.

What Should You Expect for File Storage Performance?

When performing reads and writes of large blocks (~1MB), for each terabyte of data stored you can expect:

  • Overall read performance of at least 100 MB/sec
  • Overall write performance of at least 50 MB/sec
  • At least 2,500 read IOPs

The highest levels of performance assume concurrent access that can be achieved by using multiple clients, multiple threads, and multiple mount targets. This table describes the level of performance that you can expect for different sizes of file systems. Although not guaranteed, you can expect to achieve this level of performance with File Storage.

Data Set Size

Read Bandwidth
(1 MB Block)

Write Bandwidth
(1 MB Block)

Read IOPS
(8K Blocks)

1 TB

100 MB/s

50 MB/s

2,500

10 TB

1 GB/s

500 MB/s

25,000

100 TB

10 GB/s

5 GB/s

250,000

Next, let's talk about price.  With a simple billing model, you only pay a fixed rate for capacity stored monthly.

What Other Factors Can Impact Performance?

There are other factors on the client side that impact your performance:

  • Available bandwidth

The bandwidth available to a file system significantly impacts performance. As bandwidth scales with core count, Oracle Cloud Infrastructure bare metal compute instances provide the greatest bandwidth for demanding workloads. Virtual machine bandwidth is variable based on the core count.  You should select an instance type that offers adequate performance capabilities.

  • Mount options

While it’s common practice to provide explicit values for mount options such as rsize and wsize, File Storage performance will be significantly reduced when specifying these mount options.  We recommend you do not pass any mount options when mounting file systems for optimal results.

  • Latency 

Latency is largely tied to the distance from where your application compute instances run to the cloud availability domain in which your File Storage systems reside. We recommend using the same availability domain for your file system as for your Oracle Cloud Infrastructure compute instances, or that you pick the availability domain that is closest to your own data center to achieve the lowest possible latency.

  • Workload and Access Patterns

The nature of your workload has a significant impact on your performance. File Storage works best with highly parallelized workloads. To take advantage of the full performance of OCI File Storage, use Parallel File Tools for parallel versions of tar, rm and cp. The following access patterns will cause latency to play a higher role in your performance and may negatively impact response time and your perceived throughput:

  • Accessing files sequentially
  • Using a flat directory structure with many (hundreds of thousands or more) files in a single directory
  • Performing frequent metadata operations on files and directories, such as changing permissions or access times
  • Capacity

File Storage offers a fixed amount of bandwidth for every terabyte stored in your file system which scales linearly with capacity. You can expect better performance as you store more data.

Try It for Yourself

File Storage provides high durability in any availability domain of your choice, where your data is replicated on NVMe SSD drives on five different storage hosts. With unbounded scalability and high durability, File Storage provides on-disk encryption, enables frequent space-efficient snapshots for your data protection, and reduces complexity and operational costs to your business. Interested in trying OCI File Storage? I can help. Just sign up for a free trial or drop me a line.

Related Articles

Parallel File Tools for Optimizing Performance

FSS Tutorials

Reference

File Storage Service Performance Guide

 

Be the first to comment

Comments ( 0 )
Please enter your name.Please provide a valid email address.Please enter a comment.CAPTCHA challenge response provided was incorrect. Please try again.