X

Announcing Parallel File Tools for File Storage

Mona Khabazan
Principal Product Manager

We are excited to share a new suite of Parallel File Tools that take advantage of the full performance of the Oracle Cloud Infrastructure File Storage service. File Storage offers elastic performance where throughput grows with the amount of data stored in every file system. File Storage is best suited for parallel workloads that can use the scalable throughput. The Parallel File Tools provide parallel versions of tar, rm, and cp that run requests on large file systems in parallel, enabling you to make the best use of the performance characteristics of the File Storage service.

The current toolkit is distributed as an RPM for Oracle Linux, Red Hat Enterprise Linux, and CentOS. The current Parallel File Toolkit includes:

  • partar, a parallelized subset of tar functionality to create and extract tarballs in parallel
  • parrm, a parallelized recursive remove of a directory
  • parcp, a parallelized recursive copy of a directory

Installing and Running

Use the following commands for your OS.

Oracle Linux

yum install

sudo yum install -y fss-parallel-tools

CentOS and Red Hat 6.x

OL6 install

sudo wget http://yum.oracle.com/public-yum-ol6.repo -O /etc/yum.repos.d/public-yum-ol6.repo
sudo wget http://yum.oracle.com/RPM-GPG-KEY-oracle-ol6 -O /etc/pki/rpm-gpg/RPM-GPG-KEY-oracle
sudo yum --enablerepo=ol6_developer install fss-parallel-tools

CentOS and Red Hat 7.x

yum install

sudo wget http://yum.oracle.com/public-yum-ol7.repo -O /etc/yum.repo.d/public-yum-ol7.repo
sudo wget http://yum.oracle.com/RPM-GPG-KEY-oracle-ol7 -O /etc/pki/rpm-gpg/RPM-GPG-KEY-oracle
sudo yum --enablerepo=ol7_developer install fss-parallel-tools

Using the Manual

To display the man pages, use the following commands:

  • man partar
  • man parrm
  • man parcp

Reporting Bugs or Enhancement Requests

Install the debuginfo RPM, rerun the command to collect the core, and send that to us at parallel-tools-support_ww@oracle.com with the version of the package and all the error messages that the command emits.

  • To ensure that you have the latest version, check the yum update or yum install command.
  • To install the debuginfo package, run:
    sudo debuginfo-install fss-parallel-tools

What's Next?

In the near future, we plan to provide support for Ubuntu.

More About File Storage

Oracle Cloud Infrastructure File Storage is a fully managed, network-attached storage that offers high scalability, high durability, and high availability for your data in any Oracle Cloud Infrastructure availability domain. File Storage provides the reliability and consistency of traditional NFS filers and offers enterprise-grade file systems that can scale up in the cloud without any upfront provisioning. You can start with a file system that contains only a few kilobytes of data, and grow it to 8 exabytes of data. Because File Storage is a fully managed service, you don't have to worry about capacity planning, software upgrades, security patches, hardware installation, and storage maintenance. You pay only for your capacity stored monthly; you stop paying as soon as you delete your data.

File Storage supports NFS version 3 protocol with Network Lock Manager (NLM) as the locking mechanism to provide POSIX interfaces. You can also use the NFS client on Microsoft Windows to access File Storage. File Storage protects your data by maintaining multiple replicas locally, along with encryption and the ability to take frequent snapshots. Within an availability domain, File Storage uses synchronous replication and high availability failover to keep your data safe and available.

Interested in trying File Storage? I can help. Just sign up for a free trial or drop me a line at mona.khabazan@oracle.com.

Mona Khabazan, Principal Product Manager, Oracle Cloud Infrastructure File Storage

References