We are excited to share a new suite of Parallel File Tools that take advantage of the full performance of the Oracle Cloud Infrastructure File Storage service. File Storage offers elastic performance where observed throughput grows with the amount of data stored in every file system. Given that OCI File Storage is best suited for parallel workloads, this Parallel File Tools can provide parallel versions of tar, rm, and cp that run requests in parrallel, enabling you to make the best use of the performance characteristics of the OCI File Storage service.

What is included? 

The current toolkit is distributed as an RPM for Oracle Linux. The current Parallel File Toolkit includes:

  • partar, a parallelized subset of tar functionality to create and extract tarballs in parallel
  • parrm, a parallelized recursive remove of a directory
  • parcp, a parallelized recursive copy of a directory

Installing and Running

Use the following commands for your OS.

Oracle Linux 7 & 8

sudo yum --enablerepo=ol7_developer install fss-parallel-tools
sudo yum --enablerepo=ol8_developer install fss-parallel-tools

This utility can also be used with CentOS and Red Hat as well. 

CentOS 7.x and Red Hat 7.x

sudo wget http://yum.oracle.com/public-yum-ol7.repo -O /etc/yum.repos.d/public-yum-ol7.repo
sudo wget http://yum.oracle.com/RPM-GPG-KEY-oracle-ol7 -O /etc/pki/rpm-gpg/RPM-GPG-KEY-oracle
sudo yum --enablerepo=ol7_developer install fss-parallel-tools

We no longer provide support for new issues found in verion 6 of Oracle Linux, CentOS and Red Hat.

You can run the following commands for further instructions on the usage

  • partar –help
  • parcp –help
  • parrm –help

Reporting Bugs or Enhancement Requests

If encountering any error, please send us error messages that the command emits to parallel-tools-support_ww@oracle.com with the version of the package installed.

More About File Storage

Oracle Cloud Infrastructure File Storage is a fully managed, network-attached storage that offers high scalability, high durability, and high availability for your data in any Oracle Cloud Infrastructure availability domain. File Storage provides the reliability and consistency of traditional NFS filers and offers enterprise-grade file systems that can scale up in the cloud without any upfront provisioning. You can start with a file system that contains only a few kilobytes of data, and grow it to 8 exabytes of data. Because File Storage is a fully managed service, you don’t have to worry about capacity planning, software upgrades, security patches, hardware installation, and storage maintenance. 

File Storage protects your data by maintaining multiple replicas locally, along with encryption and the ability to take frequent snapshots. Within an availability domain, File Storage uses synchronous replication and high availability failover to keep your data safe and available. Get started with Oracle Cloud Infrastructure today with our Oracle Cloud Free Tier.

Reference

For additional information refer to the File Storage documentation.