Alluxio, the leading data access acceleration platform for AI and analytics, is now available on the Oracle Marketplace, enabling OCI customers to overcome data bottlenecks and maximize the return on their GPU investments.

Modern AI workloads often suffer from high data access latency from object storage, leaving GPU utilization stuck around 50%. With Alluxio deployed between OCI Object Storage and GPU compute, customers achieve sub-millisecond latency, 1+ TB/s aggregate throughput, and 90%+ GPU utilization, dramatically improving training efficiency.

High-Performance Data Access for AI on OCI

Alluxio intelligently caches data close to compute across memory and NVMe, ensuring GPUs are continuously fed without requiring application changes. OCI customers benefit from:

  • <1 ms latency and 80%+ network bandwidth utilization
  • Plug-and-play integration with existing OCI Object Storage buckets
  • Vendor-neutral architecture that preserves data in its native format
  • 2× faster model training and lower operational cost
  • 38 GB/s throughput and 97% AU on shared GPU nodes with no extra hardware

Flexible Deployment Options on OCI

Alluxio supports multiple deployment options to accommodate GPU cluster size and architectural patterns on OCI:

1. Dedicated Mode

Runs Alluxio workers on DenseIO bare metal nodes with local NVMe.
Ideal for large multi-GPU clusters requiring maximum throughput and consistency.

2. Co-located Mode

Runs Alluxio directly on GPU servers, using spare NVMe capacity.
A cost-efficient option for smaller clusters or single-tenant workloads.

Both modes deliver the same developer experience: applications continue using their existing S3/Posix paths with no code changes required.

Proven Results on OCI

Joint Oracle–Alluxio engineering tests confirm:

  • 0.3 ms average latency (WARP benchmark)
  • 61.6 GB/s throughput on a 6-node MLPerf Storage cluster
  • Consistent 90%+ GPU utilization across training workloads

These results validate Alluxio + OCI as an ideal solution for accelerating LLM training, fine-tuning, and large-scale analytics. For more details, please refer to the article here.

Get Started on Oracle Marketplace

Alluxio is now available directly through the Oracle Marketplace, making it easy for customers to deploy a high-performance data layer and unlock the full power of OCI GPU infrastructure.

Visit the Alluxio listing on Oracle Cloud Marketplace to start accelerating your AI workloads.