Rethinking Kafka in the Cloud
High-throughput data streaming shouldn’t slow teams down, yet for many data engineering and DevOps teams, it still does.
Managing traditional Apache Kafka clusters involves risky data rebalancing, complex manual scaling, and massive resource over-provisioning to handle peaks. This drives up operational costs and complexity, often requiring manual intervention during off-hours. These challenges make Kafka clusters expensive to run, hard to scale, and difficult to operate reliably at cloud scale.
AutoMQ changes that – Built as a next-generation, open-source cloud-native Kafka service, AutoMQ re-architects Kafka for the cloud. It removes the traditional barriers to cost-efficient, elastic data streaming—so your teams can focus on building data products, not managing infrastructure.
Now Available on Oracle Marketplace
AutoMQ is now live on Oracle Marketplace, bringing its Diskless Kafka service directly to Oracle Cloud Infrastructure (OCI) users.
Through Oracle Marketplace, data and infrastructure teams can deploy a fully managed, 100% Kafka-compatible diskless solution that is:
- Pre-integrated with Oracle Cloud Infrastructure Compute
- Backed by OCI Object Storage for virtually infinite scalability
- Designed for cost efficiency, elasticity, and simplicity in the cloud
Key Benefits of AutoMQ on OCI
- 100% Kafka API Compatible: Fully retains the Apache Kafka computation layer implementation, enabling seamless collaboration with ecosystem tools like Strimzi Operator. It requires no refactoring of business logic and completely avoids vendor lock-in.
- Low-Latency S3-Compatible API of OCI Object Storage: Adopts an innovative architecture that incorporates a fixed, small-capacity, low-latency storage (approx. 10 GiB) as Write-Ahead Log (WAL) within the cloud-native diskless design, achieving low-latency performance.
- Optimized for OCI Flexible Compute: OCI offers flexible compute shapes that allow precise customization of CPU-to-memory ratios, enabling AutoMQ deployments to be tailored for specific workload profiles—whether CPU-intensive scenarios with TLS encryption and compression enabled, or memory-intensive scenarios requiring large OS page cache for high-throughput consumption.
- Simplified Cross-Zone Architecture: Introduces a shared storage architecture where data durability is guaranteed by cloud storage, eliminating cross-AZ network overhead on the producer side.
- Scaling in Seconds: Transforms Kafka Brokers into stateless compute nodes. Scaling requires no movement of local disk data, only exchanging a small amount of metadata.
- Zero Data Skew: Embeds a self-balancing mechanism natively into the platform. Based on the diskless architecture, partition reassignment can be completed within 1 second, automatically maintaining optimal load distribution.
These architectural breakthroughs aren’t just theoretical—they translate directly into measurable business value in the real world.
Proven at Scale: Trusted by Industry Leaders
AutoMQ is battle-tested in mission-critical scenarios, managing petabytes of data for large-scale enterprises.
Customers like Grab, Geely Auto, JD.com, and Poizon use our platform to achieve up to 3× better cost efficiency, cut infrastructure and storage costs by more than 50%, reduce partition migration times from hours to under a minute, support >1 GB/s throughput for connected vehicles, and streamline Kubernetes operations for leaner, more reliable systems.
Bottom line: The Future of Streaming is on OCI
We are redefining the next-gen diskless Kafka for the cloud. By combining a cloud-native, shared storage architecture with OCI’s pricing, we deliver a truly cloud native kafka experience: zero wasted resources, Zero Data Skew and infinite elasticity.
Get Started
Explore AutoMQ on Oracle Marketplace and see how simple cloud-native data streaming can be on OCI.