We’re excited to announce the general availability of the Oracle Cloud Infrastructure Service Connector Hub. Service Connector Hub is a free service that moves data between your services, both within Oracle Cloud Infrastructure (OCI) and from OCI to third-party tools. It moves data, such as logs from Logging, to services such as Object Storage, Streaming, and Monitoring, for extra processing and compliance storage needs. It triggers Functions for custom data processing and sending Notifications about changes to cloud resources. Service Connector Hub eliminates the overhead associated with building and maintaining complex applications for moving data between services. It’s fully managed, durable, and scales to handle real world back pressure scenarios.
Service Connector Hub is a key component of our Observability strategy. We understand that our customers use tools from different vendors and have made deep financial and intellectual investments in them. We want to meet our customers where they are and support them in continuing to use the tools they have invested in. Service Connector Hub provides a bridge to these tools and makes it easy to move data from your OCI services to your third-party tools.
Using Service Connector Hub opens up a range of use cases, including the following examples:
Seamlessly integrate with third-party tools for more processing and analytics: Enterprises have standardized operational postures with products from different vendors. They use dedicated tools, such as Data Dog and Splunk, for extra data processing and running analytics. Service Connector Hub enables them to seamlessly stream data from the Streaming service to Kafka-compatible third-party tools using Kafka-connectors.
Store data on Object Storage for compliance purposes: Enterprises need to archive data such as logs, metrics, and stream messages long term for compliance purposes and later processing. Service Connector Hub transfers data to Storage seamlessly for inexpensive long-term storage.
Alarm on logs: DevOps engineers can use Service Connector Hub to emit metrics from logs based on criterion they specify, such as emitting a metric every time a log has a 500 error, to the Monitoring service. They can create Alarms on these metrics in the Monitoring service to get near-real-time alerts.
Process data in transit with Functions: Data engineers often need to process data before ingesting it into a destination for running analytics. Cloud native developers want to build event driven applications. Service Connector Hub addresses both use cases. It triggers Oracle Functions for processing data in transit and for building event driven applications so data engineers and developers can focus on the job at hand without the hassle of managing infrastructure.
Get notifications about changes to cloud resources: IT operations engineers care when mission-critical infrastructure components are modified and want to be notified when these changes happen. Service Connector Hub integrates with the Notifications service to send notifications through email, Slack, PagerDuty, Custom Webhooks, and Functions when cloud resources change.
Full visibility over data movement: In general, cloud providers offer individual service-to-service integrations, which make it hard for IT and Security administrators to track the data flows in their environment. Service Connector Hub addresses this pain by offering one destination from where administrators can manage and monitor data movements across all their services.
With today’s launch, you can use Service Connector Hub to move logs from Logging to Object Storage, Streaming, and Monitoring and to trigger Functions and send Notifications. We extend support for moving other data types in our future releases.
Service Connector Hub integrates with Oracle Cloud Infrastructure Identity and Access Management (IAM) and is secure by default. You can control access to Service Connectors to selectively grant permissions to users and groups of users.
There’s no charge for using Service Connector Hub, and customers only pay for the source and destination services between which it moves data. Service Connector Hub is available in all commercial regions.
Service Connector Hub is accessible through the Oracle Cloud Infrastructure Console (under the Data and AI section), SDK, CLI, REST API, and Terraform. To learn more, see the Service Connector Hub documentation.
We welcome you to sign up for the Oracle Cloud Free Trial or sign in to your account to experience Service Connector Hub and the newly announced Logging for capturing logs and moving them to a supported service.