We’re introducing significant enhancements to Oracle Cloud Infrastructure (OCI) Search with OpenSearch, including the general availability of Data Prepper for optimized log ingestion, Cross-cluster Replication for increased resilience and high availability, and support for OpenSearch v2.18’s latest AI and ML advancements, particularly AI-driven observability and application search capabilities.

Key Use Cases for OCI Search with OpenSearch:

  • AI-powered observability: Advanced AI search capabilities for log analytics and monitoring combined with AI assistant toolkit.
  • AI and machine learning for search applications: Seamless ML integration for AI-driven search.
  • Semantic and conversational search: Enhanced vector search for intuitive interactions.
  • Security analytics: Improved insights for security monitoring.

Data Ingestion with Data Prepper

Data Prepper for Log Ingestion: Now generally available, Data Prepper enables preprocessing and transformation of log data before ingestion, optimizing data for search and observability. Additionally, Push connectors and OpenTelemetry support will enter limited availability in May as we continue to simplify your data transfer workflows.

High level diagram for Data Prepper with the list of Pull and Push connectors
Figure 1: High level diagram for Data Prepper with the list of Pull and Push connectors

Cross-cluster Search and Replication: Addressing a Key Customer Demand

Cross-cluster Replication is a highly requested feature that enables customers to replicate indexes, mappings, and metadata across OpenSearch clusters, enhancing reliability and performance for mission-critical workloads. Key benefits include:

  • High Availability: Helps ensure search requests remain operational in case of outages.
  • Faster Data Access: Reduces latency by bringing data closer to application servers.
  • Centralized Reporting: Aggregates data from multiple clusters into a single reporting instance.

OCI Search with OpenSearch v2.18: AI and ML Enhancements

AI Assistant for Observability: OCI Search with OpenSearch v2.18 supports an improved AI assistant, allowing users to retrieve and analyze log data more efficiently. Users can now create chatbot agents that leverage various tools such as:

  • PPLTool: Converts natural language queries into Piped Processing Language (PPL) queries.
  • CatIndexTool: Retrieves index information.
  • VectorDBTool and VisualizationTool: Enhances visualization and vector database interactions.

OCI Search with OpenSearch v2.18: AI and ML Enhancements

Integration with OCI Data Science for Model Tuning

LangChain Integration: OCI Search with OpenSearch now seamlessly integrates with LangChain in OCI Data Science, enabling developers to build AI-powered chatbots and conversational search experiences with your own deployed LLM model. Alternatively, you could use OCI GenAI hosted and ready-to-use LLM models if you prefer.

This reduces the need for custom middleware and enhances applications with:

  • OpenSearch vector store for retrieval-augmented generation (RAG) capabilities.
  • OCI Data Science notebook integration for experimentation and deployment with various LLM options.
    OpenSearch with Langchain, OCI Data Science and OCI GenAI high level Architecture
    Figure 2: OpenSearch with Langchain, OCI Data Science and OCI GenAI high level Architecture

     

Seamless OCI Search with OpenSearch Upgrades

You can now upgrade your OCI Search with OpenSearch current version to v2.18 directly from the OCI Console, reducing complex manual steps and reducing operational overhead.

Get Started Today

With these enhancements, OCI Search with OpenSearch continues to offer enterprise-grade capabilities for large-scale, distributed search and analytics workloads. This update comes at no additional cost, with transparent OCI pricing based on node count rather than core usage.

Ready to explore the new features? Head to the Oracle Cloud Console to start upgrading today.

For more information, see the following resources: