Thursday Oct 30, 2014

What's the Difference Between In-Memory Database and In-Memory Data Grids?

We've gotten a lot of questions recently about the differences between Oracle's announced in-memory database and in-memory data grid technologies like Coherence. Let's clear that up, with a dusted-off excerpt from our "State of the Union" blog a couple of months ago. Just in case you missed it.

The In-Memory Database option has led to confusion in the In-Memory Data Grid market
Let us try to clarify some of the confusion.
Oracle Coherence is not embedded in the In-Memory Option for the Oracle Database. Although we have seen rumors of this to the contrary, this would make absolutely no sense. Coherence is a distributed key-value store; the in-memory option is a columnar store. The In-Memory option is purpose built and optimized to work as one with the database with its primary access method being SQL. (Of course, Coherence is part of many other Oracle solutions, such as Oracle Service Bus which offers web services results caching via a check box, or the Elastic Charging Engine, which is architected on top of Coherence’s fault-tolerant distributed processing.  As you can see, Coherence has become strategic within Oracle.)

The In-Memory Option focuses on different use cases than Coherence. In-Memory focuses on ad-hoc full-table scans of unindexed data.  In the words of Maria Colgan "The main use case for the In-Memory column store is fast analytics, which has very different access patterns to OLTP. Typically analytic queries access a few columns from a table but they examine all of the entries in those columns. You need to scan the whole table or segment, not just a small part of the table to answer these queries.” Storing these columns in-memory, in columnar format, speeds full-table scans orders of magnitude.

By contrast, Coherence focuses on providing scale-out data management and processing to middleware applications thereby reducing load on shared services such as databases, mainframes, and web services.  By caching data in domain object format close the application, Coherence also increases responsiveness and availability of applications. 

Hopefully, this helps you understand some key differences and benefits. 

Tuesday Aug 12, 2014

Coherence State of the Union

Six years after I joined Coherence following Oracle’s acquisition of BEA, it is great to see how the industry has embraced In-Memory Data Grid’s as a mainstream technology to scale middleware applications. This adoption is driven by growth in customer demand to manage more and more data, and to act on that data faster and faster. The mission that the Coherence team set upon over a decade ago has come to fruition, and our core team – still intact all this time later even as we continue to grow the team in new directions – is working on new challenges as in-memory data grid based solutions become standard.

The latest release of Coherence and the new announcement of the In-Memory Option for the Oracle Database make this an opportune time to answer some recent questions I’ve received about where Coherence is headed. First lets review the recent announcements.

In June we announced Coherence 12.1.3, the second release of Coherence 12cR1. Coherence 12.1.2, released in 2013, introduced groundbreaking operational improvements like Managed Coherence Servers and GAR files, GoldenGate HotCache to keep caches and databases in sync, and Live Events to respond to state and data changes in real-time. With Coherence 12.1.3 Oracle became the first commercial vendor to support the recently ratified JSR-107 (JCache) spec, the standard for caching on the Java platform. We also introduced a JVisualVM plugin for developers, asynchronous EntryProcessors to allow clients to submit work to the data grid without waiting for a response, memcached client support, and optimization improvements to our Exalogic Infiniband optimizations (Exabus). Check out all the cool new features of Coherence 12.1.3 in our release notes.

In July, Oracle announced the availability of the In-Memory Option for the Oracle Database. The In-Memory Option is designed to accelerate database performance by orders of magnitude for analytics, data warehousing, and reporting by storing columnar data in-memory. It supports ad-hoc queries and full-table scans without requiring application changes; the interface is standard SQL. Maria Colgan answers frequently asked questions about this release on her blog.

The new In-Memory option has also led to some confusion in the In-Memory Data Grid market. Let me try to clarify some of the confusion.

Oracle Coherence is not embedded in the In-Memory Option for the Oracle Database. Although I have seen rumors of this to the contrary, this would make absolutely no sense. Coherence is a distributed key-value store; the in-memory option is a columnar store. The In-Memory option is purpose built and optimized to work as one with the database with its primary access method being SQL. (Of course, Coherence is part of many other Oracle solutions, such as Oracle Service Bus which offers web services results caching via a check box, or the Elastic Charging Engine, which is architected on top of Coherence’s fault-tolerant distributed processing.  (As you can see, Coherence has become strategic within Oracle.)

The In-Memory Option focuses on different use cases than Coherence. In-Memory focuses on ad-hoc full-table scans of unindexed data.  in the words of Maria Colgan "The main use case for the In-Memory column store is fast analytics, which has very different access patterns to OLTP. Typically analytic queries access a few columns from a table but they examine all of the entries in those columns. You need to scan the whole table or segment, not just a small part of the table to answer these queries.” Storing these columns in-memory, in columnar format, speeds full-table scans orders of magnitude.

By contrast, Coherence focuses on providing scale-out data management and processing to middleware applications thereby reducing load on shared services such as databases, mainframes, and web services.  By caching data in domain object format close the application, Coherence also increases responsiveness and availability of applications. 

So if the In-memory Option is not related to Coherence, what has the Coherence team been up to? Glad you asked! Aside from the two 12c releases over the past year, we continue to invest in several strategic areas (you can get a pretty good sneak peak of upcoming releases at Oracle OpenWorld next month).

The Cloud. Oracle has increased investment in accelerating’s Coherence role in our various cloud offerings, from public to private PAAS. Our Coherence cloud team is leveraging investments in Managed Coherence Servers to simplify operations and continue to integrate Coherence into the cloud environment. In addition, Coherence integrates with other Oracle technology to provide a full cloud management solution.

Operational Efficiency. Related to the Cloud, but somewhat separate, we are innovating to reduce the cost it takes, both from a hardware and IT staff perspective, to manage an in-memory data grid solution. I

Maximum Availability Architectures.  Several features in our next release will dramatically increase the availability of data to your applications. Features include new advancements in mutl-datacenter solutions and protecting the availability of the in-memory data grid within a single datacenter.

Developer Productivity.  We continue to invest in new functionality, new integration points (e.g. REST, JSR-107, memcached in recent releases) that complement our native clients. We also invest in new product features that simplify the lives of developers both from an API (Asynchronous EntryProcessors) and from a tooling (JVisual VM plugin and Coherence tooling in Oracle Enterprise Pack for Eclipse, or OEPE).

To get more specific of all these investments, you can join me at my Coherence Product Strategy and Roadmap talk at OpenWorld.

Thursday Feb 06, 2014

NTT Communications Corporation process 1.4M packets p/s using Oracle Coherence

NTT Communications Corporation select Oracle Exalogic,  Oracle Coherence, Oracle Weblogic Server and Oracle Event Processing to maximise application performance and scalability, for a networking monitoring system that processes 1.4 million packets per second through in-memory streaming. Read the full story here.[Read More]

Friday Nov 15, 2013

Hadoop MapReduce and Coherence - A Perfect Match

Leveraging existing powerful Coherence functionality, the solution combines the Real-Time/Fast-Data nature of Coherence In-Memory Data Grids with the popular Hadoop MapReduce API., giving developers the freedom to choose the most appropriate data-store while preserving their existing M/R assets.


[Read More]

Thursday Sep 05, 2013

From Mainframe to Coherence: Is it worth it?

OP-Pohjola Group is the leading financial services group in Finland. It is made up of some 200 member cooperative banks and OP-Pohjola Group Central Cooperative which they own, including its subsidiaries and closely related companies. OP-Pohjola Group has more than four million customers -- joint banking and non-life insurance customers total over one million. With over 530 branches, the Group boasts the broadest customer base and the most extensive branch network in Finland.

OP-Pohjola architecture is based on innovative Java EE technology running on Oracle WebLogic Server. A vital part of their architecture is Oracle Coherence distributed cache which has enabled remarkable cost savings in mainframe request volumes and improved performance in most critical and popular eBanking services. Oracle Coherence has had a critical role in enabling mobile eBanking solution as a cost effective platform to build new services with exponential usage growth. Efficient caching technology has enabled both service efficiency and remarkable savings in mainframe costs with mainframe request volumes dropping by 40%. This mainframe optimization has resulted in both financial cost savings while simultaneously enabling growth of eBanking service volumes. Come join OP-Pohjola in this session to hear about how this customer leverages Oracle technologies such as WebLogic and Coherence to achieve such fantastic results. In addition, while at OpenWorld don’t miss other Cloud Application Foundation Innovator. You can join the session whether you are an OpenWorld attendee or not.

Wednesday Sep 04, 2013

Join Emerson Network Power at OpenWorld discuss Coherence for Real Time Data Processing

Emerson (NYSE: EMR), based in St. Louis, Missouri, is a global leader in bringing technology and engineering together to provide innovative solutions for customers in industrial, commercial, and consumer markets around the world. The company is comprised of five business segments: Process Management, Industrial Automation, Network Power, Climate Technologies, and Commercial & Residential Solutions. Sales in fiscal 2012 were $24.4 billion. Emerson Network Power delivers software, hardware and services that maximize availability, capacity and efficiency for data centers, healthcare, and industrial facilities. A trusted industry leader in smart infrastructure technologies, Emerson Network Power provides innovative data center infrastructure management solutions that bridge the gap between IT and facility management and deliver efficiency and uncompromised availability regardless of capacity demands. Emerson Network Power’s acquisition of Avocent a few years back led to significant growth of the company’s product portfolio and customer base. The acquisition also provided a unique challenge for Emerson, as many of the newly acquired products were built on open source software and were difficult to develop, deploy and manage. Another big issue was integrating all these point-solution products into an integrated suite. In addition, there were scalability and performance concerns. Oracle Fusion Middleware provided Emerson with a more reliable, scalable and integrated infrastructure.

As the data center infrastructure management (DCIM) market matures over the next few years, Emerson believes that customers will need a lot more functionality than they currently realize. Moving forward, customers will need the ability to analyze data, create insights and develop predictive capabilities across the entire infrastructure in real-time. A single, open platform that incorporates hardware and software to meet current and future customer needs in an effective and efficient manner was a major requirement. The most critical customer needs are data scalability, availability and high performance in processing of the real-time data. The Trellis platform represents a groundbreaking DCIM innovation from Emerson Network Power – one that mitigates IT risk while increasing operational  efficiency. Come join Emerson in this session to hear about how this customer leverages Oracle technologies such as Coherence, ADF, CEP, EJB and TopLink and how the Oracle Coherence solution is implemented to satisfy the scalability and high performance of real-time data processing. Also, don’t miss other Cloud Application Foundation Innovators. You can join this session whether you are an OpenWorld attendee or not.

About

Oracle Coherence, the market leading in-memory datagrid product.
Stay Connected...

Search

Archives
« March 2015
SunMonTueWedThuFriSat
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
    
       
Today