Apache ORC is a columnar file type that is common to the Hadoop ecosystem. It is similar in concept to Apache Parquet; Hortonworks Hadoop clusters often...
Apache ORC is a columnar file type that is common to the Hadoop ecosystem. It is similar in concept to Apache Parquet; Hortonworks Hadoop clusters often leveraged ORC – while Cloudera clusters utilized Parquet. Like parquet, ORC is a database file designed for efficient reads. Files embed a schema, data is stored in a compressed columnar format, predicate pushdown enables data pruning – sound familiar? See the Parquet blog post if you want a refresher :) In addition, ORC...
Apache ORC is a columnar file type that is common to the Hadoop ecosystem. It is similar in concept to Apache Parquet; Hortonworks Hadoop clusters often leveraged ORC – while Cloudera clusters...
I'm pleased to announce that Oracle Big Data SQL 4.1 is now available. This is a significant release that enables you to take advantage of new Oracle Database...
I'm pleased to announce that Oracle Big Data SQL 4.1 is now available. This is a significant release that enables you to take advantage of new Oracle Database 19c capabilities plus core Big Data SQL enhancements. Big Data SQL enables organizations to easily analyze data across Apache Hadoop, Apache Kafka, NoSQL, object stores and Oracle Database leveraging their existing Oracle SQL skills, security policies and applications with extreme performance. Oracle Database 19c...
I'm pleased to announce that Oracle Big Data SQL 4.1 is now available. This is a significant release that enables you to take advantage of new Oracle Database 19c capabilities plus core Big Data SQL...
After a successful controlled GA, we are excited to announce general availability for Oracle Big Data Service in the following regions: Ashburn, Sao Paulo,...
After a successful controlled GA, we are excited to announce general availability for Oracle Big Data Service in the following regions: Ashburn, Sao Paulo, Frankfurt, Tokyo, Seoul, London and Phoenix. Oracle Big Data Service is an automated cloud platform service designed for a diverse set of big data use cases and workloads. From agile, short-lived clusters used to tackle specific tasks to long-lived clusters that manage large data lakes, Big Data Service scales to meet...
After a successful controlled GA, we are excited to announce general availability for Oracle Big Data Service in the following regions: Ashburn, Sao Paulo, Frankfurt, Tokyo, Seoul, London and...
We are excited to announce that Oracle Big Data Appliance 5.1 is now publicly available. This is a massive release with major new features across the stack. ...
We are excited to announce that Oracle Big Data Appliance 5.1 is now publicly available. This is a massive release with major new features across the stack. It is based on Cloudera Enterprise 6.2.1 and Oracle NoSQL Database 19.3.2 - allowing our customers to take advantage of the latest Apache Hadoop, Spark, Hive and other core Hadoop and Cloudera Enterprise Data Hub features. Here are key details about the release. Based on Cloudera Enterprise Data Hub (6.2.1) Provides...
We are excited to announce that Oracle Big Data Appliance 5.1 is now publicly available. This is a massive release with major new features across the stack. It is based on Cloudera Enterprise 6.2.1...
One of the popular new Big Data SQL features is its Query Server. You can think of Query Server as an Oracle Database 18c query engine that uses the Hive...
One of the popular new Big Data SQL features is its Query Server. You can think of Query Server as an Oracle Database 18c query engine that uses the Hive metastore to capture table definitions. Data isn’t stored in Query Server; it allows you to access data in Hadoop, NoSQL, Kafka and Object Stores (Oracle Object Store and Amazon S3) using Oracle SQL. Installation and Configuration Architecturally, here’s what a Big Data SQL deployment with Query Server looks like: There...
One of the popular new Big Data SQL features is its Query Server. You can think of Query Server as an Oracle Database 18c query engine that uses the Hive metastore to capture table definitions. Data...
I’m excited to announce the availability of Big Data SQL 4.0. This release is packed with new capabilities: Query more sources – including Oracle Object Store...
I’m excited to announce the availability of Big Data SQL 4.0. This release is packed with new capabilities: Query more sources – including Oracle Object Store and S3 Query data without requiring an Oracle Database using Big Data SQL Query Server Enhanced query processing – pushing aggregations to the Hadoop cluster nodes Support Apache Sentry authorization rules Support for CDH 6 Continued improvements to the install process Big Data SQL 4.0 can be downloaded from...
I’m excited to announce the availability of Big Data SQL 4.0. This release is packed with new capabilities: Query more sources – including Oracle Object Store and S3 Query data without requiring an...
Big Data SQL 4.0 introduces a data processing enhancement that can have a dramatic impact on query performance: distributed aggregation using in-memory...
Big Data SQL 4.0 introduces a data processing enhancement that can have a dramatic impact on query performance: distributed aggregation using in-memory capabilities. Big Data SQL has always done a great job of filtering data on the Hadoop cluster. It does this using the following optimizations: 1) column projection, 2) partition pruning, 3) storage indexes, 4) predicate pushdown. Column projection is the first optimization. If your table has 200 columns – and you are only...
Big Data SQL 4.0 introduces a data processing enhancement that can have a dramatic impact on query performance: distributed aggregation using in-memory capabilities. Big Data SQL has always done a...
Apache Avro is a common data format in big data solutions. Now, these types of files are easily accessible to Oracle Autonomous Databases. One of Avro's key...
Apache Avro is a common data format in big data solutions. Now, these types of files are easily accessible to Oracle Autonomous Databases. One of Avro's key benefits is that it enables efficient data exchange between applications and services. Data storage is compact and efficient – and the file format itself supports schema evolution. It does this by including the schema within each file – with an explanation of the characteristics of each field. In a previous post about...
Apache Avro is a common data format in big data solutions. Now, these types of files are easily accessible to Oracle Autonomous Databases. One of Avro's key benefits is that it enables efficient...
You have idea, you have feedback, you want to be involved in the products and services you use. Of course, so here is the new Idea Lab for Big Data, where you...
You have idea, you have feedback, you want to be involved in the products and services you use. Of course, so here is the new Idea Lab for Big Data, where you can submit your ideas and vote on ideas submitted by others. Visit the Big Data Idea Lab now. What does the Idea Lab let you do, and how do we use your feedback? For all our products and services we (Product Management) define a set of features and functionality that will enhance the products and solves customer...
You have idea, you have feedback, you want to be involved in the products and services you use. Of course, so here is the new Idea Lab for Big Data, where you can submit your ideas and vote on...
