IntroductionIn our ongoing exploration of Hive UDFs, we've covered the basic row-wise UDF. Today we'll move to the UDTF, which generates multiple rows for...
IntroductionIn our ongoing exploration of Hive UDFs, we've covered the basic row-wise UDF. Today we'll move to the UDTF, which generates multiple rows for every row processed. This UDF built its house from sticks: it's slightly more complicated than the basic UDF and allows us an opportunity to explore how Hive functions manage type checking. We'll step through some of the more interesting pieces, but as before the full source is available on github here.Extending...
IntroductionIn our ongoing exploration of Hive UDFs, we've covered the basic row-wise UDF. Today we'll move to the UDTF, which generates multiple rows for every row processed. This UDF built its...
Introduction In our ongoing series of posts explaining the in's and out's of Hive User Defined Functions, we're starting with the simplest case. Of the three...
Introduction In our ongoing series of posts explaining the in's and out's of Hive User Defined Functions, we're starting with the simplest case. Of the three little UDFs, today's entry built a straw house: simple, easy to put together, but limited in applicability. We'll walk through important parts of the code, but you can grab the whole source from github here. Extending UDF The first few lines of interest are very straightforward: @Description(name = "moving_avg", value...
Introduction In our ongoing series of posts explaining the in's and out's of Hive User Defined Functions, we're starting with the simplest case. Of the three little UDFs, today's entry built a straw...
Introduction User-defined Functions (UDFs) have a long history of usefulness in SQL-derived languages. While query languages can be rich in their...
Introduction User-defined Functions (UDFs) have a long history of usefulness in SQL-derived languages. While query languages can be rich in their expressiveness, there's just no way they can anticipate all the things a developer wants to do. Thus, the custom UDF has become commonplace in our data manipulation toolbox. Apache Hive is no different in this respect from other SQL-like languages. Hive allows extensibility via both Hadoop Streaming and compiled Java. However,...
Introduction User-defined Functions (UDFs) have a long history of usefulness in SQL-derived languages. While query languages can be rich in their expressiveness, there's just no way they...
About a year ago we did a comparison (with an update here) of Build your Own Hadoop cluster and a Big Data Appliance, where we focused purely on the hardware...
About a year ago we did a comparison (with an update here) of Build your Own Hadoop cluster and a Big Data Appliance, where we focused purely on the hardware and software cost. We thought it could use an update, but luckily an analyst firm did one for us and this time it covers both the Hardware/Software costs, but also ventures a lot more into dealing with other costs. Read all about it in ESG's Getting Real About Big Data, Build vs Buy (Feb 2013) here. Some highlights from...
About a year ago we did a comparison (with an update here) of Build your Own Hadoop cluster and a Big Data Appliance, where we focused purely on the hardware and software cost. We thought it could...
Look no further, Infosys today announced its Infosys BigDataEdge developer platform to drive value from your big data stack. By empowering business users to...
Look no further, Infosys today announced its Infosys BigDataEdge developer platform to drive value from your big data stack. By empowering business users to rapidly develop insights from vast amounts of structured and unstructured data, better business decisions can be made in near real-time. With Infosys BigDataEdge, enterprises can reduce the time taken to extract information by up to 40 percent and generate insights up to eight times faster. Read More.
Look no further, Infosys today announced its Infosys BigDataEdge developer platform to drive value from your big data stack. By empowering business users to rapidly develop insights from vast amounts...
Contrary to my habit of posting How-To articles, today I'm not going to tell you how to do anything. Instead, I'm going to ask you to go do something. What I...
Contrary to my habit of posting How-To articles, today I'm not going to tell you how to do anything. Instead, I'm going to ask you to go do something. What I want you to do is check out the series of video tutorials I'm doing around pieces of the Hadoop ecosystem and Big Data analytics. The first entry is on YouTube and in the Big Data Playlist on Oracle Media Network. It gives a brief overview of setting up Flume flows into HDFS. Of course, if you're looking for a more...
Contrary to my habit of posting How-To articles, today I'm not going to tell you how to do anything. Instead, I'm going to ask you to go do something. What I want you to do is check out the series...
Introduction I am less and less often mistaken for a pirate when I mention the R language. While I miss the excuse to wear an eyepatch, I'm glad more people...
Introduction I am less and less often mistaken for a pirate when I mention the R language. While I miss the excuse to wear an eyepatch, I'm glad more people are beginning to explore a statistical language I've been touting for years. When it comes to plotting or running complex statistics in a single line of code, R is a great tool to have. That said, there are plenty of pitfalls for the casual or new user: syntax, learning to write vectorized code, or even just knowing...
Introduction I am less and less often mistaken for a pirate when I mention the R language. While I miss the excuse to wear an eyepatch, I'm glad more people are beginning to explore a statistical...
For those who attended the BIWA Summit a few weeks ago, you would have seen the data scientist certification. BIWA just listed the first batch of data...
For those who attended the BIWA Summit a few weeks ago, you would have seen the data scientist certification. BIWA just listed the first batch of data scientists it certified:Instructor Level Certificate - Brendan Tierney Oracle Data Scientist Certificate Don Ferguson, CherryRoad TechnologiesJorge Anicama, IBM (GBS)Tim Vlamis, Vlamis Software SolutionsVijayalakshmi Muthukrishnan, MotorolaSicheng Liu, Deloitte ConsultingAvik Bhattacharya, Printpack Inc.Ari Kaplan,...
For those who attended the BIWA Summit a few weeks ago, you would have seen the data scientist certification. BIWA just listed the first batch of data scientists it certified:Instructor Level ...
Announcing the first Big Data Developer Day. A full day with two tracks and hands-on on all things Big Data at Oracle!!An influx of new data types combined with...
Announcing the first Big Data Developer Day. A full day with two tracks and hands-on on all things Big Data at Oracle!!An influx of new data types combined with new approaches for analyzing data are creating untapped growth opportunities that have the potential to transform your business. Oracle is the first vendor to provide a complete and integrated set of enterprise-ready products to address the full spectrum of big data business requirements. Jumpstart your understanding...
Announcing the first Big Data Developer Day. A full day with two tracks and hands-on on all things Big Data at Oracle!!An influx of new data types combined with new approaches for analyzing data...
