Data Wins: The WibiData Blog

Welcome to 2013!

3 January 2013 By Christophe Bisciglia Comments.

To all of our friends, customers and partners, We here at WibiData wish you a happy and prosperous 2013. Last year was an important year for WibiData. We built out many of our core technologies, setting the stage for some of the incredible applications we will be building this coming year. The WibiData team has been working on big data solutions for quite some time. We’ve built data integration pipelines and deployed advanced analytics solutions for dozens of organizations. Today these fundamental use cases are being adopted and promoted by established vendors such as MicroStrategy and Informatica. We believe that the cutting edge trend in 2013 will be about building Big Data Applications, which means a greater focus on real-time serving technologies such as HBase and Kiji as well as emerging real-time query engines like Impala and Apache Drill. With more data being stored in data reservoirs using Hadoop, organizations now have the opportunity to build incredibly rich Big Data Applications. These applications connect directly with end users, providing each user a highly relevant and personalized experience. Executed properly, all of your organization’s information can be used operationally to improve your application experience, which leads to reduced cost and increased revenue. This is in part why we introduced the Kiji project last year. Kiji gives organizations a free, open source framework for building Big Data Applications on top of the Hadoop ecosystem. We are not the only ones who see 2013 as the year of real-time Big Data Applications. Richard McDougall predicts the coming predominance of the store-everything mentality and the emergence of real-time applications to extract value from data. Big Data vendors are now focusing on real-time revenue generating applications built on the data reservoirs that organizations are creating. In large part, these predictions make it clear that ETL and BI on Hadoop are now well understood by vendors and early adopters. We no longer need Java developers writing low-level MapReduce progarms to apply Hadoop to those types of challenges. Organizations can take advantage of higher level tools that work with Hadoop’s scalability and cost effectiveness to achieve an ever lower cost of implementation. This leaves us with one critical question before we can kick off the year: what exactly is a Big Data Application? The differentiating factor between established applications and those that use Big Data is the ability of an application to dynamically adapt based on new data. This includes the ability to rescore models as sensor data fluctuates, incorporate external factors - such as weather and social media - that become relevant and modify the next best action each time end user behavior changes. Most applications make decisions using a bevy of rules and relying on select fractions of data. Products that claim real-time decisions or contextualized results largely operate in silos, using just the data that someone thought to include when the application was first deployed, not the most relevant and important data. Does this myopic use of data sound familiar? Big Data Applications use the full power of all of an organization’s data in order to create better application experiences. A common use for data is application personalization. Once understood to mean that users could upload their pictures and change their background color, today’s personalized applications take a much more subtle approach. When companies like Google, Facebook, LinkedIn and Twitter personalize their applications they are focused on content order, presentation, layout, workflow and influence. They use all of the data at their disposal to drive their users toward better outcomes such as accurate search results, more engaging stories and rekindling lost relationships. This is why these organizations have delivered better products, increased user engagement, enlarged their advertising market share beat their competitors who had “one size fits all” solutions. We are seeing the next generation of Big Data Applications such as personalization emerging beyond the web space and expect the pace of adoption to increase in 2013. Starting with advertising and mobile, and followed by retail and financial services, organizations are identifying the importance of building a comprehensive view of their customers. This 360 degree view allows organizations to deploy Big Data Applications that lead to transformative experiences including healthier patients, lower energy usage and more secure banking. The opportunity to create more efficient and relevant experiences is much larger when you consider every transaction for every type of good and service around the globe. Over the coming years, Big Data Applications will become pervasive. Built on the backbone of the Hadoop platform and integrated with existing technologies, Big Data Applications will allow organizations to create better application experiences for their customers. Personalized medicine, perfectly matched content and automated energy optimization will become possible because of the data we have amassed and the technologies we are using to tame it. These are just a few of the new opportunities for Big Data Applications and examples of the solutions that WibiData is delivering. We are excited about what 2013 has in store and we hope you are to.

comments powered by Disqus