Analyst Perspectives

I recently spent time at Strata+Hadoop World 2016 in New York. I attended this event and its predecessor, Hadoop World, off and on for the past six years. This one in New York had a different feel from previous events including the most recent event in San Jose at the end of March. Perhaps because of its location in one of the financial and commercial hubs of the world, the event had much more of a business orientation. But it’s not just location. Past events have been held in New York also,...

Ventana Research recently completed the most comprehensive evaluation of analytics and business intelligence products and vendors available anywhere. As I discussed recently, such research is necessary and timely as analytics and business intelligence is now a fast-changing market. Our Value Index for Analytics and Business Intelligence in 2015 scrutinizes 15 top vendors and their product offerings in seven key categories: Usability, Manageability, Reliability, Capability, Adaptability, Vendor...

Just a few years ago, the prevailing view in the software industry was that the category of business intelligence (BI) was mature and without room for innovation. Vendors competed in terms of feature parity and incremental advancements of their platforms. But since then business intelligence has grown to include analytics, data discovery tools and big data capabilities to process huge volumes and new types of data much faster. As is often the case with change, though, this one has created...

In many organizations, advanced analytics groups and IT are separate, and there often is a chasm of understanding between them, as I have noted. A key finding in our benchmark research on big data analytics is that communication and knowledge sharing is a top benefit of big data analytics initiatives, but often it is a latent benefit. That is, prior to deployment, communication and knowledge sharing is deemed a marginal benefit, but once the program is deployed it is deemed a top benefit. From...

Big data has become a big deal as the technology industry has invested tens of billions of dollars to create the next generation of databases and data processing. After the accompanying flood of new categories and marketing terminology from vendors, most in the IT community are now beginning to understand the potential of big data. Ventana Research thoroughly covered the evolving state of the big data and information optimization sector in 2014 and will continue this research in 2015 and...

Big data has great promise for many organizations today, but they also need technology to facilitate integration of various data stores, as I recently pointed out. Our big data integration benchmark research makes it clear that organizations are aware of the need to integrate big data, but most have yet to address it: In this area our Performance Index analysis, which assesses competency and maturity of organizations, concludes that only 13 percent reach the highest of four levels, Innovative....

Organizations should consider multiple aspects of deploying big data analytics. These include the type of analytics to be deployed, how the analytics will be deployed technologically and who must be involved both internally and externally to enable success. Our recent big data analytics benchmark research assesses each of these areas. How an organization views these deployment considerations may depend on the expected benefits of the big data analytics program and the particular business case...

SAS Institute, a long-established provider analytics software, showed off its latest technology innovations and product road maps at its recent analyst conference. In a very competitive market, SAS is not standing still, and executives showed progress on the goals introduced at last year’s conference, which I covered. SAS’s Visual Analytics software, integrated with an in-memory analytics engine called LASR, remains the company’s flagship product in its modernized portfolio. CEO Jim Goodnight...

I had the pleasure of attending Cloudera’s recent analyst summit. Presenters reviewed the work the company has done since its founding six years ago and outlined its plans to use Hadoop to further empower big data technology to support what I call information optimization. Cloudera’s executive team has the co-founders of Hadoop who worked at Facebook, Oracle and Yahoo when they developed and used Hadoop. Last year they brought in CEO Tom Reilly, who led successful organizations at ArcSight, HP...

While covering providers of business analytics software, it is also interesting for me to look at some that focus on the people, process and implementation aspects in big data and analytics. One such company is Nuevora, which uses a flexible platform to provide customized analytic solutions. I recently met the company’s founder, Phani Nagarjuna, when we appeared on a panel at the Predictive Analytics World conference in San Diego.

Datameer , a Hadoop-based analytics company, had a major presence at recent Hadoop Summit, led by CEO Stephan Groschupf’s keynote and panel appearance. Besides announcing its latest product release, which is an important advance for the company and its users, Datameer’s outspoken CEO put forth contrarian arguments about the current direction of some of the distributions in the Hadoop ecosystem.

Hadoop Summit is the biggest event on the West Coast centered on Hadoop, the open source technology for large-scale data processing. The conference organizers, Hortonworks, estimated that more than 2,400 people attended, which if true would be double-digit growth from last year. Growth on the supplier side was even larger, which indicates the opportunity this market represents. Held in Silicon Valley, the event attracts enterprise customers, industry innovators, thought leaders and venture...

Cisco Systems has announced its intent to acquire Composite Software, which provides data virtualization to help IT departments interconnect data and systems; the purchase is scheduled to complete in early August. Cisco of course is known for its ability to interconnect just about anything with its networking technology; this acquisition will help it connect data better across networks. Over the last decade Composite had been refining the science of virtualizing data but had reached the peak of...

Users of big data analytics are finally going public. At the Hadoop Summit last June, many vendors were still speaking of a large retailer or a big bank as users but could not publically disclose their partnerships. Companies experimenting with big data analytics felt that their proof of concept was so innovative that once it moved into production, it would yield a competitive advantage to the early mover. Now many companies are speaking openly about what they have been up to in their business...

Teradata recently gave me a technology update and a peek into the future of its portfolio for big data, information management and business analytics at its annual technology influencer summit. The company continues to innovate and build upon its Teradata 14 releases and its new processing technology. Since my last analysis of Teradata’s big data strategy, it has embraced technologies like Hadoop with its Teradata Aster Appliance, which won our 2012 Technology Innovation Award in Big Data....

I recently attended the annual Informatica analyst summit to get the latest on that company’s strategy and plans. The data integration provider offers a portfolio of information management software that supports today’s big data and information optimization needs. Informatica is busy making changes in its presentation to the market and its marketing and sales efforts. New executives, including new CMO Marge Breya, are working to communicate what is possible with Informatica’s product portfolio,...

Data is a commodity in business. To become useful information, data must be put into a specific business context. Without information, today’s businesses can’t function. Without the right information, available to the right people at the right time, an organization cannot make the right decisions nor take the right actions, nor compete effectively and prosper. Information must be crafted and made available to employees, customers, suppliers, partners and consumers in the forms they want it at...

Platfora has gained a lot of buzz in the Big Data analytics market primarily through word of mouth. Late last year the company took the covers off of some impressive and potentially disruptive technology that takes aim at the broad BI and business analytics ecosystem, including the very foundation on which the industry is built. It recently demonstrated its software at the Strata Conference where the audience that is fixated on big data was in attendance.

The big-data landscape just got a little more interesting with the release of EMC’s Pivotal HD distribution of Hadoop. Pivotal HD takes Apache Hadoop and extends it with a data loader and command center capabilities to configure, deploy, monitor and manage Hadoop. Pivotal HD, from EMC’s Pivotal Labs division, integrates with Greenplum Database, a massively parallel processing (MPP) database from EMC’s Greenplum division, and uses HDFS as the storage technology. The combination should help sites...

Business is starting to realize that taking advantage of big data is not just technically feasible but affordable by organizations of all sizes. However, as outlined in our agenda on big data and information optimization, the technology must be engineered to the information needs of business. HortonWorks has been steadily advancing its big data technology called Hadoop and contributing its developments back to the Apache Software Foundation for a range of projects. The company performs...

LucidWorks addresses the growing volume of information now being stored in the enterprise and in big data with two products aimed at the enterprise with search technology. Though you may not be familiar with LucidWorks (previously known as Lucid Imagination), the company has for many years contributed to Apache Lucene, an open source search project, and commercialized and supported for it for business.

Big data was big news in 2012 and probably in 2013 too. The Harvard Business Review talks about it as The Management Revolution. The Wall Street Journal says Meet the New Boss: Big Data, and Big Data is on the Rise, Bringing Big Questions. Given big data’s popularity in the press, you might think that the technology market is only about big data and how companies use the vast and growing amount of data now available to organizations. While this technology can provide a significant opportunity,...

The technology ecosystems are expanding rapidly and the use of big data and cloud computing challenge organizations to process information efficiently and deliver consistent high-quality data. To address these issues, Informatica has introduced two new offerings.

At the recent Teradata’s annual Partners user conference, the company outlined its expanding role as a provider distributed information architecture technology. My colleague Tony Cosentino assessed Teradata’s business analytics and big data strategy, but there is more under the covers in regards to the company’s expanding role for big data and enterprise architectures. Over the last several decades Teradata has been known for providing enterprise data warehouse appliances, such as its unveiling...

Karmasphere has an interesting story to tell. Much like Datameer, which I recently blogged about, Karmasphere sits on top of the Hadoop distributed platform where companies such as Cloudera, Hortonworks and MapR compete. Karmasphere provides a collaborative environment and an analytical workbench that help companies write applications and workflows that run on top of Hadoop. The company’s business model looks to leverage legacy skill sets, such as SQL, which are already resident in most...

Actuate, the driving force behind the open source Eclipse Business Intelligence and Reporting Tools (BIRT) project, is positioning itself in the center of the big-data world through multiple partnerships with companies such as Cloudera, Hortonworks, KXEN, Pervasive and a number of OEMs. These agreements, following on its acquisition of Xenos a couple of years ago, help Actuate address some big issues in big data, involving enterprise integration and closed-loop operational systems that provide...

As volumes of data grow in organizations, so do the number of deployments of Hadoop, and as Hadoop becomes widespread, more organizations demand data analysis, ease of use and visualization of large data sets. In our benchmark research on Hadoop, 88 percent of organizations said analyzing Hadoop data is important, and in our research on business analytics 89 percent said it is important to make it simpler to provide analytics and metrics to all users who need them. As my colleague Mark Smith...

Kognitio has been serving the analytics and data needs of organizations for more than 20 years with an in-memory analytics platform that meets many of the big-data needs of today’s organizations. Kognitio Analytical Platform provides a unique massively parallel processing (MPP) in-memory database that can rapidly load data and calculate analytics; it is available both in an analytical software appliance and via cloud computing.

Hadoop, the big-data technology, has transformed businesses’ ability to cost-effectively store and process large volumes of data for analysis. Numerous companies have invested in supporting Hadoop, and some produce commercial versions of the open source technology. At last year’s Hadoop Summit Hortonworks had just started to establish itself as one of these providers. Now, at the 2012 Hadoop Summit, with a new CEO, Rob Bearden, a new head of marketing, John Kreisa, and other hires, it is moving...

In our benchmark research in predictive analytics we’ve uncovered some intriguing tools for taking advantage of big data in the enterprise. Revolution Analytics, which we analyzed earlier this year, this month introduced its 6.0 release. Revolution extends the open source statistical programming language R with capabilities you would expect out of enterprise software. The company has grown substantially over the last several years and has an impressive list of more than a hundred customers in...

Using Hadoop just got easier, thanks to Teradata’s introduction of SQL-H, a new query interface to analyze data from Hadoop.  Most Hadoop access methods require preprocessing and staging of data from the Hadoop Distributed File System (HDFS) using technologies such as MapReduce. These approaches require new skills and technologies, introducing more time and costs for users, which offset the benefits of Hadoop, which according to our big data benchmark research include increasing the speed of...

Informatica has announced a major release, version 9.5, of its software platform, which will be generally available in June. The company’s data integration technologies will support the new generation of computing that includes big data, cloud computing, mobile and social media. These computing environments, which our firm has defined as key business technology drivers for this decade, have a compelling impact on the data that enterprises create and use. Being smart about integrating and...

With the release of Business Analytics version 4.5, Pentaho has expanded its platform and tools to address the needs of business and IT. The product has come a long way since the version 4 release less than a year ago, which broke ground in ease of use and support for big-data sources. Advancing beyond its roots in business intelligence, Pentaho Business Analytics 4.5 addresses data discovery, data integration and data mining and provides visual discovery and analytics that operate against...

Making business use of the vast amount of information on the Web and Internet along with a company’s intranet is no easy task. Kapow Software aims to help by providing tools to define and virtualize access to information, integrate it with other information, such as that in databases, and present it in a useful format. The tool can supply access to data from legacy applications such as PeopleSoft and Siebel, newer applications from Oracle and SAP and applications in cloud computing...

Splunk recently entered the financial markets as a publicly traded company (NASDAQ: SPLK) and also entered a new phase in its corporate growth. Splunk combines the power of search and discovery with analytics on data generated by IT systems, that they call machine data, and provide insight for a new generation of operational intelligence that helps everyone in IT including the CIO determine the efficiency of its systems that support business. The company has built a platform that can index data...

Through a series of acquisitions and organic development over the last five years, IBM has established itself as a leader in enterprise big data for business analytics. I recently wrote about IBM Smarter Analytics, which brings together the company’s portfolio of software, systems and services from analytics to big data. But supporting big data requires the ability to access many sources of information; our benchmark research on big data found that more than half of organizations require...

The increasing pressure to store, retrieve and process data on an unprecedented scale in the enterprise has created a market for processes and tools to support it. Big data, as it’s widely known, is one of the six business technology innovations of the decade outlined in our research agenda, and it has created a renaissance in data management. Our benchmark research on big data finds the top benefits of it to be the ability to retain and analyze more data (74%) and to increase the speed of...

I want to share my observations from the recent annual SAS analyst briefing. SAS is a huge software company with a unique culture and a history of success. Being privately held SAS is not required to make the same financial disclosures as publicly held organizations, it released enough information to suggest another successful year, with more than $2.7 billion in revenue and 10 percent growth in its core analytics and data management businesses. Smaller segments showed even higher growth rates....

MicroStrategy, one of the largest independent vendors of business intelligence (BI) software, recently held its annual user conference, which I attended with some of my colleagues and more than 2,000 other attendees. At this year’s event, the company emphasized four key themes: mobility, cloud computing, big data and social media. In this post, I’ll assess what MicroStrategy is doing in each of the first three areas. My colleague, Mark Smith, covered MicroStrategy’s social intelligence efforts...

My colleague Mark Smith and I recently chatted with executives of Tidemark, a company in the early stages of providing business analytics for decision-makers. It has a roster of experienced executive talent and solid financial backing. There’s a strategic link with Workday that reflects a common background at the operational and investor levels. As it gets rolling, Tidemark is targeting large and very companies as customers for its cloud-based system for analyzing data. It can automate alerts...

Talend recently announced version 5 of its information management platform, which emphasizes unifying its various components. Through a combination of development activities, acquisitions and partnerships, Talend has been steadily building its portfolio of information management capabilities. In addition to its core data integration capabilities, it has added data quality, master data management, application integration and with this release business process management (BPM).

Cloudera’s recent Hadoop World 2011 event confirmed that the world of big data is getting even bigger. As I wrote of last year’s event, Hadoop, the open source large-scale data processing technology, has gone mainstream. And while 75% of the audience attended this year for the first time and so may not have realized the breadth of Hadoop’s acceptance, statistics announced in the opening keynote show widespread use of it. Mike Olson, Cloudera CEO, reported that the event was sold out, with 1,400...

Informatica recently introduced HParser, an expansion of its capabilities for working with Hadoop data sources. Beginning with Version 9.1, introduced earlier this year, Informatica’s flagship product has been able to access data stored in HDFS as either a source or a target for information management processes. However, it could not manipulate or transform the data within the Hadoop environment. With this announcement, Informatica starts to bring its data transformation capabilities to Hadoop.

Oracle made several announcements at its recent Open World event demonstrates its strengths in the business computing market but also that it is standing on the shoulders of giants. The company has developed the expertise, processes and market share to scale out the ideas and innovations of others. Don’t get me wrong: That statement is not an indictment. Large organizations often have challenges with innovation. They are not as nimble as their smaller competitors. On the other hand, small...

Recently Karmasphere introduced version 1.5 of its Analyst product which helps organizations analyze “big data” stored in Hadoop, the open source large-scale data processing technology. An independent software vendor focused exclusively on the Hadoop market, Karmasphere made available a community edition of its developer product in September 2009 and launched the company in March 2010. Since then it has been active and visible in Hadoop-related events including Hadoop World, the IBM Big Data...

I stopped into the Yahoo Hadoop Summit (Twitter: #HadoopSummit) to see how far the open source Hadoop technology has progressed. This open source community has been advancing for years with support from Internet titans like Yahoo, eBay and Facebook. Hadoop, as my colleague David Menninger has written, is now ready to play a large role as organizations try to cope with data on a large scale and solidify their information management agenda.  

For months the speculation was rampant, and now the rumors have proven to be true. Yahoo has officially announced that it will become a player in the emerging Hadoop market. Hadoop provides distributed computing capabilities that enable organizations to process very large amounts of data quickly. Backed by Yahoo and Benchmark Capital, a new entity called Hortonworks has formed around a team from Yahoo that consists of more than 20 key architects of and contributors to the Apache Hadoop project....

Cloudera is riding the wave of big data. I first learned about the company while working at Vertica, one of Cloudera’s partners. Customers that managed large amounts of structured relational data also needed to process large amounts of semistructured data such as the type found in web logs and application logs. The emerging channel of social media provided another source of data lacking the structure that would lend itself to analysis in a relational database. Other organizations needed to...

Informatica has announced version 9.1 for Big Data.  I wrote previously about Informatica 9.1,the latest iteration of the company’s data integration platform, following its industry analyst summit. At that event in February, the company officials alluded to future plans regarding Hadoop and other big-data sources yet to be finalized. This announcement reveals those plans. Informatica will support three types of “big data”: big transaction data from relational databases and data warehouse system,...

It’s clear that now we are living in the era of big data. The stores of data on which modern businesses rely are already vast and increasing at an unprecedented pace. Organizations are capturing data at deeper levels of detail and keeping more history than they ever have before. Managing all of the data is thus emerging as one of the key challenges of the new decade.

If you enjoyed my previous blog, “Hadoop Is the Elephant in the Room,” perhaps you’d be interested in what your organization might do with Hadoop. As I mentioned, the Hadoop World event this week showcased some of the biggest and most mature Hadoop implementations, such as those of eBay, Facebook, Twitter and Yahoo. Those of you who need 8,500 processors and 16 petabytes of storage like eBay likely already know about Hadoop. But is Hadoop relevant to organizations with less data that is still a...

Earlier this week I attended Hadoop World in New York City. Hosted by Cloudera, the one-day event was by almost all accounts a smashing success. Attendance was approximately double that of last year. There were five tracks filled mostly with user presentations. According to Mike Olson, CEO of Cloudera, the conference’s tweet stream (#hw2010) was one of the top 10 trending topics of that morning. Cloudera did an admirable job of organizing the event for the Hadoop community rather than co-opting...

Managing large volumes of enterprise data continues to challenge IT organizations as they deal with administration and storage of no longer just terabytes but now petabytes of data and costs increase accordingly. This massive size of data complicates the underlying issues of where and how to store it easily in low-cost hardware and manage the data efficiently. One attempt at a solution is Hadoop, an open source community-based project. It began as part of Yahoo and was led by Doug Cutting, who...

Managing large volumes of enterprise data continues to challenge IT organizations as they deal with administration and storage of no longer just terabytes but now petabytes of data and costs increase accordingly. This massive size of data complicates the underlying issues of where and how to store it easily in low-cost hardware and manage the data efficiently. One attempt at a solution is Hadoop, an open source community-based project. It began as part of Yahoo and was led by Doug Cutting, who...