Analyst Perspectives

I previously described how Databricks had positioned its Lakehouse Platform as the basis for data engineering, data science and data warehousing. The lakehouse design pattern provides a flexible environment for storing and processing data from multiple enterprise applications and workloads for multiple use cases. I assert that by 2025, 8 in 10 current data lake adopters will invest in data lakehouse architecture to improve the business value generated from the accumulated data.

The 2023 Ventana Research Buyers Guide for DataOps research enables me to provide observations about how the market has advanced. 

The data platforms market may appear to have little or nothing to do with haute couture, but it is one of the data sectors most strongly influenced by the fickle finger of fashion. In recent years, various architectural approaches to data storage and processing have enjoyed a phase in the limelight, including data warehouse, data mart, data hub, data lake, cloud data warehouse, object storage, data lakehouse, data fabric and data mesh. These approaches are often heralded as the next big thing,...

Despite a focus on being data-driven, many organizations find that data and analytics projects fail to deliver on expectations. These initiatives can underwhelm for many reasons, because success requires a delicate balance of people, processes, information and technology. Small deviations from perfection in any of those factors can send projects off the rails.

I have written before about the rising popularity of the data fabric approach for managing and governing data spread across distributed environments comprised of multiple data centers, systems and applications. I assert that by 2025, more than 6 in 10 organizations will adopt data fabric technologies to facilitate the management and processing of data across multiple data platforms and cloud environments. The data fabric approach is also proving attractive to vendors, including Microsoft, as a...

At one point, analytics and business intelligence were considered non-mission critical activities. One of the primary concerns in designing analytics systems was to ensure they didn’t interfere with or draw computing resources away from operational systems. But today, analytical systems are integral to many aspects of operations. More than 9 in 10 participants in our Analytics and Data Benchmark Research reported analytics had improved activities and processes. However, most analytics and BI...

Organizations today have an ever-increasing appetite for platforms that improve the speed and efficiency of data analytics and business intelligence (BI). The ability to quickly process data enables organizations to make well-informed decisions in real time. This agile approach to data processing is crucial for staying ahead in today's competitive landscape. With the rising need for data-driven insights, organizations face the difficulty of dealing with massive volumes of distributed business...

I recently wrote about the various technologies used by organizations to process and analyze data in real time. I explained that while the terms streaming data and events and streaming analytics are often used interchangeably, they are separate disciplines that make use of common underlying concepts and technologies such as events, event brokers and event-driven architecture. Confluent’s acquisition of Immerok earlier this year provided a reminder of this fact. Confluent is one of the most...

Real-time business is a modern phenomenon, and business transformation has accelerated many business events in recent years. However, the execution of business events has always occurred in real time. Rather, it is the processing of the data related to business events that has accelerated instead of the event itself.

It is a mark of the rapid, current pace of development in artificial intelligence (AI) that machine learning (ML) models, until recently considered state of the art, are now routinely being referred to by developers and vendors as “traditional.” Generative AI, and large language models (LLMs) in particular, have taken the AI world by storm in the past year, automating and accelerating the development of content, including text, digital images, audio and video, as well as computer programs and...