Analyst Perspectives

Databricks recently hosted its Data+AI Summit in San Francisco, an event that attracted 22,000 attendees. That’s a far cry from the Spark Summit I attended in 2016. As pointed out in my coverage of Databricks massive funding round earlier this year, the company was originally founded as a provider of cloud-based Apache Spark services. Since its inception, Spark has been associated with processing big data, and over time this has become almost synonymous with AI. Consequently, the event became...

One of the key questions that will need to be solved if agentic artificial intelligence is to fulfill its potential is which technologies and providers will serve the role of orchestrating communication and integration between the various models, applications and data repositories involved. ISG Research defines agentic AI as software designed to execute business processes through autonomous actions, potentially controlling multiple processes and systems through the orchestration of one or more...

If a single phrase could sum up the big data craze of a dozen or so years ago, it would be “more data beats better algorithms.” Attributed to Google research director Peter Norvig, the quote effectively summarized a research paper Norvig jointly authored called The Unreasonable Effectiveness of Data and was embraced by big data enthusiasts as articulating the prevalent thinking that enterprises with the largest volumes of data have an advantage over rivals. The phrase was, of course, an...

I have previously described how data as a product was initially closely aligned with data mesh, a cultural and organizational approach to distributed data processing. As a result of data mesh’s association with distributed data, many assumed that the concept was diametrically opposed to the data lake, which offered a platform for combining large volumes of data from multiple data sources. That assumption was always misguided: There was never any reason why data lakes could not be used as a data...

I recently described how business data catalogs are evolving into data intelligence catalogs. These catalogs combine technical and business metadata and data governance capabilities with knowledge graph functionality to deliver a holistic, business-level view of data production and consumption. The concept of the knowledge graph has been part of the data sector for decades, but adoption has typically been limited to industries and enterprises focused on the Semantic Web, such as media,...

Data governance has always been a critical part of the data and analytics landscape. However, for many years, it was seen as a preventive function to limit access to data and ensure compliance with security and data privacy requirements. To fulfill today’s data-driven agendas, many enterprises need an evolved perspective on data governance. The development of new applications driven by artificial intelligence requires a more agile and collaborative approach to data governance—one that automates...

It has been a little over a decade since the term data operations entered the analytics and data lexicon. It describes the application of agile development, DevOps and lean manufacturing by data engineering professionals in support of data production. DataOps was initially seen as antithetical to traditional data management approaches, which typically included batch-based and manual tools and practices. The term was embraced by emerging software providers as a means of differentiating from...

In an earlier Analyst Perspective, I discussed data democratization’s role in creating a data-driven enterprise agenda. Building a foundation of self-service data discovery, data-driven organizations provide more workers with the ability to analyze and use data. I’ve also examined how generative artificial intelligence (GenAI) could revolutionize business intelligence software by using natural language interfaces to lower the barriers to working with analytics software. Today, however, data...

SAP was formed in 1972 to create standardized business software that would integrate all business processes and enable data processing in real time. Following the success of the initial release and subsequent R/2, the company went public in 1988 and has grown into one of the world’s largest software companies, reporting more than $37 billion in revenues in its most recent annual report. Through internal development efforts and numerous acquisitions, including Business Objects, Sybase, Ariba,...