Increased enterprise focus on artificial intelligence (AI) and generative AI (GenAI) has served to sharpen the focus on the need for trusted data and reliable analytics and data operations. The ISG State of Generative AI Market Report highlighted that elevated expectations and demands associated with AI are a forcing function for enterprises to take long-overdue steps to improve data and analytics processes to ensure that data that is clean, well-organized and compliant with regulatory...
Read More
Topics:
Analytics,
AI,
data operations,
Analytics and Data
Late 2024 saw the publication of the 2024 ISG Buyers Guides for DataOps, providing an assessment of 49 software providers offering products used by data engineers, data scientists, and data and AI professionals to facilitate the use of data for analytics and AI needs. The DataOps Buyers Guide research includes five reports which are focused on overall DataOps, Data Observability, Data Orchestration, Data Pipelines and Data Products. This is the first time in the industry when all software...
Read More
Topics:
Analytics,
data operations,
Analytics and Data
I previously explained that data observability software has become a critical component of data-driven decision-making. Data observability addresses one of the most significant impediments to generating value from data by providing an environment for monitoring the quality and reliability of data on a continual basis. Maintaining quality and trust is a perennial data management challenge, the importance of which has come into sharper focus in recent years thanks to the rise of artificial...
Read More
Topics:
AI,
data operations,
Analytics and Data
The adoption of cloud environments for analytic workloads has been a key feature of the data platforms sector in recent years. For two-thirds (66%) of participants in ISG’s Data Lake Dynamic Insights Research, the primary data platform used for analytics is cloud based. Many enterprises adopted cloud-based analytic data platforms with a view to improving operational efficiencies by reducing the need for upfront investment in physical infrastructure as well as the ability to scale cloud services...
Read More
Topics:
data operations,
Analytics and Data
I previously wrote about data mesh as a cultural and organizational approach to distributed data processing. Data mesh has four key principles—domain-oriented ownership, data as a product, self-serve data infrastructure and federated governance—each of which is being widely adopted. I assert that by 2027, more than 6 in 10 enterprises will adopt technologies to facilitate the delivery of data as a product as they adapt their cultural and organizational approaches to data ownership in the...
Read More
Topics:
data operations,
Analytics and Data
I recently wrote about the role data observability plays in generating value from data by providing an environment for monitoring its quality and reliability. Data observability is a critical functional aspect of Data Operations, alongside the development, testing and deployment of data pipelines and data orchestration, as I explained in our Data Observability Buyers Guide. Maintaining data quality and trust is a perennial data management challenge, often preventing organizations from operating...
Read More
Topics:
data operations,
Analytics and Data
Enterprises are embracing the potential for artificial intelligence (AI) to deliver improvements in productivity and efficiency. As they move from initial pilots and trial projects to deployment into production at scale, many are realizing the importance of agile and responsive data processes, as well as tools and platforms that facilitate data management, with the goal of improving trust in the data used to fuel analytics and AI. This has led to increased attention on the role of data...
Read More
Topics:
data operations,
Analytics and Data,
AI and Machine Learning
I recently wrote about the development, testing and deployment of data pipelines as a fundamental accelerator of data-driven strategies as well as the importance of data orchestration to accelerate analytics and artificial intelligence. As I explained in the recent Data Observability Buyers Guide, data observability software is also a critical aspect of data-driven decision-making. Data observability addresses one of the most significant impediments to generating value from data by providing an...
Read More
Topics:
Analytics,
data operations,
Analytics and Data,
AI and Machine Learning
I recently wrote about the development, testing and deployment of data pipelines as a fundamental accelerator of data-driven strategies. As I explained in the 2023 Data Orchestration Buyers Guide, today’s analytics environments require agile data pipelines that can traverse multiple data-processing locations and evolve with business needs.
Read More
Topics:
Analytics,
data operations,
Analytics and Data,
AI and Machine Learning
Enterprises are increasingly recognizing the need to streamline operations for efficiency, agility and innovation. This has led to various “operations” or “Ops” initiatives, each focusing on a specific aspect of enterprise IT. From software development and data analytics to IT and cloud management, these Ops groups are transforming the way enterprises operate and compete.
Read More
Topics:
Analytics,
Cloud Computing,
Digital Technology,
data operations,
Analytic Operations,
AIOps
I wrote recently about the role that data intelligence has in enabling enterprises to facilitate data democratization and the delivery of data as a product. Data intelligence provides a holistic view of how, when, and why data is produced and consumed across an enterprise, and by whom. This information can be used by data teams toensure business users and data analysts are provided with self-service access to data that is pertinent to their roles and requirements. Delivering data as a product...
Read More
Topics:
Analytics,
Data Ops,
data operations,
Analytics and Data,
AI and Machine Learning
Data and analytics have become increasingly important to all aspects of business. The modern data and analytics stack includes many components, which creates challenges for enterprises and software providers alike. As my colleague Matt Aslett points out, a better term might be modern data and analytics smorgasbord. There are arguments for and against using an assortment of tools versus a consolidated platform. For example, purchasing, integrating and deploying a variety of tools can be complex....
Read More
Topics:
Analytics,
AI,
data operations,
Analytics and Data
The development, testing and deployment of data pipelines is a fundamental accelerator of data-driven strategies, enabling enterprises to extract data from the operational applications and data platforms designed to run the business and load, integrate and transform it into the analytic data platforms and tools used to analyze the business. As I explained in our recent Data Pipelines Buyers Guide, data pipelines are essential to generating intelligence from data. Healthy data pipelines are...
Read More
Topics:
Analytics,
data operations,
Analytics and Data,
AI and Machine Learning
As enterprises seek to increase data-driven decision-making, many are investing in strategic data democratization initiatives to provide business users and data analysts with self-service access to data across the enterprise. Such access has long been a goal of many enterprises, but few have achieved it. Only 15% of participants in Ventana Research’s Analytics and Data Benchmark Research say their organization is very comfortable allowing business users to work with data that has not been...
Read More
Topics:
Analytics,
data operations,
Analytics and Data,
AI and Machine Learning
We live in an era of uncertainty, not unpredictability. Managing in uncertain times is always difficult, but tools are available to improve the odds for success by making it easier and faster to plan for contingencies and scenarios. Software makes it possible to manage ahead of any future event, connecting the tactical trees to the strategic forest. The purpose of planning is not just to create a plan: Enterprises spend time thinking ahead because it enables leadership teams, executives and...
Read More
Topics:
Office of Finance,
Continuous Planning,
Data Management,
Business Planning,
data operations,
AI and Machine Learning
I have previously written about the functional evolution and emerging use cases for NoSQL databases, a category of non-relational databases that first emerged 15 or so years ago and are now well established as potential alternatives to relational databases. NoSQL is a term used to describe a variety of databases that fall into four primary functional categories: key-value stores, wide-column stores, document-oriented databases and graph databases. Each is worthy of further exploration, which is...
Read More
Topics:
Data,
data operations
In recent years, many enterprises have migrated data platform workloads from on-premises infrastructure to cloud environments, attracted by the promised benefits of greater agility and lower costs. The scale of cloud data platform adoption is illustrated by Ventana Research’s Data Lakes Dynamic Insights research: For two-thirds (66%) of participants, the primary data platform used for analytics is cloud based. As the quantity and importance of the data platform workloads deployed in the cloud...
Read More
Topics:
business intelligence,
Cloud Computing,
data operations,
robotic automation,
analytic data platforms,
Analytics and Data,
AI and Machine Learning
Ventana Research recently announced its 2024 Market Agenda for Analytics and Data, continuing the guidance we have offered for two decades to help enterprises derive optimal value and improve business outcomes.
Read More
Topics:
embedded analytics,
Analytics,
Business Intelligence,
Data Governance,
Data Management,
natural language processing,
data operations,
Process Mining,
Streaming Analytics,
Streaming Data Events,
analytic data platforms,
Analytics and Data
As articulated in Ventana Research’s Data Platforms Buyer’s Guide and DataOps Buyer’s Guide research, the combination of cloud computing and advanced analytics has lowered the cost of storing and processing large volumes of data, accelerating the emergence of new data platform and data operations products that enable organizations to gain operational efficiency and competitive advantage. The right combination of data platform and data management products is essential to ensure that the right...
Read More
Topics:
Data Management,
Data,
Digital Technology,
data operations,
analytic data platforms,
Analytics and Data
The phrase ‘big data’ may have largely gone out of fashion, but the concept of storing and processing all relevant data continues to be important for enterprises seeking to be more data-driven. Doing so requires analytic data platforms capable of storing and processing data in multiple formats and data models. This will be an important focus for the forthcoming Data Platforms Buyer’s Guide 2024.
Read More
Topics:
Analytics,
Business Intelligence,
Data Management,
Data,
Digital Technology,
data operations,
Analytics and Data,
AI and Machine Learning
I recently discussed how fashion has a surprisingly significant role to play in the data market as various architectural approaches to data storage and processing take turns enjoying a phase in the limelight. Pendulum swing is a theory of fashion that describes the periodic movement of trends between two extremes, such as short and long hemlines or skinny and baggy/flared trousers. Pendulum swing theory is similarly a factor in data technology trends, with an example being the oscillation...
Read More
Topics:
Analytics,
Cloud Computing,
Data Management,
Data,
Digital Technology,
data operations,
Analytics and Data,
AI and Machine Learning
I have previously written about the functional evolution and emerging use cases for NoSQL databases, a category of non-relational databases that first emerged 15 or so years ago and are now well established as potential alternatives to relational databases. NoSQL is a term used to describe a variety of databases that fall into four primary functional categories: key-value stores, wide-column stores, document-oriented databases and graph databases. Each is worthy of further exploration, which is...
Read More
Topics:
Cloud Computing,
Data,
Digital Technology,
data operations,
Analytics and Data
Alteryx was founded in 1997 and initially focused on analyzing demographic and geographically organized data. In 2006, the company released its eponymous product that established its direction for what the product is today. In 2017, it went public in an IPO on the NYSE. At the time of the IPO, Alteryx was focusing much of its marketing efforts on the data preparation market, particularly to support Tableau. Throughout this time though, Alteryx offered much more than data preparation. As a...
Read More
Topics:
business intelligence,
Analytics,
data operations,
Analytic Operations,
Analytics and Data,
AI and Machine Learning
I previously discussed the trust and accuracy limitations of large language models, suggesting that data and analytics vendors provide guidance about potentially inaccurate results and the risks of creating a misplaced level of trust. In the months that have followed, we are seeing some clarity from these vendors about the approaches organizations can take to increase trust and accuracy when developing applications that incorporate generative AI, including fine-tuning and prompt engineering. It...
Read More
Topics:
Analytics,
Business Intelligence,
Data,
Digital Technology,
natural language processing,
data operations,
analytic data platforms,
Analytics and Data
I am happy to share insights gleaned from our latest Buyers Guide, an assessment of how well vendors’ offerings meet buyers’ requirements. TheVentana Research 2023 Data Observability Buyers Guide is the distillation of a year of market and product research by Ventana Research. Drawing on our Benchmark Research, we apply a structured methodology built on evaluation categories that reflect the real-world criteria incorporated in a request for proposal to data vendors supporting the spectrum of...
Read More
Topics:
Data,
data operations
The 2023 Ventana Research Buyers Guide for Data Observability research enables me to provide observations about how the market has advanced.
Read More
Topics:
Data,
data operations
I am happy to share insights gleaned from our latest Buyers Guide, an assessment of how well vendors’ offerings meet buyers’ requirements. The Ventana Research 2023 Data Orchestration Buyers Guide is the distillation of a year of market and product research by Ventana Research. Drawing on our Benchmark Research, we apply a structured methodology built on evaluation categories that reflect the real-world criteria incorporated in a request for proposal to data vendors supporting the spectrum of...
Read More
Topics:
Data,
data operations
The 2023 Ventana Research Buyers Guide for Data Orchestration research enables me to provide observations about how the market has advanced.
Read More
Topics:
Data,
data operations
I am happy to share insights gleaned from our latest Buyers Guide, an assessment of how well vendors’ offerings meet buyers’ requirements. The Ventana Research 2023 Data Pipelines Buyers Guide is the distillation of a year of market and product research by Ventana Research. Drawing on our Benchmark Research, we apply a structured methodology built on evaluation categories that reflect the real-world criteria incorporated in a request for proposal to Data vendors supporting the spectrum of Data...
Read More
Topics:
Data,
data operations
The 2023 Ventana Research Buyers Guide for Data Pipelines research enables me to provide observations about how the market has advanced.
Read More
Topics:
Data,
data operations
I am happy to share insights gleaned from our latest Buyers Guide, an assessment of how well vendors’ offerings meet buyers’ requirements. The Ventana Research 2023 DataOps Buyers Guide is the distillation of a year of market and product research by Ventana Research. Drawing on our Benchmark Research, we apply a structured methodology built on evaluation categories that reflect the real-world criteria incorporated in a request for proposal to Data vendors supporting the spectrum of DataOps....
Read More
Topics:
Data,
Data Ops,
data operations
The 2023 Ventana Research Buyers Guide for DataOps research enables me to provide observations about how the market has advanced.
Read More
Topics:
Data,
Data Ops,
data operations
The data platforms market may appear to have little or nothing to do with haute couture, but it is one of the data sectors most strongly influenced by the fickle finger of fashion. In recent years, various architectural approaches to data storage and processing have enjoyed a phase in the limelight, including data warehouse, data mart, data hub, data lake, cloud data warehouse, object storage, data lakehouse, data fabric and data mesh. These approaches are often heralded as the next big thing,...
Read More
Topics:
Cloud Computing,
Data Governance,
Data Management,
Data,
Digital Technology,
data operations,
Streaming Data Events,
analytic data platforms,
Analytics and Data,
AI and Machine Learning
Despite a focus on being data-driven, many organizations find that data and analytics projects fail to deliver on expectations. These initiatives can underwhelm for many reasons, because success requires a delicate balance of people, processes, information and technology. Small deviations from perfection in any of those factors can send projects off the rails.
Read More
Topics:
Analytics,
Business Intelligence,
Data Management,
Data,
Digital Technology,
data operations,
AI and Machine Learning
At one point, analytics and business intelligence were considered non-mission critical activities. One of the primary concerns in designing analytics systems was to ensure they didn’t interfere with or draw computing resources away from operational systems. But today, analytical systems are integral to many aspects of operations. More than 9 in 10 participants in our Analytics and Data Benchmark Research reported analytics had improved activities and processes. However, most analytics and BI...
Read More
Topics:
Analytics,
Business Intelligence,
Data Management,
Data,
Digital Technology,
data operations,
Analytics and Data
Organizations today have an ever-increasing appetite for platforms that improve the speed and efficiency of data analytics and business intelligence (BI). The ability to quickly process data enables organizations to make well-informed decisions in real time. This agile approach to data processing is crucial for staying ahead in today's competitive landscape. With the rising need for data-driven insights, organizations face the difficulty of dealing with massive volumes of distributed business...
Read More
Topics:
Data Management,
Data,
data operations,
analytic data platforms
Despite best intentions, many organizations still struggle with some fundamental aspects of data processing and analytics. Taking data from operational applications and making it available for analysis is a first step, but data management remains a perennial challenge. Data movement and transformation difficulties can lead to delays and data quality problems that prevent organizations from generating value from data. The inability to govern and integrate data from multiple data sources prevents...
Read More
Topics:
Cloud Computing,
Data Management,
Data,
Digital Technology,
data operations,
Analytics and Data
Maintaining data quality and trust is a perennial data management challenge, often preventing organizations from operating at the speed of business. Recent years have seen the emergence of data observability as a category of DataOps focused on monitoring the quality and reliability of data used for analytics and governance projects and associated data pipelines. There is clear overlap with data quality, which is more established as both a discipline and product category for improving trust in...
Read More
Topics:
Data Management,
Data,
data operations
Organizations increasingly rely on real-time analytics to make informed decisions and stay competitive in today’s data-driven business landscape. As the complexity of data grows with the continuous addition of diverse sources, customers and workers alike expect real-time responsiveness. Accelerated query performance is crucial to process and extract valuable insights from data in a timely manner. Traditional analytics applications are often insufficient for managing the scale, velocity and...
Read More
Topics:
Data Management,
Data,
data operations,
Streaming Data Events,
analytic data platforms
Data fabric has grown in popularity as organizations struggle to manage data spread across multiple data centers, systems and applications. By providing a technology-driven approach to automating data management and governance across distributed environments, data fabric is attractive to organizations seeking to simplify and standardize data management. I assert that by 2025, more than 6 in 10 organizations will adopt data fabric technologies to facilitate the management and processing of data...
Read More
Topics:
Cloud Computing,
Data Management,
Data,
Digital Technology,
data operations,
analytic data platforms,
Analytics and Data
The Office of Finance can be compared to a numbers factory where the main raw material, data, is transformed into financial statements, management accounting, analyses, forecasts, budgets, regulatory filings, tax returns and all kinds of reports. Data is the strategic raw material of the finance and accounting department. It is the key ingredient in every sale and purchase as well as every transaction of any description. Quality control is essential to achieving high standards of output in any...
Read More
Topics:
Office of Finance,
embedded analytics,
Analytics,
Business Intelligence,
Data Management,
Business Planning,
ERP and Continuous Accounting,
data operations,
analytic data platforms,
AI and Machine Learning
Master data management may not attract the same level of excitement as fashionable topics such as DataOps or Data Platforms, but it remains one of the most significant aspects of an organization’s strategic approach to data management. Having trust in data is critical to the ability of an organization to make data-driven business decisions. Along with data quality, MDM enables organizations to ensure data is accurate, complete and consistent to fulfill operational business objectives.
Read More
Topics:
Data Governance,
Data Management,
Data,
data operations
To execute more data-driven business strategies, organizations need linked and comprehensive data that is available in real time. By consistently managing data across siloed systems and ensuring that data definitions are agreed and current, organizations can overcome the challenges presented by data being distributed across an increasingly disparate range of applications and data-processing locations. Maintaining data quality is a perennial data management challenge, often preventing...
Read More
Topics:
Data Management,
Data,
data operations
Data Operations (DataOps) has been part of the lexicon of the data market for almost a decade, with the term used to describe products, practices and processes designed to support agile and continuous delivery of data analytics. DataOps takes inspiration from DevOps, which describes a set of tools, practices and philosophy used to support the continuous delivery of software applications in the face of constant changes. DataOps describes a set of tools, practices and philosophy used to ensure...
Read More
Topics:
Data Governance,
Data Management,
Data,
data operations
As data continues to grow and evolve, organizations seek better tools and technologies to employ data faster and more efficiently. Finding and managing data remains a perennial challenge for most organizations, and is exacerbated by increasing volumes of data and an expanding array of data formats. At the same time, organizations must comply with a growing list of national and regional rules and regulations, such as General Data Protection Regulation and the California Consumer Privacy Act....
Read More
Topics:
Data Governance,
Data Management,
Data,
data operations
I have previously written about the importance of data democratization as a key element of a data-driven agenda. Removing barriers that prevent or delay users from gaining access to data enables it to be treated as a product that is generated and consumed, either internally by employees or externally by partners and customers. This is particularly important for organizations adopting the data mesh approach to data ownership, access and governance. Data mesh is an organizational and cultural...
Read More
Topics:
Cloud Computing,
Data Governance,
Data Management,
Data,
Digital Technology,
data operations,
Analytics and Data
Now more than ever, effective data management is crucial to enable decision-makers to better assess information and take calculated actions. It is also important to keep up with the latest trends and technologies to derive higher value from data and analytics and maintain a competitive edge in the market. However, every organization faces challenges with data management and analytics. And as organizations scale, the complexity only increases, creating a need for better data governance, data...
Read More
Topics:
Analytics,
Data Governance,
Data Management,
Data,
data operations,
analytic data platforms
The market for data and analytics products is constantly evolving, with the emergence of new approaches to data persistence, data processing and analytics. This enables organizations to constantly adapt data analytics architecture in response to emerging functional capabilities and business requirements. It can, however, also be a challenge. Investments in data platforms cannot be constantly written-off as organizations adopt new products for new approaches. Too little change can lead to...
Read More
Topics:
Data Governance,
Data Management,
Data,
data operations
Data observability was a hot topic in 2022 and looks likely to be a continued area of focus for innovation in 2023 and beyond. As I have previously described, data observability software is designed to automate the monitoring of data platforms and data pipelines, as well as the detection and remediation of data quality and data reliability issues. There has been a Cambrian explosion of data observability software vendors in recent years, and while they have fundamental capabilities in common,...
Read More
Topics:
Cloud Computing,
Data Management,
Data,
Digital Technology,
data operations,
Analytics and Data
Organizations across various industries collect multiple types of data from disparate systems to answer key business questions and deliver personalized experiences for customers. The expanding volume of data increases complexity, and data management becomes a challenge if the process is manual and rules-based. There can be numerous siloed, incomplete and outdated data sources that result in inaccurate results. Organizations must also deal with concurrent errors – from customers to products to...
Read More
Topics:
Data Governance,
Data Management,
Data,
data operations,
analytic data platforms
Despite the emphasis on organizations being more data-driven and making an increasing proportion of business decisions based on data and analytics, it remains the case that some of the most fundamental questions about an organization are difficult to answer using data and analytics. Ostensibly simple questions such as, “how many customers does the organization have?” can be fiendishly difficult to answer, especially for organizations with multiple business entities, regions, departments and...
Read More
Topics:
Cloud Computing,
Data Management,
Data,
data operations,
Analytics and Data,
AI and Machine Learning
Ventana Research recently announced its 2023 Market Agenda for Data, continuing the guidance we have offered for two decades to help organizations derive optimal value and improve business outcomes.
Read More
Topics:
Cloud Computing,
Data Governance,
Data Management,
Data,
Digital Technology,
data operations,
Streaming Data Events,
analytic data platforms,
Analytics and Data
Data observability is a hot topic and trend. I have written about the importance of data observability for ensuring healthy data pipelines, and have covered multiple vendors with data observability capabilities, offered both as standalone and part of a larger data engineering system. Data observability software provides an environment that takes advantage of machine learning and DataOps to automate the monitoring of data quality and reliability. The term has been adopted by multiple vendors...
Read More
Topics:
Cloud Computing,
Data Management,
Data,
Digital Technology,
data operations
The shift from on-premises server infrastructure to cloud-based and software-as-a-service (SaaS) models has had a profound impact on the data and analytics architecture of many organizations in recent years. More than one-half of participants (59%) in Ventana Research’s Analytics and Data Benchmark research are deploying data and analytics workloads in the cloud, and a further 30% plan to do so. Customer demand for cloud-based consumption models has also had a significant impact on the products...
Read More
Topics:
Business Intelligence,
Cloud Computing,
Data Management,
Data,
natural language processing,
data operations,
analytic data platforms,
Analytics and Data,
AI and Machine Learning
Ventana Research uses the term “data pantry” to describe a method of data storage (and the technology and process blueprint for its construction) created for a specific set of users and use cases in business-focused software. It’s a pantry because all the data one needs is readily available and easily accessible, with labels that are immediately recognized and understood by the users of the application. In tech speak, this means the semantic layer is optimized for the intended audience. It is...
Read More
Topics:
Continuous Planning,
Business Intelligence,
Data Management,
Business Planning,
Data,
Financial Performance Management,
Enterprise Resource Planning,
continuous supply chain,
data operations,
Streaming Data Events,
Analytics and Data,
AI and Machine Learning
Earlier this year, I wrote about the increasing importance of data observability, an emerging product category that takes advantage of machine learning (ML) and Data Operations (DataOps) to automate the monitoring of data used for analytics projects to ensure its quality and lineage. Monitoring the quality and lineage of data is nothing new. Manual tools exist to ensure that it is complete, valid and consistent, as well as relevant and free from duplication. Data observability vendors,...
Read More
Topics:
Business Intelligence,
Cloud Computing,
Data Management,
Data,
data operations
One of the most significant considerations when choosing an analytic data platform is performance. As organizations compete to benefit most from being data-driven, the lower the time to insight the better. As data practitioners have learnt over time, however, lowering time to insight is about more than just high-performance queries. There are opportunities to improve time to insight throughout the analytics life cycle, which starts with data ingestion and integration, includes data preparation...
Read More
Topics:
Business Intelligence,
Data,
data operations,
analytic data platforms,
AI and Machine Learning
Organizations are increasingly utilizing cloud object storage as the foundation for analytic initiatives. There are multiple advantages to this approach, not least of which is enabling organizations to keep higher volumes of data relatively inexpensively, increasing the amount of data queried in analytics initiatives. I assert that by 2024, 6 in ten organizations will use cloud-based technology as the primary analytics data platform, making it easier to adopt and scale operations as necessary.
Read More
Topics:
Teradata,
Data Governance,
Data Management,
Data,
data operations,
analytic data platforms,
Vantage platform
Almost all organizations are investing in data science, or planning to, as they seek to encourage experimentation and exploration to identify new business challenges and opportunities as part of the drive toward creating a more data-driven culture. My colleague, David Menninger, has written about how organizations using artificial intelligence and machine learning (AI/ML) report gaining competitive advantage, improving customer experiences, responding faster to opportunities and threats, and...
Read More
Topics:
Data Governance,
Data Management,
Data,
data operations,
analytic data platforms,
Analytics and Data,
AI and Machine Learning
If you’ve ever been to London, you are probably familiar with the announcements on the London Underground to “mind the gap” between the trains and the platform. I suggest we also need to mind the gap between data and analytics. These worlds are often disconnected in organizations and, as a result, it limits their effectiveness and agility.
Read More
Topics:
embedded analytics,
Analytics,
Business Intelligence,
Data Governance,
Data Management,
data operations,
Analytics and Data
I have written recently about the similarities and differences between data mesh and data fabric. The two are potentially complementary. Data mesh is an organizational and cultural approach to data ownership, access and governance. Data fabric is a technical approach to automating data management and data governance in a distributed architecture. There are various definitions of data fabric, but key elements include a data catalog for metadata-driven data governance and self-service, agile data...
Read More
Topics:
Business Intelligence,
Cloud Computing,
Data Governance,
Data Management,
Data,
data operations,
AI and Machine Learning
In their pursuit to be data-driven, organizations are collecting and managing more data than ever before as they attempt to gain competitive advantage and respond faster to worker and customer demands for more innovative, data-rich applications and personalized experiences. As data is increasingly spread across multiple data centers, clouds and regions, organizations need to manage data on multiple systems in different locations and bring it together for analysis. As the data volumes increase...
Read More
Topics:
Data Management,
Data,
data operations,
analytic data platforms
I have written a few times in recent months about vendors offering functionality that addresses data orchestration. This is a concept that has been growing in popularity in the past five years amid the rise of Data Operations (DataOps), which describes more agile approaches to data integration and data management. In a nutshell, data orchestration is the process of combining data from multiple operational data sources and preparing and transforming it for analysis. To those unfamiliar with the...
Read More
Topics:
Data Management,
Data,
data operations,
Analytics and Data,
AI and Machine Learning
Ventana Research’s Data Lakes Dynamics Insights research illustrates that while data lakes are fulfilling their promise of enabling organizations to economically store and process large volumes of raw data, data lake environments continue to evolve. Data lakes were initially based primarily on Apache Hadoop deployed on-premises but are now increasingly based on cloud object storage. Adopters are also shifting from data lakes based on homegrown scripts and code to open standards and open...
Read More
Topics:
Business Intelligence,
Data Governance,
Data Management,
Data,
data operations,
Streaming Data Events,
analytic data platforms,
Analytics and Data,
AI and Machine Learning
I have recently written about the organizational and cultural aspects of being data-driven, and the potential advantages data-driven organizations stand to gain by responding faster to worker and customer demands for more innovative, data-rich applications and personalized experiences. I have also explained that data-driven processes require more agile, continuous data processing, with an increased focus on extract, load and transform processes — as well as change data capture and automation...
Read More
Topics:
Cloud Computing,
Data Management,
Data,
data operations,
Analytics and Data
Organizations are collecting data from multiple data sources and a variety of systems to enrich their analytics and business intelligence (BI). But collecting data is only half of the equation. As the data grows, it becomes challenging to find the right data at the right time. Many organizations can’t take full advantage of their data lakes because they don’t know what data actually exists. Also, there are more regulations and compliance requirements than ever before. It is critical for...
Read More
Topics:
Business Intelligence,
Data Governance,
Data Management,
data operations,
AI and Machine Learning
The data catalog has become an integral component of organizational data strategies over the past decade, serving as a conduit for good data governance and facilitating self-service analytics initiatives. The data catalog has become so important, in fact, that it is easy to forget that just 10 years ago it did not exist in terms of a standalone product category. Metadata-based data management functionality has had a role to play within products for data governance and business intelligence for...
Read More
Topics:
business intelligence,
Data Governance,
Data Management,
Data,
data operations,
Analytics and Data
I have recently written about the importance of healthy data pipelines to ensure data is integrated and processed in the sequence required to generate business intelligence, and the need for data pipelines to be agile in the context of real-time data processing requirements. Data engineers, who are responsible for monitoring, managing and maintaining data pipelines, are under increasing pressure to deliver high-performance and flexible data integration and processing pipelines that are capable...
Read More
Topics:
Big Data,
Cloud Computing,
Data Management,
Data,
data operations
When joining Ventana Research, I noted that the need to be more data-driven has become a mantra among large and small organizations alike. Data-driven organizations stand to gain competitive advantage, responding faster to worker and customer demands for more innovative, data-rich applications and personalized experiences. Being data-driven is clearly something to aspire to. However, it is also a somewhat vague concept without clear definition. We know data-driven organizations when we see them...
Read More
Topics:
embedded analytics,
Analytics,
Business Intelligence,
Data Governance,
Data Integration,
Data,
Digital Technology,
natural language processing,
data lakes,
data operations,
Streaming Analytics,
Streaming Data Events,
Analytics and Data,
AI and Machine Learning
Organizations are continuously increasing the use of analytics and business intelligence to turn data into meaningful and actionable insights. Our Analytics and Data Benchmark Research shows some of the benefits of using analytics: Improved efficiency in business processes, improved communication and gaining a competitive edge in the market top the list. With a unified BI system, organizations can have a comprehensive view of all organizational data to better manage processes and identify...
Read More
Topics:
business intelligence,
embedded analytics,
Data Governance,
Data Management,
natural language processing,
data operations,
Streaming Analytics,
AI and Machine Learning
I previously described the concept of hydroanalytic data platforms, which combine the structured data processing and analytics acceleration capabilities associated with data warehousing with the low-cost and multi-structured data storage advantages of the data lake. One of the key enablers of this approach is interactive SQL query engine functionality, which facilitates the use of existing business intelligence (BI) and data science tools to analyze data in data lakes. Interactive SQL query...
Read More
Topics:
Analytics,
Business Intelligence,
Cloud Computing,
Data,
Digital Technology,
data lakes,
data operations,
Analytics and Data,
AI and Machine Learning
I’ve never been a fan of talking about semantic models because most of the workforce probably doesn’t understand what they are, or doesn’t recognize them by name. But the findings in our recent Analytics and Data Benchmark Research have changed my mind. The research shows how important a semantic model can be to the success of data and analytics processes. Organizations that have successfully implemented a semantic model are more than twice as likely to report satisfaction with analytics (77%)...
Read More
Topics:
Business Intelligence,
Data Management,
data operations,
Analytics and Data,
AI and Machine Learning
I recently wrote about the potential benefits of data mesh. As I noted, data mesh is not a product that can be acquired, or even a technical architecture that can be built. It’s an organizational and cultural approach to data ownership, access and governance. While the concept of data mesh is agnostic to the technology used to implement it, technology is clearly an enabler for data mesh. For many organizations, new technological investment and evolution will be required to facilitate adoption...
Read More
Topics:
Analytics,
Business Intelligence,
Data Governance,
Data Integration,
Data,
data operations,
Streaming Data Events,
AI and Machine Learning
There is a fundamental flaw in information technology, or at least in the way it is most commonly delivered. Most technology systems are developed under the assumption that all people will use the system primarily in the same way. Sure, there are some options built in — perhaps the same action can be initiated by either clicking on a button, selecting a menu item or invoking a keyboard short-cut. The problem is that when every variation needs to be coded into the system, the prospect of...
Read More
Topics:
Business Intelligence,
Data Management,
natural language processing,
data operations,
Analytics and Data,
AI and Machine Learning
The data governance landscape is growing rapidly. Organizations handling vast amounts of data face multiple challenges as more regulations are added to govern sensitive information. Adoption of multi-cloud strategies increases governance concerns with new data sources that are accessed in real time. Our Data Governance Benchmark Research shows that organizations face multiple challenges when deploying data governance. Three-quarters (73%) of organizations report disparate data sources as the...
Read More
Topics:
Data Governance,
Data Management,
data operations
I recently wrote about the importance of data pipelines and the role they play in transporting data between the stages of data processing and analytics. Healthy data pipelines are necessary to ensure data is integrated and processed in the sequence required to generate business intelligence. The concept of the data pipeline is nothing new of course, but it is becoming increasingly important as organizations adapt data management processes to be more data driven.
Read More
Topics:
Analytics,
Business Intelligence,
Data Governance,
Data Integration,
Data,
Digital Technology,
Digital transformation,
data lakes,
data operations,
Streaming Data Events,
Analytics and Data,
AI and Machine Learning
Data mesh is the latest trend to grip the data and analytics sector. The term has been rapidly adopted by numerous vendors — as well as a growing number of organizations —as a means of embracing distributed data processing. Understanding and adopting data mesh remains a challenge, however. Data mesh is not a product that can be acquired, or even a technical architecture that can be built. It is an organizational and cultural approach to data ownership, access and governance. Adopting data mesh...
Read More
Topics:
Analytics,
Business Intelligence,
Data Governance,
Data Integration,
Data,
Digital Technology,
Digital transformation,
data lakes,
data operations,
Streaming Data Events,
Analytics and Data
Despite widespread and increasing use of the cloud for data and analytics workloads, it has become clear in recent years that, for most organizations, a proportion of data-processing workloads will remain on-premises in centralized data centers or distributed-edge processing infrastructure. As we recently noted, as compute and storage are distributed across a hybrid and multi-cloud architecture, so, too, is the data it stores and relies upon. This presents challenges for organizations to...
Read More
Topics:
Analytics,
Business Intelligence,
Data Governance,
Data,
data operations,
AI and Machine Learning
As businesses become more data-driven, they are increasingly dependent on the quality of their data and the reliability of their data pipelines. Making decisions based on data does not guarantee success, especially if the business cannot ensure that the data is accurate and trustworthy. While there is potential value in capturing all data — good or bad — making decisions based on low-quality data may do more harm than good.
Read More
Topics:
Data Governance,
Data Integration,
Data,
Digital Technology,
data lakes,
data operations,
Analytics and Data
I recently described the emergence of hydroanalytic data platforms, outlining how the processes involved in generating energy from a lake or reservoir were analogous to those required to generate intelligence from a data lake. I explained how structured data processing and analytics acceleration capabilities are the equivalent of turbines, generators and transformers in a hydroelectric power station. While these capabilities are more typically associated with data warehousing, they are now...
Read More
Topics:
Analytics,
Data Governance,
Data,
Digital Technology,
data lakes,
data operations,
Streaming Data Events,
AI and Machine Learning
As I stated when joining Ventana Research, the socioeconomic impacts of the pandemic and its aftereffects have highlighted more than ever the differences between organizations that can turn data into insights and are agile enough to act upon it and those that are incapable of seeing or responding to the need for change. Data-driven organizations stand to gain competitive advantage, responding faster to worker and customer demands for more innovative, data-rich applications and personalized...
Read More
Topics:
Analytics,
Business Intelligence,
Data Integration,
Data,
data lakes,
data operations,
Streaming Data Events,
AI and Machine Learning
Organizations of all sizes are dealing with exponentially increasing data volume and data sources, which creates challenges such as siloed information, increased technical complexities across various systems and slow reporting of important business metrics. Migrating to the cloud does not solve the problems associated with performing analytics and business intelligence on data stored in disparate systems. Also, the computing power needed to process large volumes of data consists of clusters of...
Read More
Topics:
Analytics,
Business Intelligence,
Data Integration,
Data,
data lakes,
data operations,
Streaming Analytics,
AI and Machine Learning
Ventana Research recently announced its 2022 Market Agenda for Data, continuing the guidance we have offered for nearly two decades to help organizations derive optimal value and improve business outcomes.
Read More
Topics:
Data Governance,
Data Integration,
Data,
data lakes,
data operations,
Streaming Data Events
Organizations today have huge volumes of data across various cloud and on-premises systems which keep growing by the second. To derive value from this data, organizations must query the data regularly and share insights with relevant teams and departments. Automating this process using natural language processing (NLP) and artificial intelligence and machine learning (AI/ML) enables line-of-business personnel to query the data faster, generate reports themselves without depending on IT, and...
Read More
Topics:
embedded analytics,
Analytics,
Business Intelligence,
Data Integration,
Data,
natural language processing,
data lakes,
data operations,
AI and Machine Learning
Data lakes have enormous potential as a source of business intelligence. However, many early adopters of data lakes have found that simply storing large amounts of data in a data lake environment is not enough to generate business intelligence from that data. Similarly, lakes and reservoirs have enormous potential as sources of energy. However, simply storing large amounts of water in a lake is not enough to generate energy from that water. A hydroelectric power station is required to harness...
Read More
Topics:
Analytics,
Business Intelligence,
Cloud Computing,
Data Governance,
Data Integration,
Data,
Digital Technology,
data lakes,
data operations,
AI and Machine Learning
As I noted when joining Ventana Research, the range of options faced by organizations in relation to data processing and analytics can be bewildering. When it comes to data platforms, however, there is one fundamental consideration that comes before all others: Is the workload primarily operational or analytic? Although most database products can be used for operational or analytic workloads, the market has been segmented between products targeting operational workloads, and those targeting...
Read More
Topics:
business intelligence,
Analytics,
Data,
data lakes,
data operations,
AI and Machine Learning
Any organization that relies heavily on a large labor force looks to automation to reduce costs, and contact centers are no exception. They handle interactions at such large scale that almost any effort to automate some part of the process can deliver measurable efficiencies. Two factors have ratcheted up attention on automating customer experience workflows: the dramatic expansion of digital interaction channels, and the development of artificial intelligence and machine learning tools to...
Read More
Topics:
Customer Experience,
Voice of the Customer,
Analytics,
Data Integration,
Contact Center,
Data,
agent management,
data operations,
Experience Management,
AI and Machine Learning
It has been clear for some time that future enterprise IT architecture will span multiple cloud providers as well as on-premises data centers. As Ventana Research noted in the market perspective on data architectures, the rapid adoption of cloud computing has fragmented where data is accessed or consolidated. We are already seeing that almost one-half (49%) of respondents to Ventana Research’s Analytics and Data Benchmark Research are using cloud computing for analytics and data, of which 42%...
Read More
Topics:
Data,
data lakes,
data operations
Organizations have become more agile and responsive, in part, as a result of being more agile with their information technology. Adopting a DevOps approach to application deployment has allowed organizations to deploy new and revised applications more quickly. DataOps is enabling organizations to be more agile in their data processes. As organizations are embracing artificial intelligence (AI) and machine learning (ML), they are recognizing the need to adopt MLOps. The same desire for agility...
Read More
Topics:
business intelligence,
Analytics,
Data Governance,
Data,
Digital Technology,
data operations
Enterprises looking to adopt cloud-based data processing and analytics face a disorienting array of data storage, data processing, data management and analytics offerings. Departmental autonomy, shadow IT, mergers and acquisitions, and strategic choices mean that most enterprises now have the need to manage data across multiple locations, while each of the major cloud providers and data and analytics vendors has a portfolio of offerings that may or may not be available in any given location. As...
Read More
Topics:
Analytics,
Cloud Computing,
Data Governance,
Data Integration,
Data,
Digital Technology,
data lakes,
data operations,
AI and Machine Learning
We are happy to share some insights about Viamedici EPIM drawn from our latest Value Index research, which assesses how well vendors’ offerings meet buyers’ requirements.
Read More
Topics:
Marketing,
Data Governance,
Data,
Product Information Management,
Price and Revenue Management,
Digital Commerce,
Operations & Supply Chain,
Enterprise Resource Planning,
continuous supply chain,
data operations,
Office of Revenue
We are happy to share some insights about Contentserv CS drawn from our latest Value Index research, which assesses how well vendors’ offerings meet buyers’ requirements.
Read More
Topics:
Marketing,
Data Governance,
Data,
Product Information Management,
Price and Revenue Management,
Digital Commerce,
Operations & Supply Chain,
Enterprise Resource Planning,
continuous supply chain,
data operations,
Office of Revenue
We are happy to share some insights about Perfion drawn from our latest Value Index research, which assesses how well vendors’ offerings meet buyers’ requirements.
Read More
Topics:
Marketing,
Data Governance,
Data,
Product Information Management,
Price and Revenue Management,
Digital Commerce,
Operations & Supply Chain,
Enterprise Resource Planning,
continuous supply chain,
data operations,
Office of Revenue
We are happy to share some insights about Winshuttle EnterWorks drawn from our latest Value Index research, which assesses how well vendors’ offerings meet buyers’ requirements.
Read More
Topics:
Marketing,
Data Governance,
Data,
Product Information Management,
Price and Revenue Management,
Digital Commerce,
Operations & Supply Chain,
Enterprise Resource Planning,
continuous supply chain,
data operations,
Office of Revenue
We are happy to share some insights about inRiver PIM drawn from our latest Value Index research, which assesses how well vendors’ offerings meet buyers’ requirements.
Read More
Topics:
Marketing,
Data Governance,
Data,
Product Information Management,
Price and Revenue Management,
Operations & Supply Chain,
Enterprise Resource Planning,
continuous supply chain,
data operations,
Office of Revenue
We are happy to share some insights about Riversand PX 360 drawn from our latest Value Index research, which assesses how well vendors’ offerings meet buyers’ requirements.
Read More
Topics:
Marketing,
Data Governance,
Data,
Product Information Management,
Price and Revenue Management,
Digital Commerce,
Operations & Supply Chain,
Enterprise Resource Planning,
continuous supply chain,
data operations,
Office of Revenue
We are happy to share some insights about Magnitude Agility PIM drawn from our latest Value Index research, which assesses how well vendors’ offerings meet buyers’ requirements.
Read More
Topics:
Marketing,
Data Governance,
Data,
Product Information Management,
Price and Revenue Management,
Digital Commerce,
Operations & Supply Chain,
Enterprise Resource Planning,
continuous supply chain,
data operations,
Office of Revenue
We are happy to share some insights about Salsify ProductXM drawn from our latest Value Index research, which assesses how well vendors’ offerings meet buyers’ requirements.
Read More
Topics:
Marketing,
Data Governance,
Data,
Product Information Management,
Price and Revenue Management,
Digital Commerce,
Operations & Supply Chain,
Enterprise Resource Planning,
continuous supply chain,
data operations,
Office of Revenue
We are happy to share some insights about Pimcore Platform drawn from our latest Value Index research, which assesses how well vendors’ offerings meet buyers’ requirements.
Read More
Topics:
Marketing,
Data Governance,
Data,
Product Information Management,
Price and Revenue Management,
Digital Commerce,
Operations & Supply Chain,
Enterprise Resource Planning,
continuous supply chain,
data operations,
Office of Revenue
We are happy to share some insights about Akeneo Serenity drawn from our latest Value Index research, which assesses how well vendors’ offerings meet buyers’ requirements.
Read More
Topics:
Marketing,
Data Governance,
Data,
Product Information Management,
Price and Revenue Management,
Digital Commerce,
Operations & Supply Chain,
Enterprise Resource Planning,
continuous supply chain,
data operations,
Office of Revenue