BI? DW? MDM? What's that?

A small glossary

BI

Business Intelligence: the ability to get accurate, trusted, relevant, meaningful information (not data! Data in its raw state is useless to business users) quickly, easily, and to present it according to business needs

DW

Data Warehousing: all the processes and tools enabling the BI data to be collected, stored and presented

MDM

Master Data Management: this differentiates the transactional data from reference data. MDM enables reference data to be maintained and shared amongst several systems whilst keeping its integrity.

CDC

Change Data Capture: a process that enables identification and tracking of changes in data, and being able to isolate those changes, for example for streaming into a data lakehouse, or a data warehouse, or a report.

CI/CD

Continuous Integration, Continuous Delivery: a process whereby the enterprise's products are continuously improved by automating the dev->test->deploy cycle without disruption to its users. Sometimes opposed to DevOps although it can be part of it in our view.

Useful Links

New Projects

2023 continues to see both pilot and large Big Data and Cloud data projects in Auckland. Last year, we helped with a pilot Snowflake project that prepared data for analytical consumption. This year, we are onto a large-scale Databricks project, with real-time streaming pipelines feeding a Data Lakehouse.

We also continue to architect more traditional landscapes, with star-schemas warehouses being fitted with a semantic layer for Tableau.

Big Data news

At the moment, we are seeing the popularity of the Lakehouse, which combines Data Lake and Data Warehouse, avoiding the Data Swamp direction.

Back

Design from HTML5webtemplates.co.uk.