"What is Data Governance?", a curious kid asks, peeking above my shoulder into the laptop screen. He is 14 and frequently asks questions with no interest in knowing the answer. Just like many other people around me."That's a great…

 I would like to share with you my favourite example of the modern data pipeline.It's amazing.The first cool thing that we see is that this great pipeline is utilizing a full range of cloud services built for diverse use cases.…

 Once upon a time, Sql Server was our central tool for data management, for both OLTP (online transactions processing) or OLAP(online analytical processing) database systems.We have used Sql Server Agent Jobs to pull the data from FTP…

        I took the first sip from my morning coffee when the last summit session had started, somewhere around 15:00. I heavily sank to a sofa and realized that this is the first time I had a chance to sit down…

 Sometimes there are properties in the document with unstructured text, like newspaper articles, blog posts, or book abstracts. The inverted index is easy to build and is similar to the data structures search engines use. Such…

There is a lot of tooling around data enrichment and data orchestration in the Azure cloud and many services with similar features. Azure Data Factory, Azure Databricks, Azure Synapse Pipelines, and SSIS services can move data from one…

Are you using CSV files as a primary file format for your data? CSV is a very useful file format if you want to open the file in Excel and analyze it right away.CSV format stores tabular data in plain text, it is old and was wildly used in…

Data management tools are evolving at a great speed, and this can be overwhelming.Data volumes and variety evolve and grow as well.Data Engineers are required to transform those waterfalls of data into business insights. The data is…