There is a lot of tooling around data enrichment and data orchestration in the Azure cloud and many services with similar features. Azure Data Factory, Azure Databricks, Azure Synapse Pipelines, and SSIS services can move data from one…
Are you using CSV files as a primary file format for your data? CSV is a very useful file format if you want to open the file in Excel and analyze it right away.CSV format stores tabular data in plain text, it is old and was wildly used in…
Data management tools are evolving at a great speed, and this can be overwhelming.Data volumes and variety evolve and grow as well.Data Engineers are required to transform those waterfalls of data into business insights. The data is…
A few days ago, one of the developers asked me if that was possible to generate test data by performing multiple nested INSERT statements, each of them involving inserting new rows into several parent tables and in the same…
DBbest did their best but failed to maintain great knowledge sharing place where brightest SQL used to exchange new ideas and shared their wisdom. I want to thank Adam Machanic for giving me the opportunity to host my blog over there…
When it comes to data-driven research, presenting the results is a complicated task. It is convenient to have an initial dataset handy, if anyone asks to re-run the computations or wants to interact with the…
Data Quake. That's what it is. Dave Wells have just gave this great definition that clearly describes what's happening in the data management world during the recent years. I am greatly enjoying Dave’s session today at Enterprise…
More and more companies are aiming to move away from managing their own servers and moving towards a cloud platform. Going server-less, offers a lot of benefits like lower administrative overhead and server costs. In the server-less…
Have you ever wondered how MySQL and PostgreSQL are different? Take a look at the mapping that I have made for myself: https://www.mssqltips.com/sqlservertip/5745/compare-sql-server-mysql-and-postgresql-features/ I would be happy to…
Many companies these days keep their data assets in multiple data stores. Many companies that I have worked at have used other database systems alongside SQL Server, such as PostgreSQL instances, Redis, Elasticsearch or Couchbase.…
