Data Engineering

Database Unit Testing for SQL Server

Explore the intricacies of data and metadata, their key differences and the importance of metadata management tools such as dbForge Documenter.

This function will jump-start the process of converting long descriptions into meaningful abbreviations. It's great for creating "Code" columns in lookup tables.

Without the Data Model and tools like Talend, data can completely fail to provide business value, or worse impede its success through inaccuracy, misuse, or misunderstanding.

Data Modeling is a topic that never goes away. Sometimes I do reminisce about the good ol’ days of Kimball-style data models, it was so simple, straightforward, just the same thing for years. Then Big Data happened, Spark happened. Things just changed. There is a lot of new content coming out around Data Lakes and […]

Get to know SQL Server 2022 and Azure SQL with continued performance and security innovation

I was tinkering with the idea of finding the right way to help others to identify the resources that give you bang for the buck when it comes to upskilling yourself in data engineering… and this is what I came up with. The best data engineering courses, learning materials, data engineering training.

Introduction

This article reviews the differences between stored procedures and functions in Postgres and the types of functionality they provide.

In this article, we explain the concept of Stored Procedures, and how to write them effectively in PostgreSQL 9.6. PostgreSQL is an open source database

The book that teaches SQL to developers: Learn to replace thousands of lines of code with simple queries!

The book that teaches SQL to developers: Learn to replace thousands of lines of code with simple queries!

Business logic is supposed to be the part of the application where you deal with customer or user facing decisions and computations. It is often argued that this part should be well separated from the rest of the technical infrastructure of your code. Of course, SQL and relational database design is meant to support your business cases (or user stories), so then we can ask ourselves if SQL should be part of your business logic implementation. Or actually, how much of your business logic should be SQL?

Part I. Tutorial Welcome to the PostgreSQL Tutorial. The following few chapters are intended to give a simple introduction to PostgreSQL, relational …

Learn PostgreSQL quickly through a practical PostgreSQL tutorial designed for database administrators and application developers.

We here are very big fans of Postgres as a database and believe it is often the best database for the job. For many though, working with and maintaining Postgres involves a steep learning curve. This guide is designed as an aid for beginners and experienced users to find specific tips and explore tools available within Postgres. If you want to take the quick & painless approach instead, there are great services available for Postgres hosting.

One common misconception about DataOps is that it is just DevOps applied to data analytics. While a little semantically misleading, the…

Nobody wants to look at a dashboard or make decisions with yesterday’s data. We live in a world where real-time information is a…

Obsidian Publish!

Data engineering makes data more useful and accessible by sourcing & preparing the data to be handled by data scientists. Learn more about the responsibilities.

Top 20 Most Commonly Used Data Engineering Tools 2021

Evolution of Data Warehouse Architecture (Pic source: Databricks) With the evolution of scalable cloud technology and exponential growth of digital technologies, the preferred Data Warehouse (DW) a…

Chapter 1. Introduction to Data Lakes Data-driven decision making is changing how we work and live. From data science, machine learning, and advanced analytics to real-time dashboards, decision makers are … - Selection from The Enterprise Big Data Lake [Book]

Find the best data modeling tools available on the market. What they do, and don't do.

Sharing top billing on the list of data science capabilities, machine learning and artificial intelligence are not just buzzwords – many organizations are eag