Data Loading Options With Fabric Workspaces Part 1 of 2 – Yet Another Blog About The Medallion Architecture
This blog will be split over 2 parts, in this first part we'll look at the medallion architecture from the...
Data Lake
Azure Synapse Analytics Managed Virtual Networks for the Developer
It's recommended in a Synapse environment, especially a production/live environment, to lock a Synapse Analytics workspace down behind a Virtual...
Partition Pruning with Delta Tables in Azure Synapse Analytics
A question that is often asked about Azure Synapse Analytics is how it handles Delta tables that are partitioned. Delta...
User Permissions in Serverless SQL Pools: External Tables vs Views
In a recent Synapse Analytics Serverless SQL Pools QnA session, the Serverless SQL Pools team stated that using External Tables...
Use Azure Log Analytics to analyse Azure Data Lake Gen2 activity from Serverless SQL Pools
This blog is marked as intermediate knowledge as an understanding of Serverless SQL Pools is preferable, but not essential. Refer to Getting Started...
How does Serverless SQL Pools deal with different file schemas? Part 2 – Parquet
Welcome to part 2 in this blog series in which we're looking at what happens when schema changes are made...
Trigger The Process – Using CETAS in Serverless SQL Pools to Generate Pre-Calculated Datasets – Part 2 of 2
In part one we looked at a process in which a pre-aggregated dataset can be created by Azure Synapse Analytics...
Using CETAS in Serverless SQL Pools to Generate Pre-Calculated Datasets – Part 1 of 2
Dedicated SQL Pools have a feature called Materialized Views which can generate a pre-calculated/processed dataset ready for consumption and is...
Using Access Control Lists To Manage Fine-Grain Data Lake Permissions
When data is stored in Azure Data Lake Gen2, we can use Azure Active Directory and Access Control Lists (ACLs)...
Azure Storage Folder Filtering using the Filepath Function
Serverless SQL Pools includes 2 SQL functions, filepath and filename, that can be used to return the folder path/name and...
