Reading Time: 13 minutes In this next post in this series, we will take the data that has been transformed into a machine-readable form in Azure Databricks and store it in Azure SQL Database to be used later in reporting. If you missed it, here is a link to Part 3. All code used in this post is available […]

Read More →

Reading Time: 11 minutes In this next post in this series, the data extracted using Azure Data Factory will be transformed into a readable format using Azure Databricks and adding this logic into the Azure Data Factory pipeline If you missed it, here is a link to Part 2 Create Azure Databricks workspace To complete this next portion of […]

Read More →

Reading Time: 9 minutes Update | 23/06/2021 – Have updated dataset instructions to use parameters¬† Update | 02/01/2022 – Have updated the pipeline to use a variable to decide the filename for the output file In this next post in this series, a query will be built inside Log Analytics and then the data will be extracted using Azure […]

Read More →

Reading Time: 5 minutes Recently, I have been developing a solution to extract data from a Log Analytics workspace using Azure Data Factory. At the time of writing, Azure Data Factory does not have a native connector for Log Analytics workspaces so the Log Analytics REST API must be used instead. These data will then be loaded into an […]

Read More →

Reading Time: 10 minutes What a busy couple of days! Ignite (2-4 March) 2021 has been a blast and there’s lots of new innovations in the Microsoft space that I’d like to share with you. This Ignite, like last year, was a fully digital event which allowed access to events that weren’t governed by Pacific Standard Time. First up […]

Read More →

Reading Time: 3 minutes In this post, I will introduce the case study that I will be using throughout most of my posts here, WingIt Airlines*. WingIt Airlines is a medium-sized long-haul airline operating flights between its two bases in San Diego, California and London Heathrow, United Kingdom. Their main corporate offices are in Los Angeles, California. They employ […]

Read More →