Category: Azure

Azure [EN]

Azure, Azure Data Lake Storage Gen2, Azure Storage Explorer

Uploading files to Azure Data Lake Storage Gen2 from PowerShell using REST API, OAuth 2.0 bearer token and Access Control List (ACL) privileges

  Introduction In my previous article “Connecting to Azure Data Lake Storage Gen2 from PowerShell using REST API – a step-by-step guide“, I showed and explained the connection using access keys. As you probably know, access key grants a lot of privileges. In fact, your storage account key is similarCzytaj dalej / Read more

Azure Databricks

How to get Databricks WorkspaceID from REST API using PowerShell?

Getting information about ID of the Azure Databricks workspace is not so obvious. There is no information about it in the API specification: https://docs.databricks.com/api/latest/workspace.html That’s probably because this property is not related to the content of the workspace 🙂 That’s right! Raw JSON responses are intended to deliver different setCzytaj dalej / Read more

Azure, Azure Data Lake Storage Gen2, Azure Storage Explorer

Connecting to Azure Data Lake Storage Gen2 from PowerShell using REST API – a step-by-step guide

    Introduction Azure Data Lake Storage Generation 2 was introduced in the middle of 2018. With new features like hierarchical namespaces and Azure Blob Storage integration, this was something better, faster, cheaper (blah, blah, blah!)  compared to its first version – Gen1. Since then, there has been enough time toCzytaj dalej / Read more

Azure, Azure Automation, Azure Data Factory

Azure Data Factory V2 and Azure Automation – Running pipeline from runbook with PowerShell

  Introduction Azure Automation is just a PowerShell and python running platform in the cloud. In marketing language, it’s a swiss army knife 😛 Here how Microsoft describes it: “Azure Automation delivers a cloud-based automation and configuration service that provides consistent management across your Azure and non-Azure environments. It consists of process automation,Czytaj dalej / Read more

Azure, Azure Data Factory

Azure Data Factory V2 – Incremental loading with configuration stored in a table – Complete solution, step by step.

Introduction Loading data using Azure Data Factory v2 is really simple. Just drop Copy activity to your pipeline, choose a source and sink table, configure some properties and that’s it – done with just a few clicks! But what if you have dozens or hundreds of tables to copy? AreCzytaj dalej / Read more