Let's take a quick end-to-end look at how to convert data from one format to another using AWS Glue, then query that data using AWS Athena. You can download the file used in this tutorial from Kaggle's dataset repository (https://www.kaggle.com/datasets/swathiunnikrishnan/amazon-consumer-behaviour-dataset). Step 1: Start by uploading…
Introduction In today's data-driven world, organizations rely on seamless and efficient data movement and processing to make informed decisions. Azure Data Factory (ADF) is a powerful cloud-based service from Microsoft that enables data engineers and analysts to create, schedule, and manage data pipelines for orchestrating…
To copy file from SharePoint Online requires Azure Active Directory/ Service Principal authentication and SharePoint API to retrieve files. Step 1 - Register SharePoint Application and grant permissions. A) Register Azure Active Directory Application 1) On the Azure Portal go to Azure Active Directory App…
In this blog, you will learn about how to get data from weather API and store the result as a JSON file in your system. Steps to get API data using custom C# code in SSIS. Prerequisites To get data from API, first, create an…
Azure key vault is service offered by Microsoft azure to securely store credentials, key, API ,password etc with encryption. Credentials and key stored under azure key vault can be used for authentication across multiple azure service. Key Vault service supports two types of containers: vaults…
Logic Apps is a part of Azure App Service, and it is basically used to automate the access and use of data across clouds without writing code. Azure Logic Apps enables customers to quickly build powerful integration solutions that connect applications and services on-premises and…
One of the key things when working with any job that runs is that I want to know when the job fails. If I do not have this and I assume that the data is always where I could fall into a situation where there…
In this blog you will learn how to automatically fetch Transaction history for your Paypal account daily and insert it into a database using Python and Azure. APIs (Application Programming Interfaces) play a big role in today’s world. It allows us to share data and…
Serverless computing is the need of the hour, and Microsoft Azure Functions is a serverless architecture delivering event-driven cloud computing and suitable for application development. Through Azure Functions, you can author and execute snippets of code in the cloud without the hassle of managing the…
