Mini Project Development for Azure Data Engineer

Video Tutorials, Courses

Mini Project Development for Azure Data Engineer
MP4 | Video: h264, 1280x720 | Audio: AAC, 44.1 KHz, 2 Ch
Genre: eLearning | Language: English | Duration: 51 lectures (7h 2m) | Size: 2.3 GB

Data Generator code added.


Azure Data Factory V2, Azure Data Lake, Azure Databricks, SQL Synapse Analytics, Azure Storage - Blob + ADLS, Azure SQL

Insights of Azure Data Services - Storage Services, ADF V2, Azure Databricks and SQL DW (Synapse Analytics)

Creating and Managing data related Azure services

Practical experience with able datasets

Design concepts for big data processing on Azure Data Lake

Securing Data on Blob Storage using SAS URLs + Lifecycle Policies to archive data with auto tier change

End to End Data load pipeline (Source -> Raw Layer -> Curated -> Consumption)

ETL or Database Knowledge is expected

Basic Azure Knowledge is plus

Spark knowledge will speed up learning Azure Databricks

Learn All in One Azure Data Eeering services along with hands-on (requirement gathering to implementation)

------------------------------------------------------------------------------------------------------------------

Recently added sessions:

Added code snippets for Databricks <-> SQL Server using JDBC

Now you can generate your own datasets for this workshop.

Copy data from Azure SQL to Azure SQL without ADF (kind of linked server)

ADF Code promotion - manual activity

Dynamically change DB connection in ADF (Parameterizing linked service)

Visible comparison of Blob and Azure Data Lake Gen2 storage using data analytics through Azure Databricks.

NY Taxi data files source link added in resources section

Integrate Key Vault with Azure Databricks and extract secrets via Secret Scope

Use Blob SDK in Azure Databricks to read/write files on blob like IO operations

Connecting to SQL Server with pyodbc in Azure Databricks

Datasets used in this course are now available to . Visit Azure Data Factory section.

------------------------------------------------------------------------------------------------------------------

We will execute a small project. It will help you to learn:

1) Design concepts - How to design big data system. Teologies of each components/layers.

2) Hands-on - We will be creating required Azure data services and will look various options available.

3) Tips and Tricks

4) Helps in DP-200 and DP-201 certification preparation.

Technologies you will learn:

Azure Data Factory V2, Databricks (using Standard cluster), Storage Services, SQL Synapse Analytics (DB part)

Course highlights:

1) Resources: Links to external resource for further reading

2) Datasets : and use dataset used in this course. Do more practice.

3) Architecture and Design : Start learning on how to d the data load on cloud platform.

Bners to Azure Data World

ETL Developers

Database Professionals



DOWNLOAD
uploadgig


rapidgator


nitroflare