Skills

 Develop JSON Scripts for deploying the Pipeline in Azure Data Factory (ADF) that process the data using the Sql Activity. · Develop SQL Scripts for automation purpose.Follow Development cum operation support (Dev-Ops) model · Analyze, design and build Modern data solutions using Azure PaaS service to support visualization of data. Understand current Production state of application and determine the impact of new implementation on existing business processes. · Extract Transform and Load data from Sources Systems to Azure Data Storage services using a combination of Azure Data Factory, T-SQL, Spark SQL and U-SQL Azure Data Lake Analytics. · Create Pipelines in ADF using Linked Services/Datasets/Pipeline/ to Extract, Transform and load data from different sources like Azure SQL, Blob storage, Azure SQL Data warehouse, write-back tool and backwards. · Develop Spark applications using Pyspark and Spark-SQL for data extraction, transformation and aggregation from multiple file formats for analyzing & transforming the data to uncover insights into the customer usage patterns.

Qualification

Must have a Bachelor of Engineering / Tehcnology or Computer Engineering or Information Technology. Foreign equivalent acceptable.

Experience

Must have at least 5 years of experience as an Information Technology professional and in all the listed skills and tools. Travel required