Job Details

Title : Azure Data Engineer

location: Remote

Experience : 12+ years

Mandatory skills:ETL pipelines in Azure ADF, Spark,Jira , SQL and Apache NiFi

Job Responsibilities:
• Design, develop and maintain automated monitoring and health check processes and platforms.
• Design, develop and support ETL pipelines in Azure ADF, Spark, and Apache NiFi.
• Troubleshoot and resolve application, platform, network, and ETL pipeline failures.
• Analyze and identify data quality issues and coordinate with other teams to resolve as needed.
• Perform access and other security audits.
• Control access to filesystems, databases, and applications using Active Directory
• Build and maintain Windows and Linux virtual machines.
• Develop and maintain PBI reports and dashboards.

Education:
• Bachelor's degree in a relevant field (e.g., Computer Science, Engineering, IT, or a related discipline)

Work Experience:
• 2-4 years Relevant experience. (Required)
• Experience with Azure platform ecosystem products such as: Synapse, ADF, Azure Active Directory, Data Lake Storage (ADLS)
• Experience in one or more of: Java, Perl, Python, PowerShell, groovy, bash
• Experience with one or more ETL platforms: ADF, NiFi, Alteryx, SSIS
• Experience with one or more databases: SQL Server, ADW, Postgres
• Experience with Jira, Git, Azure DevOps, CI/CD.

Skills

Years of experience

Ratings out of 5

Azure ADF

ETL pipeline failures

Control access to filesystems, databases, and applications using Active Directory

Databricks experience

PBI reports

Databases: SQL

Jira and confluence experience