Responsibilities

• Design, develop, and maintain robust and scalable data pipelines using Azure Data Factory, Databricks, and other Azure-native tools.
• Collaborate with cross-functional teams, including software developers, database architects, and data analysts, to ensure seamless data integration and delivery.
• Transform raw data into clean, structured datasets optimized for analysis and reporting.
• Develop solutions that enable real-time and batch data processing using Azure Synapse and high-speed indexing technologies.
• Implement best practices for CI/CD pipelines, automated testing, version control, and production deployment of data solutions.
• Ensure data quality, consistency, and governance by using tools such as Power BI and Microsoft Purview.
• Troubleshoot and maintain data infrastructure and support analytics applications and data warehouse environments.
• Support ongoing data initiatives by ensuring a consistent and reliable data architecture across projects.
• Contribute to architectural decisions and solution design, leveraging expertise in data modeling, distributed systems, and automation.

Requirements

• 4+ years of industry experience in data engineering and building world class data solutions.
• Excellent communication skills and a passion for collaborating with a diverse team and help foster an environment that promotes effective teamwork, communication, collaboration, and commitment.
• Assure that data is cleansed, mapped, transformed, and otherwise optimized for storage and use according to business and technical requirements
• Develop and maintain innovative Azure solutions
• Solution design using Microsoft Azure services and other tools
• The ability to automate tasks and deploy production standard code (with unit testing, continuous integration, versioning etc.)
• Load transformed data into storage and reporting structures in destinations including data warehouse, high speed indexes, real-time reporting systems and analytics applications
• Build data pipelines to collectively bring together data
• Other responsibilities include extracting data, troubleshooting and maintaining the data warehouse
• Assist software developers, database architects, data analysts, and data scientists with data initiatives and ensuring a consistent data delivery architecture is put in place throughout ongoing projects.

Qualifications

• Bachelor’s degree in computer science or equivalent experience.
• Inclusive of Data Warehouse fact and dimensional modeling concepts
• Experience in Azure Synapse, Visual Studio, Azure DevOps, CI/CD, Pipelines, Data Factory, Python, Databricks, SQL
• Experience with data tools such as Power BI and Purview
• Expertise with cloud automation tooling such as ARM Templates
• Experience with distributed (multi-tiered) systems and databases
• Strong analytic skills related to working with unstructured datasets
• The ability to design and implement well written code
• Ability to work to tight deadlines
• Ability to test the data from source to the presentation layer
• Ability to support/troubleshoot data pipelines