data engineer Halifax
Job description
Position: Azure data engineer
Location: Halifax, NS
Duration: Long Term Contract
Job Description:
Azure Cloud: Azure Datalake, Analysis services, Azure Datafactory, Databricks, Azure Synapse
ETL Tools: Visual Studio 2015 (SSIS), Informatica PowerCenter 10.1.1/9.1, DataStage
Certification: Azure data engineer
Experience
5+ years of ETL / data engineering within DWH / Data Lake / BI reporting systems
2+ Experience in developing Data Factory pipelines that are parametrized and reusable and worked on most of the ADF control flow activities like Get Metadata, Lookup, Copy, For Each, Databricks, Stored Procedure, If, Web etc.
2+ years’ experience in building Lakehouse using Azure Databricks and open-source Delta.
2+ years’ experience in creating pipelines for ingestion, transformation and custom requirements using Azure Data Factory and Azure Databricks
Experience tuning SQL queries in Databricks, Azure SQL DB, Azure Synapse
Experience in creating generic Pipelines & Dataflow mappings using Azure Data Factory
Experience in creating python/SQL notebooks to transform & load data using Databricks.
Ops / Support experience
1+ years Ops / Production Support experience in Azure Data Factory, Data Bricks
Extensive trouble shooting skills to find right RCA and Propose recommendations based on RCA.
Basic understanding of ADF and ADB for data validations.
Good to have other BI tools used within MS stack like SSRS.
Job Type: Fixed term contract
Work Location: In person
About Tek Tree
CEO: Raghuveer Bandi
Revenue: Unknown / Non-Applicable
Size: 1 to 50 Employees
Type: Company - Private
Website: https://tektreeinc.com/
Year Founded: 2005
