data engineer Toronto
Job description
About Us
The Ontario Cannabis Store provides safe, responsible access to recreational cannabis for adults 19 and older. We operate the provincial online store for recreational cannabis in Ontario and are the exclusive provincial wholesaler to authorized private retail stores.
Working at the OCS is a unique opportunity to be part of an agile start-up in a ground-breaking new industry. We’re a diverse team passionate about delivering a great customer experience, working together with mutual respect and building value out of our differences. We’re an inclusive organization that understands that delivering great results comes out of ensuring every voice is heard.
About the Role
We are looking for a Senior Data Engineer to join our Enterprise Data & IT Planning team. The Senior Data Engineer is responsible for building and maintaining end-to-end data pipelines and data orchestration within OCS integrated systems. The Senior Data Engineer powers, performs advanced analysis, creates analytical reports, and dashboards for internal clients.
As a Senior Data Engineer, you will contribute to data related projects including tasks breakdown and estimation, new technological investigation and POC, develop high level technical design and detailed design, Source-to-Target mapping documentation, orchestration design, ETL implementation, test plan/test cases creation and reviewing, and develop a plan for deployment.
This is an exciting role to leverage your 5+ years of data analytics experience to help the OCS translate business requirements into technical design and take part in building and improving git branch strategies, code standards and naming conventions.
About Your Day
- Build and maintain batch ETL/ELT data pipelines
- Develop data integration solutions to integrate a variety of data sets from disparate sources into a data model to support BI and analytical requirements
- Solution complex data engineering problems to directly support and deliver strategic data initiatives
- Automate pipelines and troubleshoot pipelines and data failures
- Improve and automate, where possible, the data pipelines used for data analytics, business data flows, and solution integration
- Translate data requirements into detailed designs and pipeline architecture, ensuring proper documentation of methodology
- Create technical and functional documentation for Data Science and other business teams
- Partner closely with data analysts and cross-functional teams to translate business requirements into detailed technical designs
- Drive thought leadership and help define best practices around data extraction, modeling, consumption, and governance
- Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs
- Maintain existing Azure Eco-system and ensure consistency in data delivery architecture throughout the project life cycle.
- Move data between systems by accessing data from many different technologies, and apply rules to “transform” and cleanse the data in order to prepare it for analysis
- Work with different layers of modern data platform and add and modify data sets based on the business requirements.
- Work with Master Data Management and Data analytics team to bring efficiencies in the data acquisition and control using raw, standardized, and Curated layers of MDP – Modern Data Platform
- Architect standard procedures for data storage, processing, and consumption using industry best practices
- Ensure adherence to architectural guidelines and principles
- Bachelor's degree in Computer Science/Software Engineering/Information Technology or a related field of study and/or equivalent level of education and experience
- 5+ years of experience with data analytics, developing and maintaining data warehouses to feed advanced analytics and deploying analytical models within an organization
- Experience with Azure Synapse is required
- Experience with source code management tools (Azure DevOps) is a must
- Hand on experience with lakehouse, data warehousing, schema design and data modeling
- Experience with D365 (ERP/CRM) data parsing or transformation is an asset
- Expertise in Python, PySpark, SQL is required
- Expertise in Azure data engineering leveraging ADLS, Azure Synapse, Azure Data Factory is required
- Excellent analytical, troubleshooting, research, and problem-solving skills
- Ability to align with rapid business changes: new requirements, evolving goals and strategies and technological advancements
- Ability to work independently with business users under minimal supervision in a highly collaborative and agile work environment
- Excellent written and verbal communication skills
- This position offers a Hybrid work schedule. You will be required to be in the office a minimum of 1 day each week, with the ability to work from home for the remaining workdays (subject to specific business needs requiring office attendance).
- When working from home, a reliable internet connection is required. Remote work is supported with cloud-based applications and collaboration tools (i.e., MS Teams)
- City: Toronto, ON
- Employment Type: Permanent Full-Time
- Required Travel: None
About Ontario Cannabis Store
Revenue: Unknown / Non-Applicable
Size: 201 to 500 Employees
Type: Government
Website: www.ocs.ca
