data engineer

data engineer Toronto

Capgemini
Full Time Toronto 122227 - 110000 CAD ANNUAL Today
Job description

Description


Location: 100% Remote Canada

Duration: 7+ months


Job Description:

  • Within this role, you would be a hands-on leader in data engineering functions including schema design, data movement, data transformation, encryption, and monitoring all the activities needed to build, sustain and govern big data pipelines.


Responsibilities:

  • Own development of large-scale data platform including operational data store, real-time metrics store and attribution platform, data warehouses and data marts for advertising planning, operation, reporting and optimization
  • Wider team collaboration and system documentation
  • Maintain next-gen cloud-based big data infrastructure for batch and streaming data applications, and continuously improve performance, scalability and availability
  • Advocate the best engineering practices, including the use of design patterns, CI/CD, code review and automated integration testing.
  • Required Education, Experience, Skills and Training
  • Bachelor or above in computer science or EE
  • 5+ years of professional programming in Scala, Java and SQL
  • 5+ years experience developing in Amazon Cloud technologies including S3, Glue, EC2, and Kinesis
  • 5+ years of big data design experience with technical stacks like Spark, Flink, Druid, Clickhouse, Single Store, Snowflake, Kafka, Nifi and AWS big data technologies
  • Proven track record with cloud infrastructure technologies, at least two of Terraform, K8S, Spinnaker, IAM, ALB, and etc.
  • Experience building highly available and scalable services for public consumption
  • Experience with processing large amounts of data at the petabyte level
  • Strong knowledge of system design, application design and architecture
  • Proficiency in both written and oral English


The Capgemini Freelancer Gateway is enabled by a cutting-edge software platform that leads the contingent labour world for technology innovation. The software platform leverages Machine Learning and Artificial Intelligence to make sure the right people end up in the right job.


A global leader in consulting, technology services and digital transformation, Capgemini is at the forefront of innovation to address the entire breadth of clients’ opportunities in the evolving world of cloud, digital and platforms. Building on its strong 50-year heritage and deep industry-specific expertise, Capgemini enables organizations to realize their business ambitions through an array of services from strategy to operations. Capgemini is driven by the conviction that the business value of technology comes from and through people. It is a multicultural company of over 200,000 team members in more than 40 countries. The Group reported 2018 global revenues of EUR 13.2 billion.

About Capgemini

CEO: Aiman Ezzat
Revenue: $10+ billion (USD)
Size: 10000+ Employees
Type: Company - Public
Website: https://www.capgemini.com
Year Founded: 1967

data engineer
Capgemini

https://www.capgemini.com
Paris, France
Aiman Ezzat
$10+ billion (USD)
10000+ Employees
Company - Public
Enterprise Software & Network Solutions
1967
Related Jobs

All Related Listed jobs

Banksman
ABM Greater Manchester 11.62 GBP HOURLY Today

Working as a member of the PRM airside driver Team, you will work closely with a driver in the ambi-lift vehicle to safely deliver passengers to and from the

compliance officer
TotalEnergies Redhill, South West England, England 46000 - 26144 GBP ANNUAL Today

Pays

Royaume-Uni

Lieu de travail

REDHILL-BRIDGE...

registered nurse
Skycare Birkenhead, England 40560 - GBP HOURLY Today

REGISTERED GENERAL NURSE

DAY SHIFTS- 36-48 hours per week

Paid breaks

Pay rate starting at £19.5...

Customer Assistant
Morrisons Sandown 21000 - 21451 GBP ANNUAL Today

Our store teams are at the heart of the local community and our Customer Assistants provide a great service and a buzz people enjoy. Its why our customers

Tour Guide
Underground Donut Tour London, England 20 GBP HOURLY Today

Able to present yourself in a positive, well-groomed manner to project an enjoyable, family friendly brand for the Underground Donut Tour.