data engineer

data engineer Hartford, CT

Pro IT
Full Time Hartford, CT 135325 - 120368 USD ANNUAL Today
Job description

Requirements:

  • Candidate must be experienced working in projects involving data migration on AWS
  • Experience on data migration from On-Prem databases to AWS Cloud on S3
  • Understands where to obtain information needed to make the appropriate decisions
  • Demonstrates ability to break down a problem to manageable pieces and implement effective, timely solutions
  • Identifies the problem versus the symptoms
  • Manages problems that require involvement of others to solve
  • Reaches sound decisions quickly
  • Develops solutions to meet business needs that reflect a clear understanding of the objectives, practices and procedures of the corporation, department and business unit

Roles & responsibilities:

  • Acts as a single point of contact for data migration to AWS projects for customer
  • Provides innovative and cost-effective solution using AWS, Spark, python & customer suggested toolset
  • Optimizes the use of all available resources
  • Develops solutions to meet business needs that reflect a clear understanding of the objectives, practices and procedures of the corporation, department and business unit
  • As a leader in the Cloud Engineering you will be responsible for the overseeing development
  • Learn/adapt quickly to new Technologies as per the business need
  • Develop a team of Operations Excellence, building tools and capabilities that the Development teams leverage to maintain high levels of performance, scalability, security and availability

Skills:

  • The Candidate must have 3-5 yrs of experience in AWS, PySpark & Python
  • Hands on experience on AWS Cloud platform especially S3, lamda, EC2, EMR
  • Experience on spark scripting
  • Has working knowledge on migrating relational and dimensional databases on AWS Cloud platform
  • Relevant experience with ETL methods and with retrieving data from dimensional data models and data warehouses.
  • Strong experience with relational databases and data access methods, especially SQL.
  • Knowledge of Amazon AWS architecture and design.

Job Type: Full-time

Pay: $120,368.43 - $135,325.42 per year

Benefits:

  • 401(k)
  • 401(k) matching
  • Dental insurance
  • Flexible schedule
  • Health insurance
  • Life insurance
  • Vision insurance

Compensation package:

  • Bonus pay
  • Performance bonus

Experience level:

  • 6 years

Schedule:

  • 8 hour shift
  • Day shift
  • Monday to Friday

Ability to commute/relocate:

  • Hartford, CT: Reliably commute or planning to relocate before starting work (Required)

Experience:

  • migrating data from on prem to cloud: 2 years (Preferred)
  • AWS (S3, Aethna, EMR, EC2), Spark, PySpark: 4 years (Preferred)

Work Location: In person

data engineer
Pro IT

www.proit-inc.com
Chesterfield, MO
Unknown / Non-Applicable
51 to 200 Employees
Company - Private
Related Jobs

All Related Listed jobs

Customer Service - Collections Team
Anglian Water Services Ltd Lincoln, England 21833 GBP ANNUAL Today

You will be providing general advice and support by listening and understanding the customers' needs to help find individual solutions; for instance,

Commercial Associate
V Group Limited Glasgow, Scotland 26527 - 49993 GBP ANNUAL Today

Group customers, by providing support with vessel forecasting, sales budgeting, post-mortem analysis,. Co-ordinating and developing customer-facing commercial

Year 2 Class Teacher - TLR - Lingey House Primary School
Gateshead Council Gateshead, England 31750 - 43685 GBP ANNUAL Today

Friendly, supportive colleagues who are motivated to develop our school and work well together. Is able to contribute to wider school life.

Junior Marketing Executive
BriefYourMarket London, England 26000 GBP ANNUAL Today

The role will be mainly a remote based role with a minimum 2 days per week in the Park Lane office and able to attend events when needed.

Hair and Makeup Artist
Lime Pictures Liverpool, England 21000 - 23850 GBP ANNUAL Today

We need someone with a minimum of level 3 hairdressing qualification and solid salon experience as a fully qualified hairdresser.