data engineer

data engineer Remote

AppsIntegration.Inc
Full Time Remote 120840 - 74181 USD ANNUAL Today
Job description

Must have ADF, Azure SQL, Spark

1) Support and refine Constellation’s data and analytics technology stack with an emphasis on improving reliability, scale, and availability. ADF, Spark

2) Assist in the design and management of enterprise grade data pipelines and data stores that will used for developing sophisticated analytics programs, machine learning models, and statistical methods.

3) Experience delivering data solutions via Agile methodologies and designing CI/CD workflows.

PRIMARY DUTIES AND ACCOUNTABILITIES

Item Accountability %

1 Create and maintain optimal data pipeline architecture 20

2 Assemble large, complex data sets that meet functional / non-functional business requirements. 20

3 Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. 20

4 Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Big Data technologies. 20

5 Deliver automation & lean processes to ensure high quality throughput & performance of the entire data & analytics platform.? 10

6 Work with data and analytics experts to strive for greater functionality in our analytics platforms. 10

POSITION SPECIFICATIONS

Minimum: Preferred:

  • Experience in building/operating/maintaining fault tolerant and scalable data processing integrations using Azure
  • Strong problem-solving skills with emphasis on optimization data pipelines
  • Excellent written and verbal communication skills for coordinating across teams
  • A drive to learn and master new technologies and techniques
  • Experienced in DevOps and Agile • Experience using Docker or Kubernetes is a plus
  • Demonstrated capabilities with cloud infrastructures and multi-cloud environments such as Azure, AWS, IBM cloud
  • environments and using CI/CD pipelines.
  • Experienced using Databricks & Apache Spark
  • Experienced using Azure Data Factory or Synapse Analytics

Job Type: Contract

Pay: $74,181.34 - $120,840.44 per year

Experience:

  • Informatica: 1 year (Preferred)
  • SQL: 1 year (Preferred)
  • Data warehouse: 1 year (Preferred)

Work Location: Remote

Speak with the employer
+91 9255967099

data engineer
AppsIntegration.Inc

Related Jobs

All Related Listed jobs

Night Support Worker
Cygnet Health Care Bradford, Yorkshire and the Humber, England 10.1 GBP HOURLY Today

At Cygnet, our perks go way beyond pension schemes and excellent professional development - youll also enjoy discounts with our free NHS blue light card,

Health Care Assistant
MedCare HQ London, England 10.42 - 11 GBP HOURLY Today

Full UK Driving licence preferred but not essential. We are looking for a confident candidate with a passion for delivering outstanding care to adults in a

Store Assistant
Aldi Newport, Newport, Wales 11 GBP HOURLY Today

You'll do everything from checking off deliveries to dealing with enquiries or ensuring that the shelves are fully stocked with well-presented products.

Care Assistant
Exemplar Health Care Services Limited Leigh, Dorset, South West England, England 9.85 GBP HOURLY Today

Support social and recreational activities; both in and out the home individually, or as part of a group. Lakeview supports 30 adults living with complex mental

Barber In Central Bath
Dappa Bath, England 15 - 25 GBP HOURLY Today

We're looking for a barber to join our team at Dappa. Ideally 3-5 days per week including Saturdays. You'll be joining a really talented and friendly group