data engineer

data engineer Remote

AppsIntegration
Full Time Remote 50 - 45 USD HOURLY Today
Job description

Position: Sr. Azure Data Engineer

Duration: 12+months

Location: 100% Remote

TOP 3:

Azure Data Engineer:

Must have ADF, Azure SQL, Spark

1) Support and refine Constellation’s data and analytics technology stack with an emphasis on improving reliability, scale, and availability. ADF, Spark

2) Assist in the design and management of enterprise grade data pipelines and data stores that will used for developing sophisticated analytics programs, machine learning models, and statistical methods.

3) Experience delivering data solutions via Agile methodologies and designing CI/CD workflows.

PRIMARY DUTIES AND ACCOUNTABILITIES

Item Accountability %

1 Create and maintain optimal data pipeline architecture 20

2 Assemble large, complex data sets that meet functional / non-functional business requirements. 20

3 Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. 20

4 Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Big Data technologies. 20

5 Deliver automation & lean processes to ensure high quality throughput & performance of the entire data & analytics platform.? 10

6 Work with data and analytics experts to strive for greater functionality in our analytics platforms. 10

POSITION SPECIFICATIONS

Minimum: Preferred:

  • Experience in building/operating/maintaining fault tolerant and scalable data processing integrations using Azure
  • Strong problem-solving skills with emphasis on optimization data pipelines
  • Excellent written and verbal communication skills for coordinating across teams
  • A drive to learn and master new technologies and techniques
  • Experienced in DevOps and Agile • Experience using Docker or Kubernetes is a plus
  • Demonstrated capabilities with cloud infrastructures and multi-cloud environments such as Azure, AWS, IBM cloud
  • environments and using CI/CD pipelines.
  • Experienced using Databricks & Apache Spark
  • Experienced using Azure Data Factory or Synapse Analytics

Job Type: Contract

Salary: $45.00 - $50.00 per hour

Compensation package:

  • Weekly pay

Experience level:

  • 8 years

Schedule:

  • 8 hour shift

Experience:

  • Informatica: 1 year (Preferred)
  • SQL: 1 year (Preferred)
  • Data warehouse: 1 year (Preferred)

Work Location: Remote

data engineer
AppsIntegration

www.appsintegration.com
Pleasanton, CA
Madhu B Vattikuti
$1 to $5 million (USD)
1 to 50 Employees
Company - Private
Computer Hardware Development
Related Jobs

All Related Listed jobs

Housekeeper
Premier Inn Liverpool, England 11.02 GBP HOURLY Today

Fixed term contract 3 months. Join us at Liverpool City Centre (Liverpool One) as a Housekeeper, part of the Housekeeping team that clean our hotel rooms.

Ride Operator and Kiosk
Flamingo Park Hastings, England 5.28 - 10.42 GBP HOURLY Today

19 - 21 years old - Sunday 19th March 2023. 16 - 18 years old - Saturday 18th March 2023. Bonuses awarded to those who excel in their positions.

treasury analyst
Northland Investment Corporation Newton, MA 70080 - 53526 USD ANNUAL Today

Position Purpose: Processes treasury functions for all Northland’s corporate, commercial, multifamily, and development...

Marketing Operations Manager - EMEA
Fender London, England 35688 - 46779 GBP ANNUAL Today

Partner with the FMIC sales team to take a strategic account management approach with Fender's top retail partners and drive the Exceptional Presentation

inside sales representative
HomeStars London 90000 - 85000 CAD ANNUAL Today

Job Type: Full Time - Permanent

Working Hours: Mon-Fri, 40...