data engineer

data engineer Washington, DC

Serigor
Full Time Washington, DC 80 - 70 USD HOURLY Today
Job description

Title: Azure Data Engineer (Hybrid)

Duration: 6 Months

Location: Washington, DC. 20003

The Azure Data Engineer will be responsible for designing, developing, and maintaining data pipelines, data models, and data storage solutions using Azure services. The candidate will work closely with cross-functional teams to ensure successful delivery of projects and support business objectives. The ideal candidate should have a strong technical background in managing data platforms and architecture using Azure services and experience in data warehousing, data integration, and ETL tools.

Responsibilities:

  • Design, develop, and maintain data pipelines using Azure Data Factory to ingest data from various sources such as SQL Server, MongoDB, and Blob Storage into Azure SQL Database and Azure Cosmos DB and Kafka.
  • Build data transformation logic using Databricks and Spark for data processing and analytics. Experience in tuning Databricks environments.
  • Design / implement data models for data warehousing on Azure SQL DB.
  • Configure and manage Hadoop and Spark clusters in Azure HDInsight for big data processing
  • Create and manage data storage solutions using Azure Blob and Data Lake.
  • Implement data governance and security measures to protect sensitive data.
  • Collaborate with cross-functional teams to ensure successful delivery of projects and support business objectives.
  • Mentor junior data engineers and developers and stay up-to-date with emerging technologies and trends in Azure data engineering.

Qualifications:

  • BS or MS degree in Computer Science or related fields
  • Minimum of 10 years of experience in managing data platforms and architecture using Azure services such as Azure Data Factory, Azure SQL Database, Azure Cosmos DB, and Azure HDInsight.
  • Strong experience in data warehousing, data integration, and ETL tools.
  • Proficient in programming languages such as Python, SQL, and C#.
  • Familiarity with NoSQL databases such as MongoDB and Cassandra.
  • Experience in version control tools such as Git and Bitbucket.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.
  • Ability to work independently and in a team environment.
  • Desirable: familiarity with Aveva/OSISoft PI system and SCADA systems

Regards,

Supriya Shaileja | Technical Recruiter

[email protected]

Ph: 443-529-9735 || Fax: 443-672-2575 || Fax: 443-692-6129

Job Type: Contract

Salary: $70.00 - $80.00 per hour

Ability to commute/relocate:

  • Washington, DC 20001: Reliably commute or planning to relocate before starting work (Required)

Experience:

  • Informatica: 1 year (Preferred)
  • SQL: 1 year (Preferred)
  • Data warehouse: 1 year (Preferred)

Work Location: In person

data engineer
Serigor

www.serigor.com
Baltimore, MD
Swati Sharma
$5 to $25 million (USD)
51 to 200 Employees
Company - Private
Information Technology Support Services
Related Jobs

All Related Listed jobs

Cleaning Assistant
Everyone Active Sunderland, North East England, England 7.49 - 10.42 GBP HOURLY Today

Ensure that the centre re-cycling policies are implemented when dealing with waste promoting good habits to the customers and colleagues.

Restaurant Crew Member - New Opening Restaurant
Burger King - York 2 - Monks Cross York, England 8 - 9.5 GBP HOURLY Today

To pull it off we need Restaurant Crew Members with fire in their belly who want to commit to the cause of go Whopper or go home!

Warehouse Operative (FT)
Mach Recruitment Stoke-on-Trent, England 10.42 - 23.45 GBP HOURLY Today

Previous warehouse experience desired but not required - Training Provided. Various training on other MHE (LLOP, PPT, Reach Truck) opportunities for development

Incident Manager
Visa London Today

Company Description Fascinated by the future and captivated by technology? Smart, driven and want to make a difference in the world? You will fit right in. By joining one of our teams at Visa...

Graduate trainee - Reading based
Transform Talent Limited Reading, England 25000 - 26000 GBP ANNUAL Today

They will be looking after a number of clients with multiple orders so organisational skills are key here. Ideally some experience with client facing roles as