data engineer Remote
Job description
Job Role: Data Engineer (Cloud Analytics)
Location: Remote (with in United States)
Duration: Contract
Description:
This Data Engineer (Cloud Analytics) will support data sourcing strategies, designs, and implementation for Federal Enterprise Cloud Data Lake by designing, building, and integrating data from various sources in support of predictive and adaptive analytics.
Required (Individual Role):
We are looking for a data engineer who can create and manage automated data pipelines using the latest technologies for data ingestion, processing, and delivery. You will work with cloud services such as Azure and Apache Hadoop to design and implement data lake solutions that support advanced analytics use cases. You will also develop and deploy data distribution mechanisms using APIs, event streams, and pub/sub models. You will be responsible for migrating data lakes from on-premises to cloud, optimizing data workflow performance, and monitoring data quality and availability. You will collaborate with data analysts, scientists, and visualization experts to deliver insights to our clients.
To be successful in this role, you should have:
Hands-on experience with batch ETL, data streaming, or change data capture technologies
Proficiency in designing and implementing data integration processes using cloud services such as Azure Event Hub, Data Factory, Data Catalog, Databricks, Stream Analytics, Apache Spark
Experience in designing data lake storage structures and data transformation and distribution processes
Proficiency in developing and operationalizing various data distribution patterns such as APIs, event based, publish/subscribe models
Experience migrating data lakes from on-premises to cloud
Experience using the Apache Hadoop technology stack
Advanced experience in SQL programming
Proficiency in programming languages (e.g., Python, Java)
Experience with agile delivery using Jira, or Azure DevOps
Experience monitoring performance of data workflows and infrastructure using monitoring tools and enabling alerts
Functional knowledge of data visualization tools
Excellent written and oral communication skills
Bachelor’s degree in information systems, Computer Science, Engineering, or related field
If you are interested in this opportunity, please apply online with your resume and cover letter. We look forward to hearing from you.
Job Type: Contract
Compensation package:
- 1099 contract
- Hourly pay
Experience level:
- 10 years
Schedule:
- 8 hour shift
Experience:
- Informatica: 10 years (Required)
- SQL: 9 years (Required)
- Data warehouse: 9 years (Required)
Work Location: Remote
