data engineer Washington, DC
Insomniac Design
Full Time
Washington, DC
120496 - 81779 USD ANNUAL Today
Job description
Insomniac Design is a global digital agency headquartered in Washington D.C., with offices in London, Bucharest and Chisinau. We’re an agile, determined and innovative team organized by functional areas of expertise — Creative, Technology, Strategy, and Management. We specialize in human-centered design with deep focus on design thinking and digital transformation.
As a Data Engineer, you will work closely with the other Engineers to design, develop, and maintain a robust and scalable unified data repository for our client's global marketing agency. Your primary responsibility will be to ensure the seamless integration and consolidation of various data types, implement data pipelines, and build an interactive reporting portal. Your expertise in data engineering, database management, and data integration will be critical in delivering high-quality solutions that meet our client's needs.
Responsibilities
- Design, and deliver specifications, documentation and implementation of unified data repositories and the data flows of diverse data types from multiple sources.
- Develop and maintain ETL (Extract, Transform, Load) processes and data pipelines to efficiently extract data from various sources, transform and clean it, and load it into the unified data repository.
- Design and optimize database structures, tables, and schemas to ensure efficient storage, retrieval, and querying of data.
- Implement data quality and data governance processes to ensure the accuracy, integrity, and security of the data repository.
- Work closely with the development team to integrate the unified data repository with the reporting portal, ensuring seamless data access and enabling interactive data visualization and reporting capabilities.
- Collaborate with cross-functional teams to understand and document data requirements and translate them into technical solutions.
- Monitor data integration processes, troubleshoot issues, and perform data validation and reconciliation to ensure data accuracy and consistency.
- Work closely with clients to understand their business needs and design solutions that meet those needs.
- Troubleshoot technical issues and work with the development team to deliver solutions.
- Provide technical guidance and mentorship to junior team members.
- Stay up-to-date with emerging trends and technologies in web development, cloud platforms and data schema design.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related field. A master's degree is a plus.
- 4+ years of experience as a Data Engineer or in a similar role, preferably in a large-scale data integration or data warehousing project.
- Strong proficiency in SQL and experience with relational database management systems (e.g., MySQL, PostgreSQL, Oracle).
- Proficiency in designing and developing ETL processes and data pipelines using tools like Apache Spark, Apache Kafka, or similar technologies.
- Solid understanding of data modeling concepts and experience with data modeling tools.
- Experience with cloud platforms (e.g., AWS, Azure, GCP) and knowledge of cloud-based data services (e.g., Amazon Redshift, Google BigQuery, Azure Data Lake).
- Familiarity with data visualization tools and techniques for creating interactive dashboards and reports (e.g., Tableau, Power BI, Looker).
- Strong analytical and problem-solving skills, with the ability to analyze complex data sets and troubleshoot data-related issues.
- Excellent communication and interpersonal skills, with experience managing client relationships.
- Experience working in an Agile development environment.
Applicant Eligibility: Please note, candidates who are eligible to work in the US without visa sponsorship are eligible to apply. No recruiters or staffing agencies please.
Insomniac Design
www.insomniacdesign.com
Washington, DC
Daniel McKee
Unknown / Non-Applicable
1 to 50 Employees
Company - Private
Enterprise Software & Network Solutions
1999
