data engineer Arizona
ACL Digital
Full Time
Arizona
10.56 - 12.04 USD Today
Job description
We are looking for an experience as a Big Data Engineer. You will design, develop, and implement large-scale big data solutions that enable the processing, storage, and analysis of massive datasets.
Joining ACL as an Big Data will provide you with the opportunity to work on challenging projects, leverage cutting-edge technologies, and contribute to the development of innovative solutions!
Location: Arizona, US
Level: 5+ years of experience
*Full-time position - W2 contract*
Role and responsibilities:
- Work closely with a team of data scientists, analysts, and other stakeholders to ensure the availability, reliability, and usability of data for analytical purposes and business decision-making.
- Work on the design and development of efficient and reliable data pipelines to collect, process, and store large-scale structured and unstructured data from various sources.
- Involved in the integration and data transformation from diverse sources, ensuring compatibility and consistency, to enable effective analysis and reporting.
- Set up and maintain the infrastructure required for Big Data processing, monitoring system performance, troubleshooting issues, and optimizing resource utilization.
- Implement robust security measures to protect sensitive data, including access controls, encryption, and compliance with privacy regulations.
- Work in collaboration with data scientists and analysts to understand requirements, provide clean and structured data for analysis, and assist in deriving data-driven insights.
Required Skills and Qualifications:
- At least 5+ years experience as a Bid Data Engineer
- Strong engineering skills
- Hands on experience with Unix commands, Unix Shell scripting, Hive, Bigdata technologies.
- Strong SQL knowledge with any RDBMS/HQL/Hive.
- Demonstrated skills in Pyspark
Nice to have skill:
- Bachelor's degree in Computer Science, Information Technology, or a related field. Advanced degree preferred.
- Working knowledge on Java (good to have)
- Knowledge of Scala/Python is a plus
We are an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
If you're interested in this exciting opportunity, please submit your resume soon. We're looking forward to hearing from you!
ACL Digital
www.acldigital.com
San Jose, CA
Ramandeep Singh
Unknown / Non-Applicable
1001 to 5000 Employees
Company - Private
Information Technology Support Services
1992
