data engineer Richmond, VA
Job description
Job Title: Big Data Hadoop Developer with Cloud Description
Job Location: Richmond, VA/Norfolk, VA/Atlanta, GA/Woodland Hills, CA/Thousands Oak, CA (onsite role for any of the given location)
Job Type: Contract
Job Duration: Long Term.
Job Description:-
Big Data Hadoop Developer with Cloud experience to build end to end business solutions and to work with one of the leading healthcare providers in US. The ideal candidate must possess excellent background on Big Data Hadoop development. The candidate must possess excellent written and verbal communication skills with the ability and collaborate effectively with domain and technical experts in the team
Requirements
- Must have experience in design and development of applications using Scala, Python languages on Hadoop
- Experience in implementing applications using Spark framework on Hadoop platform
- Experience in data processing using XML files, JSON, Excel, CVS and other types of files
- Experience in ETL and data processing on Hive and HBase
- Experience in implementation of Scoop, Flume and Kafka etc.
- In-depth understanding main components of Hadoop:HDFS, Hadoop MapReduce, YARN
- Must have developed and implemented integration processes involving shell scripting
- Experience in Devops: Automation of integration testing using Bamboo, JUnit and deployment of applications from development to production.
- Must have solid trouble shooting skills in identifying errors and to provide solutions.
- Comfort & familiarity with SQL and Hadoop ecosystem of tools including spark Understanding of foundational Machine Learning concepts and some Deep Learning basics • Candidate with a mixture of Software Development, Data Engineering and Data Science skills
- Strong Software Development and Engineering skills with some basic knowledge in Machine Learning and Deep Learning
- Ability to write efficient code-- Good understanding of core Data Structures/algorithms is critical for engine development
- 5+ years’ experience in any flavor of SQL dealing with complex queries, analytics and data models.
- 3+ years’ experience in any of the modern programming languages
- Must have 4+ years of experience in Spark
- Should have experience in AWS services like Glue, S3, Athena, EMR
- Should have experience in Windows Powershell scripting
- Good Analytical skills and experience in cross functional team environment
- Healthcare domain knowledge is preferred
- The work will entail heads down coding, testing, data analysis, component packing/deployment
- Strong SQL, Teradata, unix, Strong standard Big Data/hadoop skillset (Hadoop hive, sqoop, hdfs, etc) String Spark/python/scala
- 3+ solid yrs experience with the above skillset
Responsibilities
- Design, code, install, and maintain appropriate systems software program.
- This is a lower level development role - Which means absolute hands on expertise is mandatory
- Identify, evaluate, tailor, and direct the implementation of vendor-supplied software packages.
- Ensure the maintenance of adequate software systems documentation.
- Conduct quality assurance activities such as peer reviews and test plan development
- Work on sprint team in agile, rapid development and deployment environment
Location:
Preferred location is Atlanta followed by any other locations including but not limited to Richmond VA, Atlanta GA, Norfolk VA, Mason, OH, Woodland Hills CA, Thousand Oaks CA
Job Types: Contract, Temporary
Salary: $60.00 - $65.00 per hour
Schedule:
- 8 hour shift
- Monday to Friday
Ability to commute/relocate:
- Richmond, VA 23230: Reliably commute or planning to relocate before starting work (Required)
Experience:
- Hadoop: 6 years (Required)
- Big data: 5 years (Required)
- Spark: 3 years (Required)
Work Location: In person
Speak with the employer
+91 9810-561162
