technology engineer New York, NY
Job description
Role: Data Bricks Engineer with Pyspark and Snowflake experience
Location: NYC, NY (Onsite)
Experience : 10 to 15 years
Skills:
Great hands-on experience with Databricks platform. Extensive experience in PySpark coding.
Excellent written and verbal communication, intellectual curiosity, a passion to understand and solve problems, consulting & customer service
Structured and conceptual mindset coupled with strong quantitative and analytical problem-solving aptitude
Exceptional interpersonal and collaboration skills within a team environment
Responsibilities:
Design, develop, and deploy Databricks jobs to process and analyze large volumes of data.
Collaborate with data engineers and data scientists to understand data requirements and implement appropriate data processing pipelines.
Optimize Databricks jobs for performance and scalability to handle big data workloads.
Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
Implement best practices for data management, security, and governance within the Databricks environment.
Job Type: Contract
Salary: $60.00 - $80.00 per hour
Schedule:
- 8 hour shift
Ability to commute/relocate:
- New York, NY: Reliably commute or planning to relocate before starting work (Required)
Experience:
- REST: 1 year (Preferred)
- Java: 1 year (Preferred)
Work Location: In person
