data engineer Toronto
illumin
Full Time
Toronto
143424 - 132701 CAD ANNUAL Today
Job description
illumin is a leading technology company that provides marketers with a one-stop solution for omnichannel digital advertising with best-of-category return on advertising spend. Our journey automation technology, illumin™, offers planning, buying and real-time intelligence from one platform. With proprietary Artificial Intelligence, illumin™ brings unique programmatic capabilities to close the gap between advertising planning and execution. illumin is headquartered in Toronto with offices throughout Canada, the U.S., Europe, and Latin America. For more information, visit illumin.com and check out our Life @ illumin video here!
We are seeking a talented Data Engineer (Scala/Spark) to join our Engineering team! As a Data Engineer, you will be responsible for designing and developing large-scale data processing solutions using Apache Spark and other big data technologies. The ideal candidate should have experience with Scala programming and a deep understanding of Spark architecture and internals.
What You Will Do:
- Design, develop, and maintain large-scale data processing solutions using Apache Spark and Scala
- Develop ETL pipelines to process, clean, and transform data from various sources
- Optimize Spark jobs for performance and scalability
- Collaborate with data scientists, analysts, and other cross-functional teams to understand data requirements and deliver high-quality solutions
- Ensure data accuracy, consistency, and completeness throughout the entire data pipeline
- Develop and maintain APIs to facilitate data access and integration
What You Will Need:
- Bachelor's degree in Computer Science, Software Engineering, or related field
- 3+ years of experience in Scala programming and Spark development
- Strong understanding of Spark architecture and internals
- Experience with distributed computing technologies (e.g., Hadoop, Hive, Kafka)
- Experience with database technologies and SQL
- Experience with developing and consuming APIs
- Strong problem-solving skills and attention to detail
- Excellent communication and collaboration skills
Nice To Have But Not Required:
- Experience with other big data technologies (e.g., Flink, Storm)
- Experience with developing and consuming from real time API sources using OAuth
- Experience with data visualization tools (e.g., Tableau, Power BI)
What You Will Get:
- An inspiring and family-focused culture with offices around the world
- A competitive compensation package
- Comprehensive health and dental benefits including life and disability insurance
- An unlimited vacation policy
- Generous parental leave benefits with a top-up plan
- Time with our executive coach and Chief Empowerment Officer to assist in your growth and professional development
- Participation in our Employee Recognition Awards program
- An annual education and learning stipend
- Corporate rates and perks including fitness membership discounts
- We live and promote our company's values: Act with integrity, Never settle, Design to disrupt, Customer-Driven, Family-focused
GREAT PLACE TO WORK®
illumin is certified as a Great Place to Work® after a thorough and independent analysis conducted by @Great Place to Work Canada. This certification is based on direct feedback from employees, provided as part of an extensive and anonymous survey about the workplace experience. Check out our website here.
DISCLAIMER
This description has been designed to indicate the general nature and level of work performed by the employee within this position. However, the actual responsibilities, duties, qualifications, and experience may vary. The Employee may perform other related duties as required to meet the ongoing needs of the organization. Information contained in this job posting/description is subject to change.
DIVERSITY, INCLUSION & EQUAL EMPLOYMENT OPPORTUNITIES
illumin is committed to the principle of equal employment opportunity for all our people and to providing a work environment free of discrimination and harassment. We expect and require the cooperation of all our people in maintaining an environment with mutual respect by and for all our employees and applicants.
All employment decisions at illumin are based on business needs, job requirements and individual qualifications, without regard to race, colour, ancestry, creed (religion), place of origin, ethnic origin, citizenship, sex (including pregnancy, gender identity), sexual orientation, age, marital status, family status, political belief, physical or mental disability, receipt of public assistance, or irrelevant record of the offence.
illumin provides accommodations for individuals with disabilities. If you require accommodation, please contact us by e-mail at [email protected]. This ensures that the appropriate accommodations are in place during the recruitment and selection process and before you begin your journey with us.
Let us know what we can do to help you be successful during your recruitment experience at illumin.
About illumin
CEO: Tal Hayek
Revenue: $100 to $500 million (USD)
Size: 51 to 200 Employees
Type: Company - Public
Website: https://www.illumin.com
Year Founded: 2009
illumin
https://www.illumin.com
Toronto, Canada
Tal Hayek
$100 to $500 million (USD)
51 to 200 Employees
Company - Public
Computer Hardware Development
2009
