Responsibilities
▪ Build data analytics platform using Python and Spark utilizing good DevOps practices.
▪ Work with business partners to understand new requirements and migrate existing legacy applications to the new platform
▪ Ability to go from requirements gathering to production
▪ Work in cross-functional agile teams to continuously experiment, iterate and deliver on new objectives.
▪ Developing scalable and re-usable frameworks
▪ Strong track record in working with open-source projects and picking the right tool for the job
▪ Ability to bring less experienced team members along for the ride with the ability to explain the complex technical topics.
▪ Collaborate with the wider Enterprise data organization.

Requirements
▪ 3+ years as a Data Engineer, Data Scientist, or Data Analyst
▪ 3+ years’ experience working with Python and Spark
▪ Extensive knowledge and experience of working with Databricks
▪ Solid experience in good test automation patterns with the ability to implement
▪ Experience working in Cloud environments such as Azure or AWS
▪ Expert knowledge and experience working with data pipelines from multiple sources
▪ Familiar with modern data lake and warehousing concepts
▪ Knowledgeable about data modeling, data access, and data storage techniques.
▪ Ability to work in an Agile Scrum environment
▪ Good working knowledge of SQL.
▪ Experience working with and creating APIs
▪ Self-starter attitude