Description:
My client has been a pioneer in delivering data-driven insights to the media and market research industries for over a decade. Their platform provides unique and actionable data solutions to top brands and partners worldwide, empowering them to make informed, strategic decisions.
They are seeking an experienced Data Engineer to work closely with our Machine Learning and Product teams to ensure our data products are of the highest quality. The ideal candidate will have strong analytical skills, expertise in Python and SQL, and a passion for debugging and improving data processes. This role requires collaborative problem-solving, a keen attention to detail, and the ability to translate complex business requirements into robust data solutions.
The Role:
Your primary responsibilities will involve analysing and troubleshooting issues with data products and collaborating with both Product and ML teams to devise robust solutions. You will apply strong Python and SQL skills to ensure data accuracy, integrity, and scalability, while also engaging in continuous improvements to our data products.
You will tackle complex data challenges in a fast-paced, exciting environment, leveraging cutting-edge Big Data open-source technologies like Apache Spark, as well as Amazon Web Services (AWS) solutions such as Elastic MapReduce (EMR), Athena, and Lambda to develop innovative and scalable data solutions.
Key Responsibilities:
- Continually review and measure the performance of data products and drive innovation and improvements
- Become a subject matter expert for data products and supporting processes and be able to present to others to knowledge share.
- Regularly reviewing colleagues’ work and providing helpful feedback.
- Working with stakeholders to fully understand requirements and be a technical reference point for product team members on customer calls.
- Writing application code and tests that conform to standards.
- Adhering to Company Policies and Procedures with respect to Security, Quality and Health & Safety.
About You:
Here’s what we’re looking for:
- SQL and Python development experience as a Data Engineer, preferably using AWS or equivalent cloud provider.
- Analytical skills to be able to present decisions to stakeholders in a data driven way.
- The ability to problem-solve and break down complex problems, whilst working on complex datasets.
- Knowledge of agile software development best practices including continuous integration, automated testing and working with software engineering requirements and specifications.
- Good interpersonal skills, positive attitude and willing to help other members of the team.
