Lead Data Engineer

Lead Data Engineer

Marcus Donald are now searching for a Lead Data Engineer to join a client based in London.

My clients Data & Digital landscape is massively evolving, and they are looking to lead in modernising the approach currently offered. This is a great opportunity to join a collaborative environment that encourages open and inclusive discussion to drive the team forward.

You will be leading the technical development and have the opportunity to shape and direct data technology and in doing so can influence wider data architectures across the business.

Please note: To be considered for this role, you must have prior experience leading a team.

Key Skills as Lead Data Engineer

• Deployment (Essential)
• Hadoop (Essential)
• Data Modelling (Essential)
• DevOps knowledge/experience (Essential)
• Azure (Preferable)
• Python and SQL
• Hands on experience (including QA) in platforms such as Azure and the Hadoop ecosystems (HIVE, HDFS and Apache spark)
• Good knowledge on BI Tools
• Good knowledge on Linux
• Data Modelling

Key Responsibilities as Lead Data Engineer

• Designing pipelines, creating proof of concepts to production, running functional tests, end to end regression testing and quality/automation tests
• Carrying out data modelling and working closely with data scientists
• End-to-end data architecture and handling approach in the Data Services platform
• Define and communicate technical needs for data collection, ingestion, transformation and calculation
• Lead a team of engineers
• Delivering continuous improvements to the functionality of the Data Service platform and evolve the platform to meet business needs
• Assure all work meets governing standards
• Ensuring principles of privacy and security are assessed and designed into data solutions
• Follow Agile methodologies and encourage teamwork, communication, knowledge retention and training
• Share work with Product Owners and discuss strategies and support business needs

If you feel you are suitable for this Lead Data Engineer position, please apply via this job ad. Alternatively contact Joe directly.

Lead Data Engineer