Search & Apply Job description
Job description
Senior Data Engineer (6272)
Your Role and What You'll Be Doing
We’re looking for a Senior Data Engineer to play a key role in shaping and delivering our data strategy, helping us unlock the full value of data across the firm.
In this role, you’ll design, build, and optimise modern data solutions, supporting advanced analytics and enabling data-driven decision-making across the business.
You’ll work closely with engineers, analysts, and stakeholders to deliver high-quality, scalable data products, while also contributing to the development of our cloud-based data platform and wider data culture.
Key responsibilities:
- Design, develop and maintain end-to-end data pipelines and lakehouse solutions using Python/PySpark and Azure technologies
- Build and optimise ETL processes and data models to support business requirements
- Collaborate with stakeholders to translate complex data needs into scalable technical solutions
- Implement data integration workflows across multiple sources into Azure data storage solutions
- Optimise performance, scalability and reliability using distributed data processing techniques
- Monitor, troubleshoot and resolve data pipeline issues, ensuring data integrity and availability
- Support data scientists and analysts with data engineering solutions for advanced analytics and machine learning
- Contribute to architectural best practices and continuous improvement across the data platform
- Stay up to date with emerging technologies and recommend improvements to our data capabilities
- Support technical interviews and help shape the growth of the data engineering team
- Provide coaching and guidance to junior engineers to support their technical and professional development
- Share best practices and foster a culture of continuous learning
- Support career development and progression through regular feedback and development conversations
- Contribute to training initiatives and knowledge sharing across the team
About You
Essential experience:
- Proven experience as a Data Engineer, working extensively with Python/PySpark
- Strong experience with Azure data services (e.g. Azure Data Factory, Databricks, Azure SQL, Data Lake, Synapse)
- Experience building Databricks Lakehouse solutions (including Delta Lake and Unity Catalog)
- Strong knowledge of data modelling, ETL processes, and data integration
- Experience working with cloud-based architectures and big data technologies
- Experience using infrastructure-as-code tools (e.g. Terraform or Bicep) and Azure DevOps
Desirable:
- Experience working in cloud platform engineering
- Experience within agile product teams
- Experience in a professional services environment
You’ll also bring:
- Strong communication skills, with the ability to explain technical concepts to non-technical stakeholders
- A collaborative approach and ability to build strong working relationships
- Excellent problem-solving skills and attention to detail
- Adaptability and a passion for continuous learning
- Emotional intelligence and a supportive approach to teamwork
- Leadership capability, with experience mentoring or guiding others
We're proud of our values, and we're looking for people who share them
- Sub-Department:Data Engineering & Platforms
- Sub-Division:Data Architecture & Engineering
- Company:IM LLP
- Working Hours:Full Time
- Vacancy Type:Permanent
- Location:Flexible
- Salary:Competitive
Loading



