Senior Data Engineer

VIQU Limited
United Kingdom
45000.00 - 86000.00 GBP Annual + Benefits
03 Jan 2023
31 Jan 2023
Employer Sector
Technology, ICT & Telecoms
Contract Type
Full Time
Senior Data Engineer - GBP45-86k UK Remote Working - Must have SC Clearance Our client, a leading consultancy business is looking for outstanding talent to join their vibrant and growing team. With cutting-edge resources, are you the next hire to join their passionate team. Main responsibilities of the Senior Data Engineer: As a Senior Data Engineer, you will be accountable or designing and developing data processing and data persistence software components for solutions which handle data at scale. Working within a multi-skilled agile team, Senior Data Engineers provide strong development leadership and take responsibility for significant technical components of data systems, while designing and developing large-scale data processing software to meet user needs in demanding production environments. Working to develop data processing software primarily for deployment in Big Data technologies. The role encompasses the full software lifecycle including design, code, test and defect resolution. Collaborating with colleagues to resolve implementation challenges and ensure code quality and maintainability remains high. Leads by example in code quality. Working with Architects and Lead Engineers to ensure the software supports non-functional needs. Working with operations teams to ensure operational readiness Advising customers and managers on the estimated effort and technical implications of user stories and user journeys. Coaching and mentoring team members. Essential Requirements for the Senior Data Engineer: Strong software development experience in one of Java, Scala, or Python Software development experience with data-processing platforms from vendors such as AWS, Azure, GCP, Databricks. Solid understanding of ETL/ELT data processing pipelines and design patterns Experience of developing substantial components for large-scale data processing solutions and deploying into a production environment Proficient in SQL and SQL extensions for analytical queries Aware of key features and pitfalls of distributed data processing frameworks, data stores and data serialisation formats Able to write quality, testable code and has experience of automated testing Experience with Continuous Integration and Continuous Deployment techniques Desirables for the Senior Data Engineer: Experience of performance tuning Experience with steaming and event-processing architectures including technologies such as Kafka and change-data-capture (CDC) products Experience of data visualisation and complex data transformations Expertise in continuous improvement and sharing input on data best practice Job title: Senior Data Engineer Job type: Permanent Job Location: Remote Job Salary: GBP45-86k per annum + Benefits