Search

Data Engineer (G7)

Posted: 29/10/26
Recruiter:Department for Work and Pensions
Reference:3205432231
Type:Permanent
Disciplines: Systems Engineer
Salary:Competitive
Location:Birmingham
Description: Job summary

Please notethis role requires you to pass Security Check clearance. For further information, please see 'Selection process details'.

You must have resided continuously in the UK for at least 3 of the last 5 years, 2 of which must have been the immediately preceding years from the point of applying for this job.

Are you a Senior Data Engineer with expert-level experience in Azure data engineering, ETL/ELT pipeline design and technical team leadership?

Join DWP as part of our Data Engineering community, where you will lead the design and delivery of secure, scalable data solutions that power services used by millions of people across the UK. This role plays a key part in ensuring our data estate is reliable, well-governed and continuously improving, enabling analysts, data scientists and operational teams to access trusted data at scale.

Job description

Roles and Responsibilities:
  • Lead the team in designing, developing andmaintainingscalable ETL/ELT pipelinesusingastrong knowledge of PySpark and Python to ensure best practice and standards are met in optimizing,validatingand standardising all team data workflows as well as batch processes.
  • Lead collection of complex data requirements from a wide range of stakeholders, interpret the data and shape data sets to for Data Analysts to fulfil requirements in their creation of analysis and insight dashboards.
  • Lead the build and management as well as the supply of data to multiple systems and applications including database management. This to secure data availability and the construction of efficient scripts to extract data for cross business usage.
  • Leading immediate team though large-scale data and platform transformation and/or migration programmes, ensuring bestpracticeand building capability within the team as the transformation occurs. Set direction of change and proactivelyidentifykey issues.
  • Apply a deep understanding and experience of cloud data engineering toolsets in developing complex pipelines, lead development of products and automation processes. Lead development of logging,monitoringand assuring tool performance information.
  • Oversee, support and manage team in developing and using a range of operational tracking and cataloguing tools to track data and metadata through its journey such as: Google Cloud DataCatalog, AWS Glue DataCatalog, Azure DataCatalog, Informatica Enterprise DataCatalog, Alation, Apache Atlas etc. Ensuring compliance with business standards.
  • Lead the use of Agile practices in the team toleveragedata engineering tools like version control, automation, monitoring to streamline data pipelines, automate testing, deployment and track changes.
Skills England is an executive agency of the Department for Work and Pensions (DWP), working with employers, training providers, local partners and government to create better skills for better jobs. We play a leading role in identifying current and future skills needs across the economy, helping to ensure that people can access high-quality education, training and employment opportunities while supporting businesses to develop the skilled workforce they need. As part of the Digital and Data Services team you will play a key role in ensuring Skills England creates, maintains and uses data efficiently and effectively to drive decisions and produce high quality technical education products and labour market insights.

Locations for this team are: London, Coventry, Darlington, Sheffield, Leeds. Roles within other teams will be based in the locations advertised above. This can be discussed further, should you be successful.

Person specification

See selection process for further details.

If you would like to learn more about the role, please contact .

Technical skills

We'll assess you against these technical skills during the selection process:
  • Leading a team in designing Data Engineering Pipelines
Benefits

Alongside your salary of 57,946, Department for Work and Pensions contributes 16,786 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides (opens in a new window).

We also have a broad benefits package built around your work-life balance which includes:
  • Working patterns to support work/life balance such as job sharing, term-time working, flexi-time and compressed hours.
  • Generous annual leave at least 25 days on entry, increasing up to 30 days over time (prorata for part time employees), plus 9 days public and privilege leave.
  • Support for financial wellbeing, including interest-free season ticket loans for travel, a cycle to work scheme and an employee discount scheme.
  • Health and wellbeing support including our Employee Assistance Programme for specialist advice and counselling and the opportunity to join HASSRA a first-class programme of competitions, activities and benefits for its members (subscription payable monthly).
  • Family friendly policies including enhanced maternity and shared parental leave pay after 1 years continuous service.
  • Funded learning and development to support progress in your role and career. This includes industry recognised qualifications and accreditations, coaching, mentoring and talent development programmes.
  • An inclusive and diverse environment with opportunities to join professional and interpersonal networks including Womens Network, National Race Network, National Disability Network (THRIVE) and many more.
Hybrid Working

This role may be suitable for hybrid working, which is where an employee works part of the week in their DWP office and part of the week from home. This is a voluntary, non-contractual arrangement and your office will be your contractual place of work.

If a hybrid working arrangement is suitable for the role and for you, you will normally be required to spend a minimum of 60% of your contracted working hours from your DWP office.

If you have a disability, caring responsibilities, or other circumstances that may affect your ability to meet the minimum office attendance requirement, please discuss this with us using the contact details in this advert.

Salary Information

Pay for this role is from 57,946 to 75,664.

The maximum salary for the grade is 68,205, however a Digital Allowance of up to 7,459 per annum is available for exceptional candidates. Digital Allowance is non-salary, and non-pensionable, and is classed as a temporary allowance. It is reviewed annually where it could beretained, amended, or removed.

Pay for this role in London is from 63,075 to 74,005. (Please refer to location details to check eligibility)

Our offer to successful candidates will be based on an assessment of your skills and experience asdemonstratedat interview.

Existing Civil Servants who secure a new role on lateral transfer willmaintaintheir current substantive salary.

Civil Servants who gain promotion will move to the bottom of the grade pay scale or receive a 10% increase applied to their current substantive salary, whichever is greater.

Any temporary allowances that you are currently in receipt of will not form part of the calculation todetermineyour pay. Any allowances that are in payment will cease when you move into your new role.

Things you need to know

Artificial intelligence
Artificial intelligence can be a useful tool to support your application, however, all examples and statements provided must be truthful, factually accurate and taken directly from your own experience. Where plagiarism has been identified (presenting the ideas and experiences of others, or generated by artificial intelligence, as your own) applications may be withdrawn and internal candidates may be subject to disciplinary action. Please see our candidate guidance (opens in a new window) for more information on appropriate and inappropriate use.

Selection process details

This vacancy is using Success Profiles (opens in a new window) , and will assess your Experience and Technical skills.

Stage 1: Application

Your application will consist of four parts:

1. A Personal Details application form.

2. Employment history - this should contain your work experience and any skills, qualifications and accomplishments relevant to the jobs you have completed.

3. Personal statement - up to 1000 words. This statement should be used to provide examples of how you meet the essential criteria below:
  • PRACTITIONER: Ability to lead the team in developing complex ETL pipelines, including effective delegation and prioritisation of work.
  • PRACTITIONER: Sound ability in communicating between the technical and non-technical: you can break down complex concepts to communicate them in plain language, adapting communication style to large audiences of none-specialists and senior stakeholders.
  • PRACTITIONER: Strong understanding of the principles of data processing in a distributed or cloud systems, and ability to use this understanding to ensure and design robust coding in a distributed or cloud environment using a variety of native toolsets.
  • PRACTITIONER: Understand how to collate and review complex technical requirements and specifications, leading the definition of test conditions for the team.
  • PRACTITIONER: Understand how to lead and investigate complex problems/issues in data, pipelines and processes, systems and platforms . click apply for full job details

Recruiting now