Search

Data Engineer

Posted: 01/09/26
Recruiter:Department for Work and Pensions
Reference:3165745633
Type:Permanent
Disciplines: Systems Engineer
Salary:Competitive
Location:Birmingham
Description: Job summary

Please note this role requires you to pass Security Check clearance. For further information, please see 'Selection process details'.

Are you an experienced Data Engineer with strong Analytical skills?

Do you want to utilise best in class technologies to deliver exceptional cloud-based data products for Data Analysts and Scientists?

DWPs Digital Group is looking for experienced Data Engineers to fill post in Management Information (MI) team.

The MI teamprovides strategic capabilities for MI reporting and data visualisations across DWP. Working with modern cloud environments alongside legacy on-premises technologies, youll play a key role in developing the DWP Data Engineering Strategy for MI products and services.

Successful candidates will join a fast-paced environment with a wide portfolio of products for analytical use and a challenging delivery roadmap. Youll focus on a variety of tasks, supporting platform live service and delivering high quality, data transformation products.

Job description
  • Building and maintain scalable data engineering solutions that power analytical reporting, working in line with DWPs engineering standards.
  • Collaborating with stakeholders across DWP to gather and clarify requirements where needed and translate them into scalable back-end data processes that support MI reporting needs.
  • Maintaining comprehensive technical documentation and collaborative workspaces in Confluence to improve transparency, knowledge sharing, and onboarding.
  • Working closely with other junior data engineers to provide guidance, share technical expertise, and actively support ongoing knowledge sharing.
  • Reviewing code developed by fellow engineers to ensure quality, maintainability, and adherence to DWP coding standards.
Person specification

See selection process for further details.

If you would like to learn more about the role, please contact .

Technical skills

We'll assess you against these technical skills during the selection process:
  • Technical Breadth
Benefits

Alongside your salary of 44,447, Department for Work and Pensions contributes 12,876 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides (opens in a new window).

We also have a broad benefits package built around your work-life balance which includes:
  • Working patterns to support work/life balance such as job sharing, term-time working, flexi-time and compressed hours.
  • Generous annual leave at least 25 days on entry, increasing up to 30 days over time (prorata for part time employees), plus 9 days public and privilege leave.
  • Support for financial wellbeing, including interest-free season ticket loans for travel, a cycle to work scheme and an employee discount scheme.
  • Health and wellbeing support including our Employee Assistance Programme for specialist advice and counselling and the opportunity to join HASSRA a first-class programme of competitions, activities and benefits for its members (subscription payable monthly).
  • Family friendly policies including enhanced maternity and shared parental leave pay after 1 years continuous service.
  • Funded learning and development to support progress in your role and career. This includes industry recognised qualifications and accreditations, coaching, mentoring and talent development programmes.
  • An inclusive and diverse environment with opportunities to join professional and interpersonal networks including Womens Network, National Race Network, National Disability Network (THRIVE) and many more.
Hybrid Working

This role may be suitable for hybrid working, which is where an employee works part of the week in their DWP office and part of the week from home. This is a voluntary, non-contractual arrangement and your office will be your contractual place of work.

If a hybrid working arrangement is suitable for the role and for you, you will normally be required to spend a minimum of 60% of your contracted working hours from your DWP office.

If you have a disability, caring responsibilities, or other circumstances that may affect your ability to meet the minimum office attendance requirement, please discuss this with us using the contact details in this advert.

Salary Information

Pay for this role in National locations is from 44,447 to 54,813.

The maximum salary for the grade is 46,547, however a Digital Allowance of up to 8,266 per annum is available for exceptional candidates. Digital Allowance is non-salary, and non-pensionable, and is classed as a temporary allowance. It is reviewed annually where it could be retained, amended, or removed.

Pay for this role in London is from 50,044 to 51,528.

Our offer to successful candidates will be based on an assessment of your skills and experience asdemonstratedat interview.

Existing Civil Servants who secure a new role on lateral transfer willmaintaintheir current substantive salary.

Civil Servants who gain promotion will move to the bottom of the grade pay scale or receive a 10% increase applied to their current substantive salary, whichever is greater.

Any temporary allowances that you are currently in receipt of will not form part of the calculation todetermineyour pay. Any allowances that are in payment will cease when you move into your new role.

Things you need to know

Artificial intelligence
Artificial intelligence can be a useful tool to support your application, however, all examples and statements provided must be truthful, factually accurate and taken directly from your own experience. Where plagiarism has been identified (presenting the ideas and experiences of others, or generated by artificial intelligence, as your own) applications may be withdrawn and internal candidates may be subject to disciplinary action. Please see our candidate guidance (opens in a new window) for more information on appropriate and inappropriate use.

Selection process details

This vacancy is using Success Profiles (opens in a new window) , and will assess your Experience and Technical skills.

Stage 1: Application

Your application will consist of four parts:

1. A Personal Details application form.

2. Employment history - this should contain your work experience and any skills, qualifications and accomplishments relevant to the jobs you have completed.

3. Personal statement - up to 750 words. This statement should be used to provide examples of how you meet the essential criteria below:
  • Practitioner: Ability toorchestrate PySpark jobs on EMR, managing dependencies, workflow execution, and operational efficiency.
  • Working: Knowledge of designingevent-driven architectures, leveragingAWS Lambda functionsto triggerPySpark workflowsbased on real-time data ingestion and processing needs.
  • Practitioner: Experienced in provisioning cloud infrastructure using Amazon EC2, and automating deployment, configuration, and data workflows with Bash scripting across scalable environments.
  • Working: Ability to applyAgile best practices in developing CI/CD pipelines, using continuous integration, testing, and deploymentwithin a collaborative development framework.
  • Practitioner: Understanding ofoptimising queries, storage formats, and data structuresto enhance efficiency, reduce processing time, and ensure high data quality standards in complex cloud architectures.
4. Technical statement (up to 250 words). The following statement is aligned to the required technical skill of Technical Breadth. This statement should be used to provide example(s) of how you meet the criterion below:
  • Practitioner: Good understanding ofdesigning and automating ETL pipelinesusingPySpark and Spark SQL, ensuring seamless extraction, transformation, and loading of structured and unstructured data across cloud environments.
Ensure that all examples provided in your statements are taken directly from your own experience and that you describe the examples in your own words. If you choose to use gen-AI to support your statements, you must follow the guidelines outlined in the Artificial intelligence and recruitment guide.

The sift panel will use the information in your employment history, personal statement, and technical statement to assess your experience, skills and knowledge.

An initial sift will be conducted using the technical statement. Candidates who pass the initial sift will be progressed to a full sift.

If you do progress to a full sift, you will be provided with one combined overall assessment score for both your employment history and Personal Statement.

For Hints and Tips on completing your application visit Applying for jobs at DWP Digital.

Important Information
  • You will be asked to complete your employment history. Any information that you would customarily share on a CV should therefore be entered onto the application form.
  • Personal details that could be used to identify you including your name, contact details and address must be removed for your application to be considered.
  • If your employment history, personal statement or technical statement contain any personal details your application will be withdrawn.
Stage 2: Interview 1

If youre successful at sift stage . click apply for full job details

Recruiting now

This website uses cookies to improve user experience. By using our website you consent to all cookies in accordance with our cookie policy OK