Data Engineer

Job Title: Data Engineer
Contract Type: Contract
Location: England
Salary: £650 - £750 per day + inside IR35
Start Date: ASAP
Reference: BBBH30657_1656514923
Contact Name: James Norval
Contact Email:
Job Published: June 29, 2022 16:02

Job Description

Data Engineer - Central Government Contract

  • SC Clearance - ideally held currently
  • Remote or Hybrid
  • Inside IR35 - day rates can be negotiated, ideally £650/£750 range
  • 3 months initially
  • Deadline: 12 Noon 04/07
  • Big Data tech stack - Spark/Hadoop/Python/R, also BI stack

Key Responsibilities:

  • A lead data engineer is responsible for the design and implementation of numerous complex data flows to connect operational systems, data for analytics and business intelligence (BI) systems
  • Recognise and share opportunities to re-use existing data flows between their teams
  • Be responsible for the build of datastreaming systems
  • Coordinate teams and set best practice and standards
  • Apply knowledge of systems integration to their work
  • Champion data engineering across government

Skills and Experience outline:

  • You can communicate effectively across organisational, technical and political boundaries, understanding the context.
  • You know how to make complex and technical information and language simple and accessible for nontechnical audiences. You can advocate on behalf of a team and communicate what it does, to create trust and authenticity. You know how to respond to challenge.
  • You can listen to the needs of technical and business stakeholders and interpret them. You know how to manage stakeholder expectations. You are flexible and capable of proactive and reactive communication. You know how to facilitate difficult discussions within the team or with diverse senior stakeholders.
  • You understand and can help teams apply a range of techniques for data profiling. You can source system analysis from a complex single source. You can bring multiple data sources together in a conformed model for analysis.
  • You can integrate and separate data feeds to map, produce, transform and test new data products
  • You know how to establish enterprise scale data integration procedures across the data development life cycle and ensure that teams adhere to these. You can manage resources to ensure that data services work effectively at an enterprise level.
  • You recognise and can exploit business opportunities to ensure efficient and effective performance of organisations. You can explore new ways of conducting business and organisational processes.
  • You can identify areas of innovation in data tools and techniques, and recognise appropriate timing for adoption.
  • You can develop fitfor-purpose, resilient, scalable and futureproof data services to meet user needs.
  • You have a demonstrable understanding of how to expose data from systems (for example, through APIs), link data from multiple systems and deliver streaming services.
  • You know how to establish standards and you know how to keep those standards up to date and ensure adherence to them. You keep abreast of best practice in industry and across government.
  • Programming and build (data engineering)
  • You can design, write and iterate code from prototype to production-ready. You understand security, accessibility and version control. You can use a range of coding tools and languages.
  • You know how to use agreed standards and tools to design, code, test, correct and document moderate to-complex programs and scripts from agreed specifications and subsequent iterations. You can collaborate with others to review specifications where appropriate.
  • You know about the specific technologies that underpin your ability to deliver the responsibilities and tasks of the role. You can apply the required breadth and depth of technical knowledge.
  • You have the detailed knowledge and understanding of the technical concepts required for the role. You know how these fit into the wider technical landscape.
  • You can plan, design, manage, execute and report tests, using appropriate tools and techniques, and work within regulations. You know how to ensure that risks associated with deployment are adequately understood and documented.