Start: September 2021
End: 31st March 2022
You must hold active SC clearance or SC clearance which may have lapsed within the last 12 months.
Remote for foreseeable. Although we are currently working from home there is an expectation to return to the office in some capacity in the coming months/year.
The post will provide pivotal programming support to a team developing and delivering the programming and design of routines to import, validate and structure key administrative data that will flow into ONS in the wake of the Digital Economy Act (DEA).
A lead data engineer is responsible for the design and implementation of numerous complex data flows to connect operational systems, data for analytics and business intelligence (BI) systems.
- Recognise and share opportunities to re-use existing data flows between their team
- Be responsible for the build of data-streaming systems
- Coordinate teams and set best practice and standards
- Apply knowledge of systems integration to their work
- Champion data engineering across government
Person Specification Skills and Experience
Communication skills (data)
You can communicate effectively across organisational, technical and political boundaries, understanding the context. You know how to make complex and technical information and language simple and accessible for non-technical audiences. You can advocate on behalf of a team and communicate what it does, to create trust and authenticity. You know how to respond to challenge.
Data analysis and synthesis.
You can translate data into valuable insights that inform decisions. You know how to involve teams in analytics and synthesis to increase consensus and challenge assumptions. You can identify and use the most appropriate analytical techniques. You understand analytical tools; you are numerate. You are aware of and keep up to date with advances in digital analytics tools and data manipulation products. You can collect, collate, cleanse, synthesise and interpret data to derive meaningful and actionable insights.
Data development process
You can integrate and separate data feeds in order to map, produce, transform and test new data products.You know how to establish enterprise-scale data integration procedures across the data development life cycle and ensure that teams adhere to these. You can manage resources to ensure that data services work effectively at an enterprise level.
You recognise and can exploit business opportunities to ensure efficient and effective performance of organisations. You can explore new ways of conducting business and organisational processes.You can identify areas of innovation in data tools and techniques, and recognise appropriate timing for adoption.
Data integration design.
You can develop fit-for-purpose, resilient, scalable and future-proof data services to meet user needs. You have a demonstrable understanding of how to expose data from systems (for example, through APIs), link data from multiple systems and deliver streaming services.
You will produce data models and understand where to use different types of data models. You understand different tools and can compare different data models. You can reverse-engineer a data model from a live system. You understand industry-recognised data modelling patterns and standards.You understand the concepts and principles of data modelling and can produce relevant data models. You know how to work across government and industry, recognising opportunities for re-use and alignment between the data models in different organisations. You can design the method to categorise data model within the organisation.
You understand a variety of metadata management tools. You can design and maintain the appropriate metadata repositories to enable the organisation to understand their data assets.You can design an appropriate metadata repository and present changes to existing metadata repositories. You understand a range of tools for storing and working with metadata. You can provide oversight and advice to more inexperienced members of the team.
Problem resolution (data).
You know how to log, analyse and manage problems in order to identify and implement the appropriate solution. You can ensure that the problem is fixed.
Programming and build (data engineering).
You can design, write and iterate code from prototype to production-ready. You understand security, accessibility and version control. You can use a range of coding tools and languages. You know how to use agreed standards and tools to design, code, test, correct and document moderate-to-complex programs and scripts from agreed specifications and subsequent iterations. You can collaborate with others to review specifications where appropriate.
Technical understanding (data engineering).
You know about the specific technologies that underpin your ability to deliver the responsibilities and tasks of the role. You can apply the required breadth and depth of technical knowledge.
You can plan, design, manage, execute and report tests, using appropriate tools and techniques, and work within regulations. You know how to ensure that risks associated with deployment are adequately understood and documented.