Connecting...

Contract// Data Engineer - SC Clearance required

Job Title: Contract// Data Engineer - SC Clearance required
Contract Type: Contract
Location: Fareham, Hampshire
Industry:
Salary: £400 - £450 per day
Start Date: ASAP
Reference: BBBH22451_1586968811
Contact Name: Taijaan deCordova
Contact Email: taijaan.decordova@talentinternational.com
Job Published: April 15, 2020 17:40

Job Description

Data Engineer

Contract

Fareham or Newport

Active SC Clearance is Required

Job description:

This will involve developing operational and organisational data to form the basis of a series of products as well as applying established data engineering and data modelling methods to the data for the main stage of the product build.

Skills and Experience

Essential

  • Extensive proven experience of data engineering and architectural techniques, including data wrangling, data profiling, data preparation, metadata development, and data upload/download.
  • Proven experience of 'big data' environments, including the Hadoop Stack (Cloudera), including data ingestion, processing and storage using HDFS, Spark, Hive and Impala.
  • Extensive hands-on experience of developing ETL functionality in a cloud or on-premise environment.
  • Experience of using tools such as python and SQL (Spark) to profile, query and structure large-volume data.
  • Proven experience of using Cloud Services particularly in the context of Hadoop.
  • Experience of developing/utilising programming and query languages e.g. SQL (Hive Impala specifically), Python (through Spark), Scala.
  • Understanding of data bases and applying data models in relational database formats.

If you would like to find out abit more please get in touch on 0117 332 0834