Hadoop Big Data Engineer
-
Location
Cambridge
-
Sector:
-
Job type:
-
Salary:
£700 - £750 per day
-
Contact:
Reece Marquis-Harris
-
Contact email:
r.marquis-harris@ioassociates.co.uk
-
Job ref:
BBBH73725_1654608425
-
Duration:
12 Months
-
Startdate:
ASAP
- Big Data Engineer
- Defence Client
- Active DV Clearance required
- 12 Month Contract
- Outside IR35
- £700 - £750
- On site in Cambridge (5 days a week).
Our prestigious client in the Defence Sector is seeking a very talented Front Office Big Data Engineer/Architect contractor to join their high profile on-site team.
This is an amazing opportunity to work with some of the most talented IT professionals in the country, on projects that are completely classified.
Please note, you MUST have DV clearance for this position.
Data Engineer
Requirements:
- Deep hands-on expertise with Hadoop
- Design and implementation of Big Data technologies (Databricks Spark, Hadoop ecosystem, Apache Kafka, NoSQL databases) and familiarity with data architecture patterns (data warehouse, data lake, streaming, Lambda/Kappa architecture)
- Experience working as either Data Engineer / Big Data Engineer (query tuning, performance tuning, troubleshooting, and debugging Spark and other big data solutions) , Data Scientist/ML Engineer (model selection, model lifecycle, hyperparameter tuning, model serving, deep learning, etc.)
- Experience with cloud providers such as AWS, Azure or GCP
- Familiarity with a full range of data engineering and data science approaches, covering theoretical best practices and the technical applications of these methods
- Experience building and deploying a range of data engineering pipelines into production, including using automation best practices for CI / CD
- Familiarity with databases and analytics technologies in the industry including Data Warehousing / ETL, Relational Databases, or MPP
- Experience with performance tuning, troubleshooting, and debugging Databricks Spark and other big data solutions
Please apply for immediate consideration
