img
Permanent

Data Engineer

City of London
money-bag £140000/annum
223895692
Posted Yesterday

Data Engineer - Permanent

As a data Engineer, you will shape next-gen data architecture, build smart solutions with Web and Data Science teams, and harness Gen AI to move faster and smarter. You will be experienced in AI and enjoy writing code.



Responsibilities

  • Build and maintain scalable distributed systems using Scala and Java
  • Design complex Spark jobs, asynchronous APIs, and parallel processes
  • Use Gen AI tools to enhance development speed and quality
  • Collaborate in Agile teams to improve their data collection pipelines
  • Apply best practices like TDD, SOLID, and their engineering standards
  • Design relational and non-relational databases and data models
  • Support the Data Science team in deploying machine learning models to production
  • Leverage data structures, algorithms, and design patterns effectively
  • Foster empathy and collaboration within the team and with customers


Preferred Experience

  • Degree in Computer Science or equivalent practical experience
  • Commercial experience with Spark, Scala, and Java (Python is a plus)
  • Strong background in distributed systems (Hadoop, Spark, AWS)
  • Skilled in SQL/NoSQL (PostgreSQL, Cassandra) and messaging tech (Kafka, RabbitMQ)
  • Experience with orchestration tools (Chef, Puppet, Ansible) and ETL workflows (Airflow, Luigi)
  • Familiarity with cloud platforms (AWS, GCP) and monitoring tools (ELK stack)
  • Proven problem-solving mindset and ability to adapt solutions to complex challenges
  • Hands-on use of Gen AI tools for coding, debugging, or system design

Fully Remote
Brilliant benefits package

Please send me a copy of your CV if you meet all of the requirements

Other jobs of interest...

CV-Library
City of LondonToday
money-bag£55000 - £75000/annum
CV-Library
City of LondonToday
money-bag£55000 - £75000/annum
CV-Library
City of LondonToday
money-bag£55000 - £75000/annum
CV-Library
LondonToday
money-bag£55000 - £75000/annum
CV-Library
City of LondonToday
money-bag£85000 - £100000/annum
UK Health Security Agency
East LondonToday
money-bag£65,000
Henderson Scott
LondonToday
money-bag35.00-35.00 Annual
Parker Shaw
LondonToday
money-bag35.00-35.00 Annual
We Are Aspire
LondonToday
money-bag95000.00-95000.00 Annual
CV-Library
LondonYesterday
money-bag£500/annum remote role, outside IR35

Perform a fresh search...

  • Create your ideal job search criteria by
    completing our quick and simple form and
    receive daily job alerts tailored to you!

Jobs. Straight to your inbox!