Location: Remote

Job Type: Full-Time

Our client is on a mission to innovate and build a cutting-edge data platform to help their business clients grow via next generation marketing. They are looking for a talented and passionate data engineer to architect and implement systems that handle large-scale data and deliver insights in real-time.

Due to the start-up nature of a client, this vacancy creates a perfect opportunity for a data engineer to put their own stamp, not only on the technology stack, but all process and procedures that surround the data engineering department. You will be working closely with the senior management team, but also engaged with other internal and external stakeholders to build out this division from scratch. 

This role is an excellent opportunity for an experienced data engineer to step away from a large corporate to start a data department from scratch or for a data engineer who has previously worked for a start-up and is looking to take on a new challenge.

Job Description

As a Data Engineer, you will be responsible for designing, building, and maintaining the core data infrastructure that powers our applications and services. You will work closely with cross-functional teams to understand their data needs and provide robust solutions. Your expertise in Elasticsearch, real-time data platforms, and API development will be crucial in ensuring our systems are efficient, scalable, and reliable.

Key Responsibilities

• Design, develop, and maintain robust data pipelines and systems to support large-scale data processing.
• Implement and manage Elasticsearch clusters to ensure high availability and performance.
• Develop scalable APIs that leverage the full potential of Elasticsearch and other data stores.
• Work with real-time data platforms such as Tinybird to deliver timely insights and analytics.
• Create and optimize recommendation systems to enhance user experience and engagement.
• Integrate modern Large Language Models (LLMs) such as GPT and Gemini into our data workflows.
• Design and manage relational databases, particularly PostgreSQL, ensuring data integrity and performance.
• Collaborate with key stakeholders to understand requirements and deliver solutions.
• Ensure data security and compliance with relevant regulations and best practices.
• Continuously monitor, troubleshoot, and improve data systems to maintain optimal performance.

Qualifications

• Proven experience in backend development / data engineering.
• Expertise in Elasticsearch or similar search technologies.
• Proficiency in building and maintaining real-time data platforms like Tinybird.
• Strong experience in developing scalable APIs.
• Hands-on experience with recommendation systems and machine learning models.
• Familiarity with modern LLMs such as GPT, Gemini, etc.
• Deep understanding of relational databases, particularly PostgreSQL.
• Proficiency in programming languages such as Python, Typescript, Java, or Go.
• Experience with cloud platforms (AWS, GCP, Azure) and containerisation technologies (Docker, Kubernetes).
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills.

Preferred Skills

• Knowledge of data warehousing solutions like Redshift, BigQuery, or Snowflake.
• Experience with ETL tools and processes.
• Familiarity with CI/CD pipelines and DevOps practices.
• Understanding of data privacy laws and best practices for data governance.
• Experience with data visualization tools such as Tableau or Looker.
• Proficiency in TypeScript.

What We Offer

• Competitive salary and benefits package.
• Opportunity to work with cutting-edge technologies and innovate.
• Collaborative and dynamic work environment.
• Professional growth and development opportunities.

Our client is not in a position to offer VISA sponsorship therefore applicants must be eligible to work in the United Kingdom.