Data Platform Engineer

About the role

Block Labs is a technology studio focused on Web3, AI and iGaming. The Data Platform Engineer will design and operate a new real‑time data platform that underpins decision‑making, predictive modelling and AI agents across a multi‑tenant environment.

Key responsibilities

• Design, build and maintain scalable data pipelines on AWS Glue (PySpark) or equivalent orchestration tools.
• Engineer and optimise the ClickHouse analytical warehouse for sub‑second query performance.
• Implement data contracts that allow new operators to be onboarded via configuration changes only.
• Develop a feature‑serving layer delivering pre‑computed features to AI agents with millisecond latency.
• Integrate third‑party databases, back‑office APIs, CRM and affiliate systems.
• Establish monitoring, alerting, freshness checks and SLA enforcement for data pipelines.
• Own CI/CD pipelines and infrastructure‑as‑code for all data workloads.
• Collaborate with data scientists, AI engineers, BI developers and infrastructure teams to translate requirements into production‑grade pipelines.

Required profile

• 3+ years of experience building and operating production data pipelines at scale.
• Hands‑on expertise with both streaming and batch processing.
• Strong problem‑solving skills and ability to work in a fast‑moving, high‑impact environment.

Required skills

• AWS Glue / PySpark
• Apache Kafka or Amazon MSK
• ClickHouse (or other columnar analytical databases)
• SQL
• CI/CD and infrastructure‑as‑code (e.g., Terraform, CloudFormation)