This job is no longer available
This job expired on 31/08/2026. It no longer accepts applications.
Databricks Data Engineer
DNS Info Ltd · Dublin
Job description
About the role
We are looking for a Data Engineer specialized in Databricks to design and operate scalable data pipelines that deliver high-quality cyber security data for analytics. The role focuses on building ingestion, transformation, and lakehouse solutions that support security monitoring and threat detection.
Key responsibilities
- Build ingestion pipelines for logs, network data, and security tool outputs.
- Develop ETL/ELT processes using Databricks and Apache Spark.
- Implement Delta Lake architecture with Bronze, Silver, and Gold layers.
- Optimize performance and cost through partitioning, caching, and resource tuning.
- Ensure data quality, lineage, and reliability across the data platform.
Required profile
Required skills
- Strong proficiency in PySpark and Spark SQL.
- Experience with the Databricks ecosystem, including Delta Lake, Jobs, and Workflows.
- Knowledge of streaming technologies such as Kafka or Azure Event Hub.
- Cloud expertise, preferably AWS (S3, IAM, Glue).
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Ireland.
Salaries by job title
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
DNS Info Ltd
Dublin
Related job offers
-
Senior Software Engineer – Virtual Card Services
mastercard Dublin -
Software Engineer II – API & Integration Engineering
mastercard Dublin -
Principal Data Scientist – Advanced AI & ML for Insurance
relx Dublin -
Senior Data Engineer – Azure Data Platform (Remote)
Archer Recruitment -
Professional Services Engineer – French Speaker
NetApp Cork