Talent.com
Sr data Engineer

Sr data Engineer

Test TriangleDublin 1, D, ie
3 days ago
Job description

Role : Sr. Data Engineer (2 positions)

Exp : 7 to 15 Overall

Hybrid – 3 days to Dublin office

2 rounds of Interview with client (1 would be b Teams & final will be face to face)

Senior Data Engineer

Overview

Are you passionate about building scalable data solutions and ensuring data integrity in high-impact financial technology? Do you thrive in solving complex data challenges while maintaining rigorous quality standards?

Join the team behind Crypto Secure , a cutting-edge risk assessment platform helping banks gain visibility into crypto spend, transaction volumes, and AML risk exposure. Working with modern technologies like Snowflake, Hadoop, Spark, NiFi , and cloud-native architectures, you’ll play a dual role : designing robust data pipelines and implementing comprehensive testing strategies to guarantee reliability and trust.

Role Responsibilities

Data Engineering & Platform Development

  • Design, build, and maintain scalable data pipelines using Snowflake, Hadoop, Spark, NiFi , and related big data technologies.
  • Implement data architectures and optimize workflows for massive financial datasets.
  • Write high-quality, maintainable code in Python and SQL following best practices.
  • Integrate data governance principles, metadata management, and lineage tracking into solutions.

Data Quality Assurance & Testing

  • Develop automated testing frameworks and validation scripts for ETL processes and data transformations.
  • Implement data quality checks, reconciliation processes, and regression testing suites to ensure accuracy, completeness, and timeliness.
  • Perform unit, integration, and end-to-end testing for data pipelines and schema changes.
  • Use tools like dbt tests, custom Python utilities for automated validation.
  • Collaboration & Agile Delivery

  • Work closely with Data Engineers, Product, and Data Science teams to embed testing into the development lifecycle.
  • Participate in agile ceremonies (sprint planning, backlog refinement, retrospectives) with a focus on quality and delivery.
  • Support production incident response with rapid data validation and root cause analysis.
  • Continuous Improvement

  • Stay current with emerging data engineering and testing technologies.
  • Contribute to team knowledge sharing, mentoring junior engineers, and improving technical standards.
  • Shape best practices for data reliability, testing automation, and CI / CD integration.
  • Skills & Qualifications

    Core Technical Expertise

  • Advanced SQL and experience with relational and NoSQL databases.
  • Strong experience with Snowflake, Hadoop, Spark, Databricks, Kafka , and cloud data platforms.
  • Proficiency in Python for both data engineering and test automation.
  • Familiarity with orchestration tools and workflow management systems.
  • Testing & Quality

  • Proven experience in data testing methodologies , ETL validation, and automated testing frameworks.
  • Knowledge of data profiling, anomaly detection, and statistical validation techniques .
  • Experience integrating testing into CI / CD pipelines.
  • Professional Attributes

  • Strong problem-solving and analytical skills with attention to detail.
  • Excellent communication skills for cross-functional collaboration.
  • Ability to work independently and manage multiple priorities in fast-paced environments.
  • Why You’ll Love This Role

  • Work on cutting-edge fintech solutions at the intersection of cryptocurrency, risk management, and compliance.
  • Combine engineering and quality expertise to deliver trusted, high-performance data platforms.
  • Collaborate with talented engineers and data scientists in a culture that values technical excellence and continuous learning .
  • Opportunities for career growth in both data engineering and data quality leadership .
  • Create a job alert for this search

    Data Engineer • Dublin 1, D, ie