Talent.com
This job offer is not available in your country.
Data Engineer - Graph

Data Engineer - Graph

Mastercard, Inc.Dublin, Ireland
18 days ago
Job description

Responsibilities

  • Develop, and maintain scalable and reliable data pipelines for batch and streaming data.
  • Collaborate with cross-functional teams to translate data requirements into technical solutions.
  • Ensure data integrity and quality through testing, validation, and continuous monitoring.
  • Implement and enforce dataernance, privacy, and security best practices.
  • Evaluate and integrate modern tools and technologies to enhance the data ecosystem.
  • Participate in code reviews and contribute to engineering best practices and process improvements.
  • Manage production incidents, perform root cause analysis, and implement mitigation plans.

Essential Skills & Experience

  • 3+ years of hands-on experience in data engineering with expertise in big data technologies such as Hadoop, Apache Spark, Spark SQL, Kafka, NiFi, and ETL frameworks.
  • Strong experience with databases such as Oracle and Netezza; excellent SQL skills.
  • Experience developing scalable streaming solutions using the Hadoop ecosystem (HDFS, Ozone, Hive / Impala).
  • Proficient in building data pipelines using Git, Shell scripting, Java or Python on Hadoop or object storage systems (S3 / CEPH).
  • Demonstrated experience in delivering end-to-end data warehouse projects in big data environments.
  • Strong analytical and debugging skills with demonstrated ability to resolve production issues independently.
  • Excellentmunication skills, with a collaborative approach to working across teams.

    • Preferred Qualifications

  • Experience with AI / ML workloads using Python on Hadoop platforms is a plus.
  • Familiarity with tools like NiFi, APIs, Unix / Linux environments.
  • Exposure to Agile methodologies and experience working in Agile teams.
  • Experience with microservices architecture, messaging systems (, Kafka, RabbitMQ).
  • Hands-on knowledge of containerization and orchestration tools like Docker and Kubernetes.
  • Deep understanding of data security,pliance, andernance frameworks.
  • Ability to work on multiple projects simultaneously, providing guidance and technical oversight.
  • Proactive, self-motivated, and able to operate effectively under pressure in a fast-paced environment.
  • A strong sense of ownership with a proven track record of delivering high-impact solutions.

    • Corporate Security Responsibility

    All activities involving access to Mastercard assets, information, and networkses with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must :

  • Abide by Mastercard's security policies and practices.
  • Ensure the confidentiality and integrity of the information being accessed.
  • Report any suspected information security violation or breach, and
  • plete all periodic mandatory security trainings in accordance with Mastercard's guidelines.

    • Corporate Security Responsibility

    All activities involving access to Mastercard assets, information, and networkses with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must :

  • Abide by Mastercard's security policies and practices;
  • Ensure the confidentiality and integrity of the information being accessed;
  • Report any suspected information security violation or breach, and

    • Job ID R-247499

    Create a job alert for this search

    Data Engineer • Dublin, Ireland