#22331_R-251597
uality across large-scale distributed systems.
Key Responsibilities:
Lead the design and implementation of data quality frameworks and automated validation pipelines using Python, Apache Spark, and Hadoop ecosystem tools.
Develop, deploy, and maintain scalable ETL/ELT workflows using Apache Airflow and Apache NiFi to ensure seamless data ingestion, transformation, and quality checks.
Collaborate with cross-functional teams to understand data quality requirements and translate them into technical solutions.
Define and enforce data quality standards, rules, and monitoring processes.
Perform root cause analysis on data quality issues and implement effective fixes and enhancements.
Mentor and guide junior engineers, conducting code reviews and fostering best practices.
Continuously evaluate and integrate new tools and technologies to enhance data quality capabilities.
Ensure high code quality, performance, and reliability in all data processing pipelines.
Create comprehensive documentation and reports on data quality metrics and system architecture.
Required Skills & Experience:
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must: