Senior Data Engineer (Data Quality)

• Establish and lead Data Quality Center of Excellence to govern and mature technology and process

• Collaborate with key stakeholders to generate Enterprise Data Quality product roadmap

• Assess and identify Data Quality gaps and challenges to improve in Azure Cloud, prioritize the efforts, and lead engineering team to implement

• Collaborate with stakeholders and engineers to assess COTS solution on data quality tools, evaluate options and define future state

• Define architecture and design that matures data quality solution for batch and data streaming services

• Evolve inline Data Quality framework for batch data processing in Azure cloud

• Enable Data Quality monitoring and alerts for Data Streaming services

• Apply Data Quality dimension principles to improve and measure quality of data

• Deliver key Data Quality metrics to measure the success of the efforts for business stakeholders

• Evolve and enforce data engineering standards for Data Quality

• Develop automated tests using Python or enhance existing custom PySpark-based test frameworks

• Integrate test suites into CI/CD pipelines to ensure continuous validation of data pipelines

• Collaborate with data teams to ensure robust test coverage and support test-driven development practices

• Generate Monthly Status Report for Data Quality efforts and review with leadership

• Provide technical direction and leadership routinely to other engineers; serve as a coach and mentor

• Perform other duties as assigned

Qualifications

• Bachelor's degree in information systems, Computer Science, Engineering, or related field, or the equivalent combination of education, training, and experience

• Expertise in delivering and improving data quality in a Big Data environment in cloud for Enterprise Data Lake (Azure or similar), Data Warehouse (Azure Synapse or similar), and Data Hubs (Azure Cosmos DB or similar)

• Expertise in data processing (Databricks ETL, Azure Event Hub, Azure Functions, or similar), data quality solution (Acceldata, Ataccama, Anomalo, or similar), data governance solution (Unity Catalog, Alation, Azure Purview or similar)

• Expertise in enabling error handling, data validation, data reconciliation, data quality monitoring and alert

• Experience with processing various file types in Data Lake. (Delta, JSON, Parquet or similar)

• Strong understanding of data quality principles and best practices

• Proficiency in programing languages such as SQL, Python & Spark

• Experience with DevOps toolset (Azure DevOps or similar) to collaborate and deploy code

• Experience in Test case design, execution, and defect tracking

• Familiarity with QA methodologies (e.g., Agile, Scrum)

• Excellent verbal and written communication skills, with the ability to effectively communicate complex concepts to stakeholders at all levels

Hours: Monday - Friday, 8:00AM - 4:30PM

Location: 820 Follin Lane, Vienna, VA 22180

About Us
Navy Federal provides much more than a job. We provide a meaningful career experience, including a culture that is energized, engaged and committed; and fierce appreciation for our teams, who are rewarded with highly competitive pay and generous benefits and perks.

Our approach to careers is simple yet powerful: Make our mission your passion.

• Best Companies for Latinos to Work for 2024

• Computerworld® Best Places to Work in IT

• Forbes® 2024 America's Best Large Employers

• Forbes® 2024 America's Best Employers for New Grads

• Forbes® 2024 America's Best Employers for Tech Workers

• Fortune Best Workplaces for Millennials™ 2024

• Fortune Best Workplaces for Women ™ 2024

• Fortune 100 Best Companies to Work For® 2024

• Military Times 2024 Best for Vets Employers

• Newsweek Most Loved Workplaces

• 2024 PEOPLE® Companies That Care

• Ripplematch Recruiting Choice Award

• Yello and WayUp Top 100 Internship Programs

From Fortune . ©2024 Fortune Media IP Limited. All rights reserved. Used under license. Fortune and Fortune Media IP Limited are not affiliated with, and do not endorse products or services of, Navy Federal Credit Union.

Equal Employment Opportunity: All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected Veteran.

Hybrid Workplace: Navy Federal Credit Union is a hybrid workplace, and details will be discussed during your interview process.

Disclaimers: Navy Federal reserves the right to fill this role at a higher/lower grade level based on business need. An assessment may be required to compete for this position. Job postings are subject to close early or extend out longer than the anticipated closing date at the hiring team's discretion based on qualified applicant volume. Navy Federal Credit Union assesses market data to establish salary ranges that enable us to remain competitive. You are paid within the salary range, based on your experience, location and market position

Bank Secrecy Act: Remains cognizant of and adheres to Navy Federal policies and procedures, and regulations pertaining to the Bank Secrecy Act.