Staff Data Engineer
What you'll do at
This position is responsible for the operation of a department. An individual in this position will be expected to perform additional job related responsibilities and duties as assigned and/or necessary.
Problem Formulation - Analytics, big data analytics, and/or automation techniques and methods. Business requirements and insights that the business is seeking. Precedence and use cases.
Applied Business Acumen - Related industry and environmental factors (for example, market fluctuations, changes in regulatory policies or politics, emerging technology, cultural practices). Multiple approaches to business models, practices, processes, and guidelines. Less common and more specialized business vernacular. Business practices across two or more domains such as finance, marketing, sales, technology, business systems, and human resources and in-depth knowledge of related practices. Directly relevant business metrics and business areas.
Data Source Identification - Functional business domain and scenarios. Categories of data and where it is held. Business data requirements. Database technologies and distributed datastores (e.g. SQL, NoSQL). Data Quality. Existing business systems and processes, including the key drivers and measures of success.
Data Transformation and Integration - Internal and external data sources including how they are collected, where and how they are stored, and interrelationships, both within and external to the organization. Techniques like ETL batch processing, streaming ingestion, scrapers, API and crawlers. Data warehousing service for structured and semi-structured data, or to MPP databases such as Snowflake, Microsoft Azure, Presto or Google BigQuery. Pre-processing techniques such as transformation, integration, normalization, feature extraction, to identify and apply appropriate methods. Techniques such as decision trees, advanced regression techniques such as LASSO methods, random forests etc. Cloud and big data environments like EDO2 systems.
Data Modeling - Cloud data strategy, data warehouse, data lake, and enterprise big data platforms. Data modeling techniques and tools (e.g., Dimensional design and scalability), Entity Relationship diagrams, Erwin, etc. Database programming languages SQL / NoSQL. Flow of data through the different systems. Tools supporting automated data loads. AI- enabled metadata management tools and techniques.
Code Development and Testing - Coding languages like SQL, Java, C++, R, Python and others. Testing methods such as static, dynamic, software composition analysis, manual penetration testing and others. Business, domain understanding.
Data Governance - Data modeling, storage, integration, and warehousing. Data value chains (identification, ingestion, processing, storage, analysis, and utilization). Data quality framework and metrics. Regulatory and ethical requirements around data privacy, security, storage, retention, and documentation. Business implications on data usage.
Data Strategy - Appropriate application and understanding of data ecosystem, including Data Management, Data Quality Standards and Data Governance, Accessibility, Storage and Scalability etc. Deep understanding of the business value of data and data enabled insights and decisions.
Judgment: Make Informed Judgments - Uses relevant business metrics, analyses, and reports to measure, monitor, and improve performance. Identifies and applies sound, fact-based criteria in setting priorities and making decisions. Looks beyond symptoms to determine the root causes of problems, and identify and implement applicable solutions. Integrates knowledge and expertise in making fact-based recommendations and decisions.
Customer/Member Centered: Ensure Customer/Member Centered Performance - Analyzes data and information, and develops plans to exceed customer/member expectations. Sponsors initiatives and practices that provide customers/members with desired products, services, and experiences and that grow the business. Ensures customers/members receive the level of service that builds their trust and confidence. Removes barriers to delivering customer/member value, service, and support.
Execution and Results: Ensure Execution and Achieve Results - Conveys a sense of urgency in ways that motivate others to complete responsibilities and achieve goals. Pursues the achievement and alignment of measurable and meaningful goals. Leverages resources and talent to achieve business goals. Ensures others are held accountable for achieving expected results. Prioritizes and balances time, actions, and projects to ensure accomplishment of results. Monitors progress of others and redirects efforts when goals change or results are not met.
Planning and Improvement: Ensure Planning and Improvement - Sets clear expectations, performance measures, and goals, and helps others do the same. Plans for and ensures others have the information, resources, implementation time, and talent needed to accomplish business initiatives. Identifies and plans for improvement in performance using key business metrics.
Influence and Communicate: Build and Influence Team - Develops and communicates logical, convincing reasons, including lessons learned, to build support for one's viewpoints and actions. Involves others in decisions and plans that affect them, when appropriate. Recognizes and rewards team accomplishments, celebrating team and organizational success. Ensures business priorities, change initiatives, and organizational information are communicated in clear and compelling ways. Promotes the exchange of diverse experiences and ideas within own organization.
Ethics and Compliance: Ensure Ethics and Compliance - Actively communicates, trains, and guides associates on compliance with policies and procedures. Maintains an environment that promotes and reinforces the highest standards of integrity and ethics. Anticipates potential issues and takes action to enhance compliance.
Masters degree in Computer Science or related field and 4 years' experience in software engineering or related field. 6 years' experience in data engineering, database engineering, business intelligence, or business analytics.
2 years' experience in ETL tools and working with large data sets in the cloud.
About Walmart Labs
Imagine working in an environment where one experiment can catapult an entire industry toward a smarter future. Thats what we do at Walmart Labs. Were a team of 5,000+ software engineers, data scientists, designers and product managers within Walmart, the worlds largest retailer, delivering innovations that improve how our customers shop and our enterprise operates.