Software Engineer III - Data Engineer, AWS, ETL, Python

rchitecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development

• Design, develop, and maintain scalable data pipelines to extract, transform, and load (ETL) data from various sources into data warehouses or data lakes.

• Build and manage relational and non-relational databases, ensuring data integrity, security, and performance.

• Integrate data from multiple internal and external sources, ensuring consistency and quality across platforms.

• Automate data processing tasks and workflows to improve efficiency and reduce manual intervention.

• Monitor data pipelines and systems for performance issues, troubleshoot problems, and implement solutions.

• Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture

• Contributes to software engineering communities of practice and events that explore new and emerging technologies

• Document data engineering processes, architectures, and data flows for transparency and maintainability

Required qualifications, capabilities, and skills

• Formal training or certification on software engineering concepts and 2+ years applied experience

• Hands-on practical experience in system design, application development, testing, and operational stability

• Proficient in coding in one or more languages

• Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages

• Overall knowledge of the Software Development Life Cycle

• Proficiency in programming languages such as Python, Java, or Scala

• Experience in Databricks

• Experience with ETL tools and frameworks

• Strong knowledge of SQL and database technologies (e.g., MySQL, PostgreSQL).

• Experience with cloud platforms (e.g., AWS,) and their data services.

• Understanding of data warehousing concepts and architectures

Preferred qualifications, capabilities, and skills

• Demonstrated knowledge of software applications and technical processes within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile, etc.)
• Master's degree or relevant certifications (e.g., AWS Certified Data Analytics).
• Experience with data governance, data quality, and data security practices.
• Knowledge of DevOps practices and CI/CD pipelines.
• Experience with real-time data processing and streaming analytics