PySpark Technical Lead

The Hartford

4.5

(69)

Multiple Locations

Why you should apply for a job to The Hartford:

  • 4.5/5 in overall job satisfaction
  • 4.4/5 in supportive management
  • 75% say women are treated fairly and equally to men
  • 87% would recommend this company to other women
  • 90% say the CEO supports gender diversity
  • Ratings are based on anonymous reviews by Fairygodboss members.
  • The Professional Women’s Network (PWN) provides professional support, growth, advancement and networking to enable greater gender balance.
  • The Hartford offers diversity awareness training known as Appreciating Differences and Managing Inclusion.
  • Employees will be provided with leave of up to four weeks and paid at a rate of 100 percent of their base pay.
  • #R2519289

    Position summary

    or technical lead for a large-scale data products. Drive End-to-End solution delivery involving multiple platforms and technologies with medium to large, complexity or oversee certain parts of very large complex implementations, leveraging ELT solutions to acquire, integrate, and operationalize data.

    • Partner with architects and stakeholders to influence and implement the vision of the pipeline and data product architecture while safeguarding the integrity and scalability of of the environment.

    • Articulate risks and tradeoffs of technology solutions to senior leaders with translations as needed for business leaders.

    • Accountable for data pipeline and product physical solution designs across teams as well as tool recommendations

    • Accountable for Data Engineering Practices across all the teams involved.

    • Implement and utilize leading big data methodologies (AWS, Hadoop/EMR, Spark, Kafka, Snowflake and Talend) with cloud/on premise hybrid hosting solutions, on a multi-team/product level

    Knowledge, Skills, and Abilities:

    • Strong Technical Knowledge (Cloud data pipelines and data consumption products)

    • Leader and a team player with transformation mindset.

    • Ability to lead successfully in a lean, agile, and fast-paced organization, leveraging Scaled Agile principles and ways of working.

    • Guides team to mature Code quality management, DataOps principles, automated testing, and environment management practices to deliver incremental customer value.

    Qualifications:

    • 5+ years in large scale big data engineering experience and designing best practices in Programming, SDLC practices, Distributed systems, Data warehousing solutions SQL and NoSQL, ETL tools, CICD, Cloud Technologies (AWS/AZURE),Python/Spark, Datamesh and Datalake, Data Fabric

    • 3+ years of operating in a technical leadership capacity for 2+ teams.

    • 3+ years of developing and operating production workloads in cloud infrastructure (AWS, Azure, etc)

    • Exposure to AWS best practices

    • Knowledge of core functional components/services of AWS - compute, storage, Edge, Database, Migration and Transfer, Networking, and Governance

    • Candidate must be authorized to work in the US without company sponsorship. The company will not support the STEM OPT I-983 Training Plan endorsement for this position.

    Certifications/Licenses (as applicable)

    • Cloud certifications preferred.

    Compensation

    The listed annualized base pay range is primarily based on analysis of similar positions in the external market. Actual base pay could vary and may be above or below the listed range based on factors including but not limited to performance, proficiency and demonstration of competencies required for the role. The base pay is just one component of The Hartford's total compensation package for employees. Other rewards may include short-term or annual bonuses, long-term incentives, and on-the-spot recognition. The annualized base pay range for this role is:

    $123,280 - $184,920

    Equal Opportunity Employer/Females/Minorities/Veterans/Disability/Sexual Orientation/Gender Identity or Expression/Religion/Age

    About Us | Culture & Employee Insights | Diversity, Equity and Inclusion | Benefits

    Why you should apply for a job to The Hartford:

  • 4.5/5 in overall job satisfaction
  • 4.4/5 in supportive management
  • 75% say women are treated fairly and equally to men
  • 87% would recommend this company to other women
  • 90% say the CEO supports gender diversity
  • Ratings are based on anonymous reviews by Fairygodboss members.
  • The Professional Women’s Network (PWN) provides professional support, growth, advancement and networking to enable greater gender balance.
  • The Hartford offers diversity awareness training known as Appreciating Differences and Managing Inclusion.
  • Employees will be provided with leave of up to four weeks and paid at a rate of 100 percent of their base pay.