1,794 jobs for "Data Engineer - Data Platform"

A specialized role for a Snowflake Platform Administration & Performance Engineer role focuses on the seamless synergy between automated administration and high-tier workload optimization. This position is about transforming the data warehouse into an autonomous, high-performance engine that fuels real-time decision-making.

Description

Performance Tuning & Optimization: Proactively monitor and tune workloads using Snowsight Performance Explorer and account usage schemas.

You will optimize query execution by analyzing query profiles for disk spillage, identifying Cartesian joins, and implementing Search Optimization Services or Query Acceleration where necessary. Lakehouse Implementation: Design and manage unified storage using Apache Iceberg to allow open-format data to be queried directly in Snowflake with warehouse-level performance. Python-Driven Automation: Develop advanced scripts and pipelines using Snowpark Python and Snowpark pandas APIs for scalable data transformations. Automate administrative tasks such as environment provisioning and security policy enforcement through Infrastructure as Code (IaC) tools like Terraform.

Cloud: Manage Snowflake Iceberg Tables in AWS cloud.Experience in cloud s3, gateway, private link, EKS, Load Balancing, VPC peering, and secure data sharing

Advanced Cost Management: Implement autonomous warehouse management, right-sizing clusters based on real-time usage patterns, and configuring auto-suspend/resume with 60-second timeouts to eliminate idle compute waste

Snowflake Platform Administration: Manage accounts, virtual warehouses, and database objects. This includes configuring auto-scaling, monitoring warehouse utilization, and implementing backup strategies via Time Travel and Cloning

Security & Governance: Implement Role-Based Access Control (RBAC), Multi-Factor Authentication (MFA), and data masking policies. You are responsible for ensuring compliance with data protection standards like GDPR or HIPAA","responsibilities":"Snowflake Platform Administration: Manage accounts, virtual warehouses, and database objects. This includes configuring auto-scaling, monitoring warehouse utilization, and implementing backup strategies via Time Travel and Cloning.

Advanced Cost Management: Implement autonomous warehouse management, right-sizing clusters based on real-time usage patterns, and configuring auto-suspend/resume with 60-second timeouts to eliminate idle compute waste.

Lakehouse Implementation: Design and manage unified storage using Apache Iceberg to allow open-format data to be queried directly in Snowflake with warehouse-level performance.

Python-Driven Automation: Develop advanced scripts and pipelines using Snowpark Python and

Snowpark pandas APIs for scalable data transformations. Automate administrative tasks such as environment provisioning and security policy enforcement through Infrastructure as Code (IaC) tools like Terraform.

Preferred Qualifications

2+ years in database administration or Performance Tuning with specific hands-on Snowflake experience

Master's Degree, Computer Science or equivalent degree

Architecture Knowledge: Deep understanding of Snowflake's multi-cluster shared data architecture and micro-partitioning.

Certifications: SnowPro Core Certification is highly preferred, along with cloud-specific associate or professional certifications

Performance Tuning & Optimization: Proactively monitor and tune workloads using Snowsight Performance Explorer and ACCOUNT USAGE schemas.

You will optimize query execution by analyzing query profiles for disk spillage, identifying Cartesian joins, and implementing Search Optimization Services or Query Acceleration where necessary.

Cost Optimization: Analyze credit consumption and query performance to reduce spend while maintaining SLAs

Python-Driven Automation: Develop advanced scripts and pipelines using Snowpark Python and

Snowpark pandas APIs for scalable data transformations. Automate administrative tasks such as environment provisioning and security policy enforcement through Infrastructure as Code (IaC) tools like Terraform.

Minimum Qualifications

Snowflake experience

Data Engineer or Database Administration or Performance Tuning experience

Architecture Knowledge: Deep understanding of multi-cluster shared data architecture and micro-partitioning

Bachelor's Degree, Computer Science or equivalent degree or experience

About Apple

Working at Apple means doing more than you ever thought possible and having more impact than you ever imagined.

Size: 10,000+ employees
Industry: Technology: Manufacturing

View company profile