To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.
Products and Technology
Slack is looking for a senior data engineer to join the Data Orchestration Team. As part of the Data Engineering organization, we build and operate the platform that ingests data into our Data Warehouse. We write software to manage the ingestion for thousands of stateful hosts and stateless real time logging events. Currently, our infrastructure handles 65PB+ of storage, processes ~900B records a day, 400+ ETL pipelines and 900+ Active Airflow DAGs. As Slack’s data grows (along with the number of customers, features and employees), the goal of the team is to build a highly scalable and resilient orchestration capabilities for our downstream customers so that they can focus on their strengths.
You will build scalable services and tools to help partners implement, deploy and analyze data assets with a high level of autonomy and limited friction. You will play a meaningful role in making partner interactions with the Data Warehouse pleasant and productive. You will have deep technical skills, be a self-starter, detail and quality oriented, and passionate about driving data driven decisions and having a huge impact at Slack!
Here are a few blog posts that shed light into what we do here at Slack:
Data Lineage at Slack - https://slack.engineering/data-lineage-at-slack/
Reliably Upgrading Apache Airflow at Slack's Scale - https://slack.engineering/reliably-upgrading-apache-airflow-at-slacks-scale/
Introducing Data Residency for Slack - https://slack.com/blog/transformation/introducing-data-residency-for-slack
Data Wangling At Slack - https://slack.engineering/data-wrangling-at-slack/
5+ years of software/data engineering experience, including experience with Big Data technologies, e.g. OLAP, Airflow, Spark, Kafka, Hadoop, etc.
Experience operating Airflow clusters and knowledge of Airflow best practices.
Experience working with cloud infrastructure (AWS preferred).
You have extensive experience of building and maintaining large scale ETL pipelines and in-depth knowledge of various big data frameworks and architectures
You are skilled at crafting and building robust distributed Microservices with tools like Docker, Kubernetes, AWS ECS/EKS etc.
Experience in real time analytics/low latency data access layer with OLAP stores such as Apache Pinot or Apache Druid is a huge plus.
You have strong dedication to code quality, automation and operational excellence: CI/CD pipelines, unit/integration tests.
You are proficient in object-oriented and/or functional programming languages: Python, Java/Scala, Chef, Terraform
You have excellent written and verbal communication and interpersonal skills; able to effectively collaborate with cross functional partners and explaining sophisticated technical concepts to non-technical stakeholders
You have high growth expectations for yourself and your team, and a willingness to push yourself and your team to achieve them
Bachelor's degree in Computer Science, Engineering or related field, or equivalent training, fellowship, or work experience.
Slack has a positive, diverse, and supportive culture—we look for people who are curious, inventive, and work to be a little better every single day. In our work together we seek to be smart, humble, hardworking and, above all, collaborative.
More details about our company benefits can be found at the following link: https://www.getsalesforcebenefits.com/
If you require assistance due to a disability applying for open positions please submit a request via this Accommodations Request Form.
At Salesforce we believe that the business of business is to improve the state of our world. Each of us has a responsibility to drive Equality in our communities and workplaces. We are committed to creating a workforce that reflects society through inclusive programs and initiatives such as equal pay, employee resource groups, inclusive benefits, and more. Learn more about Equality at Salesforce and explore our benefits.
Salesforce, Inc. and Salesforce.org are Equal Employment Opportunity and Affirmative Action Employers. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status. Salesforce, Inc. and Salesforce.org do not accept unsolicited headhunter and agency resumes. Salesforce, Inc. and Salesforce.org will not pay any third-party agency or company that does not have a signed agreement with Salesforce, Inc. or Salesforce.org.
Salesforce welcomes all.
For Colorado-based roles, the base salary hiring range for this position is $156,800 to $215,600.Compensation offered will be determined by factors such as location, level, job-related knowledge, skills, and experience.Certain roles may be eligible for incentive compensation, equity, and benefits. More details about our company benefits can be found at the following link: https://www.salesforcebenefits.com.
Child care benefits
Short term disability
Salesforce, the Customer Success Platform and world's #1 CRM, empowers companies to connect with their customers in a whole new way. The company was founded on three disruptive ideas: a new technology model in cloud computing, a pay-as-you-go business model, and a new integrated corporate philanthropy model. These founding principles have taken our company to great heights, ...