#738701BR
and a constant quest for knowledge serve as the foundation to success in IBM Consulting. In your role, you'll be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions resulting in ground breaking impact for a wide network of clients. Our culture of evolution and empathy centers on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.
Your Role and Responsibilities
As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.
Your primary responsibilities include:
PHJP2024
Required Technical and Professional Expertise
Proficient with AWS Data Platform components for Data Lakehouse - AWS S3, RedShift, RedShift Spectrum, AWS Glue with Spark, AWS Glue with Python, Lambda functions with Python, AWS Glue Catalog and AWS Glue Databrew, Dynamo DB, Aurora
Proficient with AWS Kinesis and Managed Streaming for Apache Kafka
Proficient with using other open source technologies like Apache Airflow and dbt, Spark / Python or Spark / Scala on AWS Platform
Experience in developing batch and real time data pipelines for Data Warehouse and Datalake
Experience in using DataBricks services on AWS platform
Experience in Scheduling and managing the data services on AWS Platform
Amenable to work on a client-based schedule (dayshift, mid-shift, night-shift) and in any IBM location in Quezon City (Eastwood and/or UP Ayala Technohub) or Cebu.
Preferred Technical and Professional Expertise