Data Engineer - Director - Data & Analytics Engineering

ement) and functions (e.g., Operations, Finance, Risk, Trading, Treasury, Resilience) across the Firm. The team vision is a multi-year effort to simplify firm's data architecture and business processes front-to-back with goals of reducing infrastructure and manpower costs, improving the ability to demonstrate control of data, empowering developers by providing consistent means of handling data, facilitate data-driven insights & decision making, and providing a platform to implement future change initiatives faster, cheaper, and easier.Data & Analytics EngineeringThis is a Director position that provides specialist data analysis and expertise that drive decision-making and business insights as well as crafting data pipelines, implementing data models, optimizing data processes for improved data accuracy and accessibility, including applying machine learning and AI-based techniques.Morgan Stanley is an industry leader in financial services, known for mobilizing capital to help governments, corporations, institutions, and individuals around the world achieve their financial goals. At Morgan Stanley India, we support the Firm's global businesses, with critical presence across Institutional Securities, Wealth Management, and Investment management, as well as in the Firm's infrastructure functions of Technology, Operations, Finance, Risk Management, Legal and Corporate & Enterprise Services. Morgan Stanley has been rooted in India since 1993, with campuses in both Mumbai and Bengaluru. We empower our multi-faceted and talented teams to advance their careers and make a global impact on the business. For those who show passion and grit in their work, there's ample opportunity to move across the businesses for those who show passion and grit in their work. Interested in joining a team that's eager to create, innovate and make an impact on the world? Read on...What you'll do in the role:We are looking for a skilled Data Engineer with 6-10 years of experience to join our team. The Firmwide Data Office department is recruiting for an enthusiastic, dynamic, hands-on and delivery focused Data and ETL Engineer. As a member of our Software Development team, we look first and foremost for people who are passionate about solving business problems through innovation and engineering practices. You'll be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle, as well as partner with stakeholders to stay focused on business goals. We embrace a culture of experimentation and constantly strive for improvement and learning. You'll work in a collaborative, trusting, thought-provoking environment-one that encourages diversity of thought and creative solutions that are in the best interests of our customers globally. You'll combine your design and development expertise with a never-ending quest to create innovative technology through solid engineering practices. You'll work with highly inspired and inquisitive team of technologists who are developing & delivering top quality technology products to our clients & stakeholders. Responsibilities: • Design, development and support of Data Ingestion Pipelines for Knowledge Graph using Python & Snowflake. • Collaborate with business and other technology teams to translate business requirements into innovative solutions implementing performant, scalable, resilient distributed applicationsWhat you'll bring to the role:Required Skills & Qualifications: • Bachelor's/Master's Degree in Computer Science, Computer Engineering, Data Analytics or related field • 6+ Years of strong development experience building robust Data ingestion pipelines using tools like Python, PySpark and Snowflake as well as Autosys/Airflow. • Strong experience in writing multi-processing scripts using Python and distributed processing scripts using PySpark. • Strong problem-solving skills, business acumen, and demonstrated excellent oral and written communication skills with both technical and non-technical audiences • Experience in closely working with application teams and managing all the DB related activities such as DB modeling, design, development, maintenance and support • 2+ Years of strong experience in python for automating data cleansing, data re-formatting, data transformations • Strong Skills in Relational Databases including database design, writing complex queries and stored procedures, performance tuning • Strong Data Modeling skills - Enterprise Data Model (OLTP) and Dimensional modeling. Well versed with principles, techniques and best practices of data modeling. • Extensive experience in designing and developing of complex mappings, applying various transformations such as lookup, source qualifier, update strategy, router, sequence generator,aggregator, rank, stored procedure, filter, joiner and sorter transformations • Experience in integration of various data sources like DB2, SQL Server, and Flat Files into the staging area • Expert in designing Parallel jobs using various stages like Join, Merge, Lookup, Remove duplicates, Filter, Dataset, Lookup file set, Modify, Aggregator, XML parsing stages. • Knowledge about DevOps implementation in Data space • Extensive experience working on UNIX/Linux platform, Python scripting and managing Good to Have: • Experience with Big Data processing and technologies like Hadoop, Spark, Kafka • Experience with Graph Databases and Redis Data Stores. • Exposure to LLM Technologies. • Experience and expertise working with data wrangling and visualization tools like Dataiku, Tableau and Power BI. • Financial Services experience will be a strong plusWHAT YOU CAN EXPECT FROM MORGAN STANLEY:We are committed to maintaining the first-class service and high standard of excellence that have defined Morgan Stanley for over 89 years. Our values - putting clients first, doing the right thing, leading with exceptional ideas, committing to diversity and inclusion, and giving back - aren't just beliefs, they guide the decisions we make every day to do what's best for our clients, communities and more than 80,000 employees in 1,200 offices across 42 countries. At Morgan Stanley, you'll find an opportunity to work alongside the best and the brightest, in an environment where you are supported and empowered. Our teams are relentless collaborators and creative thinkers, fueled by their diverse backgrounds and experiences. We are proud to support our employees and their families at every point along their work-life journey, offering some of the most attractive and comprehensive employee benefits and perks in the industry. There's also ample opportunity to move about the business for those who show passion and grit in their work.To learn more about our offices across the globe, please copy and paste https://https://www.morganstanley.com/about-us/global-offices into your browser.Morgan Stanley is an equal opportunities employer. We work to provide a supportive and inclusive environment where all individuals can maximize their full potential. Our skilled and creative workforce is comprised of individuals drawn from a broad cross section of the global communities in which we operate and who reflect a variety of backgrounds, talents, perspectives, and experiences. Our strong commitment to a culture of inclusion is evident through our constant focus on recruiting, developing, and advancing individuals based on their skills and talents.