Data Engineering Consultant

Advanced Analytics

Skills and experiences

Technical Characteristics desired for this role

• Ability to conduct data profiling, cataloguing, and mapping for technical design and construction of technical data flows.

• The ability to apply such methods to solve business problems using one or more Azure Data and Analytics services in combination with building data pipelines, data streams, and system integration.

• Mastery of Python and T-SQL and familiarity with NET C# is required

• Azure Data Factory, Azure Data Lake, Azure Databricks, Azure SQL DW, Azure SQL, and Azure App Service

• Knowledge of Azure HDInsight + Spark, Azure Cosmos DB, Azure Stream Analytics, Azure IOT Hub, and Azure Event Hub is a plus

• Demonstrated experience preparing data and building data pipelines for AI Use Cases (text, voice, image, etc.)

• Designing and building Data Pipelines using streams of IOT data.

• Knowledge of Lambda and Kappa architecture patterns.

• Knowledge of Master Data Management (MDM) and Data Quality tools and processes

• Strong team collaboration and experience working with remote teams.

• Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code fundamentals.

• Working experience with Visual Studio, PowerShell Scripting, and ARM templates

• Knowledge of Jupyter Notebooks or Databricks Notebooks for Python development is a plus

• Experience with Git and Azure DevOps is a must.

Certifications

• Microsoft Certified: Azure Data Engineer Associate

What you'll do

What you'll do

• Translate business requirements to technical solutions leveraging strong business acumen.

• Analyze current business practices, processes and procedures as well as identifying future business opportunities for leveraging Microsoft Azure Fabric or Azure Databricks

• Support the planning and implementation of data design services, providing sizing and configuration assistance and performing needs assessments

• Deliver architectures for transformations and modernizations of enterprise data solutions using Azure cloud data technologies

• Design and Build Modern Data Pipelines and Data Streams

• Design and Build Data Service APIs

• Develop and maintain data warehouse schematics, layouts, architectures and relational/non-relational databases for data access and Advanced Analytics

• Expose data to end users using PowerBI, Azure API Apps or any other modern visualization platform or experience

• Implement effective metrics and monitoring processes

• Travel as needed.

Learn more

Learn more

Interested in knowing what's going on inside Avanade? Check out our blogs:

• Avanade Insights – exchange ideas that drive tomorrow's innovation

• Inside Avanade – explore what life is like working at Avanade

Enjoy your career

Some of the best things about working at Avanade

• Opportunity to work for Microsoft's Global Alliance Partner of the Year, with exceptional development and training (minimum 80 hours per year for training and paid certifications)

• Real-time access to technical and skilled resources globally

• Dedicated career advisor to encourage your growth

• Engaged and helpful coworkers genuinely interested in you

Find out more about some of our benefits Employee Benefits at Avanade | Avanade

A great place to work

As you bring your skills and abilities to Avanade, you'll get distinctive experiences, limitless learning, and ambitious growth in return. As we continue to build our diverse and inclusive culture, we become even more innovative and creative, helping us better serve our clients and communities. You'll join a community of smart, supportive collaborators to lift, mentor, and guide you, and to lean on your expertise. You get a company purpose-built for business-critical, leading-edge technology solutions, committed to improving the way humans work, interact, and live. It's all here, so take a closer look!

We work hard to provide an inclusive, diverse culture with a deep sense of belonging for all our employees. Visit our Inclusion & Diversity page.

Create a future for our people that focuses on

• Expanding your thinking
•Experimenting courageously
•Learning and pivoting

Inspire greatness in our people by

• Empowering every voice
•Encouraging boldness
•Celebrating progress

Accelerate the impact of our people by

• Amazing the client
•Prioritizing what matters
•Acting as one