Y

Manager, Data Engineering

Yoush Consulting
Full-time
On-site
Toronto, Ontario, Canada
AI



Welcome to Yoush Consulting. Yoush Consulting provides project management and information technology expertise to help our clients deliver their projects. Our client is looking to hire a Manager in data Engineering and we are helping them find an excellent one. 

Azure DevOps Engineer with D365 and F&O experience - As a Data Engineer, you will be responsible for building and maintaining the systems and processes that allow for the extraction, transformation, and loading (ETL) of data from various sources into our Azure-based data ecosystem.

Responsibilities: Manage, guide, and assist a team of data engineers to provide:

  • Provide a detailed review and assessment of the enterprise data warehouse environment and proposed changes and implementation plan to improve scalability and performance
  • Design and develop SSIS ETL process using table partitioning with a focus on performance improvement of large tables
  • Design and develop Power BI reports to show SSIS package run duration and trend over time
  • Perform data analysis and provided suggestions and feedback to the team to design and develop optimized SQL Queries and Stored Procedures (SCD Type1, SCD Type2 using Hash bytes) to improve performance
  • Design and implement an operational process to provide a high-level summary of SQL Server and database environment to assist in the upgrade and migration of SQL Server databases to newer versions


Requirements

• 5+ years' experience in leading a high-performance technical team
• 5+ years of progressive Data Engineering experience in Python, R, SQL and PowerShell scripting
• Mandatory experience with Azure Synapse and DW technologies, Microsoft Data Technologies (Azure Data Factory, PowerBI, etc.)
• Experience with Azure (app services, API management, security features)
• Experience in organizing and conditioning data and conducting big data analysis
• Excellent written and verbal communication skills: ability to clearly communicate with business and technical stakeholders
• Strong problem-solving and analytical abilities, creativity, and insight with the ability to address complex situations with stakeholders
• Knowledge of machine learning is a strong asset
• Knowledge and some experience in data science, predictive modelling is a strong asset

Application Experience:
• Experience with applications such as Azure DevOps, Microsoft Dynamics 365, iFirm, Workday, Power BI, and Systems Integration

Education:
• Degree in Computer Science, Math, Statistics or STEM-related field. A Masters Degree and/or Ph.D is a strong asset, but not required