Our client is currently looking for a Data Engineering Manager who will be primarily responsible for team development, leadership, Big Data Platform strategy and execution, direction on design of data pipelines and managing operations.
Description:
- Directing the necessary re-architecture and general design improvement of the data engineering ecosystem that comprises the data ingestion processes, data flows, the data lake, the data warehouse and BI platform
- Managing, motivating and mentoring the team whilst ensuring succession planning and career guidance for the respective team members
- Helping to enforce technical architecture and documentation standards, policies and quality assurance procedures
- Coordinating and providing technical leadership to other members of the team on application design and development
- Following the project work plans to meet functionality requirements, project objectives and timelines
- Helping in the diagnosis and resolve of critical issues and liaise with other members of the team and other teams within the organisation to arrive to a solution
- Proactively proposing enhancements to existing processes and liaising with Technical Architects to introduce new technologies which facilitate the BI and development process
- Undertaking any other related tasks as directed by senior management
Requirements:
- Bachelor's Degree in IT/Engineering or equivalent
- Minimum of 5 years’ experience in data engineering environments, data warehousing and ETL design
- Project management experience related to data architecture overhaul
- Excellent knowledge of distributed processing systems used for big data workloads
- Experience in defining and adhering to data governance frameworks
- Applied experience and skills in building data workflows with industry standard tooling and be able to programmatically schedule them
- Experience and knowledge in OLAP Technology;
- Experience in MS BI Stack (SSIS/SSRS/SSAS)
- Have working knowledge of visualization tools such as Microsoft Power BI, Tableau or Qlik Sense
- Highly skilled in SQL and have mastery of a programming or scripting language (Java, Scala, Python etc.…)
- Highly self-driven, motivated individual who firmly believes in a growth-based culture
- Experience in managing or leading a medium sized team or larger
- Certified and have experience in Cloud-based infrastructure
- Have experience and knowledge in Dimensional Modelling in Data Warehousing
- Experience with machine learning
- Have working experience with data warehousing infrastructure
- Familiar with development approaches of CI/CD, continuous testing, Microservices and containerization
- A solid understanding together with applied experience of stream, message and event based real time architectures
- Worked within agile frameworks and very familiar with its mindset