Big Data Engineer – Job no. 4933

Share

Introduction

An opportunity for a Big Data Engineer who will be at the core of the data eco-system identifying unstructured data sources, building map-reduce processes and making the data available for consumption through the data lake, both within the department as well as by other data consumers. The role requires flexibility to work on an on-call basis as needed for production support.

Organization

Our client is an established bank offering a selection of savings and investment schemes whilst also including wealth management.

Function

  • Creating, optimizing and maintaining distributed, fault-tolerant and scalable data pipelines
  • Extending and enriching a high-performance, geo-clustered Data Lake whilst monitoring and maintaining the overall production of the Big Data Stack health
  • Testing and deploying new solutions or patches to existing systems under established change control procedures
  • Improving the Data processes and procedures continuously to accelerate delivery and raise quality standards, and conducting design and code review to ensure compliance with standards for production deployments
  • Maintaining source control, records and documentation as appropriate in a regulated bank
  • Providing support for the full stack of technologies and systems within the department to ensure SLAs are kept and working towards attaining expert level knowledge of core technologies used by the department
  • Responding to production issues or incidents during and off business hours and providing data integration and expertise to the organisation as needed

Requirements

  • A minimum of 3 years’ work experience in application development or production support
  • Working experience or good understanding of Data Lake concepts and technologies
  • Practical experience using Big Data tools and technologies such as Talend for BD, Hive, Spark, Hadoop, HBase, Hive, and Pig
  • Strong documentation skills both of existing systems and of new requirements
  • Ability to understand underlying data in complex systems and identify improvements
  • Willing to conduct research and learn new technologies
  • Knowledge of banking and investment products will be considered an asset
  • Exposure to business intelligence and data warehousing will be considered an asset
  • Experience working in an agile environment and in a regulated industry will be considered an asset

Offer

An attractive remuneration package commensurate with skills set and experience will be offered to the selected candidate.

Information

Applications from non-EU citizens will not be acknowledged/considered.

Your Consultant

Similar Jobs

We are looking for motivated Junior Front-End Developer who is ready to lead custom web development throughout the entire project lifecycle, focusing on the creation of the front-end applications.
An opportunity for a Fullstack Developer who has competitive spirit, passion for innovation and achievement, and desire to be at the forefront of an evolutionary change in a digital workforce.
We are looking for the right person who will be able to take charge of support functions essential to SalesForce productivity and the overall productivity and effectiveness of the assigned sales organization, liaising with internal and external stakeholders and reporting directly to the Sales Operation Manager.
The Pre-Sales Engineer Lead will lead a team of pre-sales engineers in EMEA, working closely to provide senior-level technical and commercial expertise on the Company’s products with a focus on Company’s Remote Application Server (RAS). The Pre-sales Engineers lead the customer through the process of integrating the Company’s solutions in their environment and ensures technical success from the first technical review into the Proof of Concept, pilot and through the full implementation. The Pre-Sales Engineers utilize their Application and Desktop virtualization expertise, System and Infrastructure Design and Administration knowledge and other technical skills relating to virtualization and cloud computing platforms, application delivery, software integration, mobile solutions, testing and troubleshooting skills to provide best in class solutions to our clients.The selected candidate will work closely with Product teams to propose solutions and provide direct feedback on product direction for emerging customer needs.