Lead Data Engineer

Lokalizacja: Gdansk

Job description

Lead Data Engineer is responsible for designing and developing data processing and data persistence software components for solutions which handle data at scale. Working in agile teams, Lead Data Engineers providing strong development leadership for team members and take responsibility for the quality of the codebase as well as the match to user needs.

Most of our work comes through repeat business and direct referrals, which comes down to the quality of our people. The success of our Data Engineering teams means that customers are bringing us an increasing number of exciting data projects using cutting-edge technology to solve real-world problems. We are seeking more high calibre people to join our Data & Analytics capability where you will grow and contribute to industry-leading technical expertise.

Role Description:

  • Taking responsibility for the development of whole components or subsystems within a team;
  • Development incorporates design, code, test and defect resolution;
  • Focusing on hands-on design and development, using open source and commercial platforms.
  • Defining and enforcing development best practice and coaching junior team members to ensure consistency;
  • Working with project architects, taking responsibility for non-functional needs of ETL/ELT data processing pipelines such as robustness and performance;
  • Taking responsibility for standards and execution of unit and integration testing done within the team;
  • Taking responsibility for software product due diligence and integration;
  • Leading troubleshooting and tuning of activities;
  • Working with Operations teams to ensure the application software is operationally ready;
  • Working with Security Architects and accreditors to ensure compliance with relevant legal and security requirements;
  • Advising customers and managers and other team members of the estimated effort and technical implications of user stories and user journeys;
  • Contributing to technical proposals as part of the sales process.

Required Experience:

  • Software development experience with distributed data storage and processing technologies including: Cloudera’s distribution of Apache Hadoop and Spark;
  • Software development experience in open source technologies including: JVM languages;
  • Experience of developing substantial components for multiple large-scale data processing solutions;
  • Experience in coaching and mentoring experience in data development disciplines;
  • Data modelling experience with RDBMS and NoSQL data stores.
  • Ability to advise architects and other stakeholder on detailed technology and development practice;
  • Ability to make effective decisions within fast-moving Agile delivery;
  • Strong understanding of tools, design methodologies and best practice;
  • Ability to simply and clearly communicate technical design both written and verbally;
  • Maintains an open attitude to sharing information;
  • Ability to prioritise and work to deadlines.

Desirable Skills:

  • Experience of data visualisation and data complex data transformations, including ETL tools such as Talend;
  • Comfortable with continuous improvement and sharing input on data best practice;
  • Understanding of unstructured text processing including NLP.
  • Understanding of data redaction implementations;
  • Experience with steaming and event-processing architectures including technologies such as Kafka and change-data-capture products;
  • Understanding of contemporary data storage technology, such as document, graph, log stores and other non-relational platforms;
  • Has experience of security, performance tuning, capacity planning, resilience, and availability across multiple solutions;
  • Participation in development and/or technology communities;
  • Open source contributor.

What you get from Kainos:

  • Relocation package that covers flights, accommodation, and other relocation costs;
  • Private medical insurance at Medicover (possibility to take your family under it);
  • 1500 PLN per year to pay for your hobby courses (you can spend it for whatever you want i.e. kitesurfing or Spanish language lessons);
  • Gym card Multisport (50% paid by company; possibility to take your family under it);
  • Integration and family parties: Santa Claus, Summer BBQ, Kick Off, Pay Day Drinks, Christmas Party, St. Patrick’s Day, and many more;
  • Online training portal access — Pluralsight;
  • Career Coach taking care of your career progress in Kainos;
  • Conferences in Poland and abroad as a speaker or listener (you can prepare for your presentation within working hours);
  • 3000 Pounds for Refer-a-friend scheme;
  • Possibility to work from home up to 3 days per week;
  • Core hours (starting work between 8 and 10 AM);
  • 7,5 hours working day;
  • Fun rooms, Chill Out room and gym with showers in the office;
  • Soft skills training;
  • Easy access to the people on managerial levels, real influence on the company’s decisions;
  • Very stable employment in a company that cares about employees’ development.

Recruiter’s contact: Michalina Kowalik (

Please send us your resume in English with following information attached: “I hereby declare that all the facts and information provided for this cover letter and CV are true. I allow my personal data stated in the abovementioned applications to be processed for the purpose of recruitment, in accordance with the Personal Data Protection Act dated 29/08/1997 (Dz. U. 2016 r. poz. 922)”.


Możesz też wysłać nam swoje CV na adres


Możesz też wysłać nam swoje CV na adres