Location: Warsaw, Poland (2 days onsite per week). Start ASAP, 12 months rolling contract.
For the DataGen squad we are looking for a Senior DevOps Data Engineer (ODI)
… to build with us the Strategic Data Exchange between Lending core systems and surrounding systems. The DataGen squad is part of WB Tribe Lending. The primary focus of the squad is on the processes concerning data delivery to Lending internal applications, to the Wholesale Bank Data Lake and data delivery on Regulations.
Data is becoming more important every day. Your contribution to the Strategic Data Integration will be critical to realize our ambitioned Lending data platform, with high quality and timely data availability, moving from batch to real-time. This way enabling excellent data consumption possibilities to meet our ever increasing client- and regulatory demands on data.
We need your help in designing and building this new exchange and building bridges towards other squads in order to realize end-to-end delivery across Lending- and other Tribes. We value Agile, self- organization and craftsmanship. We are driven professionals who enjoy shaping the future of this place.
Needed skills & experience
We are looking for someone with an easy-to-work-with, mature and can-do mentality. Someone who is an open and honest communicator, who values working as part of a team, who is willing and able to coach or train other developers and who is aware of developments and trends in the industry and corporate ecosystem.
Are you also passionate about a (not so distant) future that most data processing is done in a streaming fashion, not scared off by complex data, and enjoy developing complex components in Java? Then please read on.
On the more technical side you must have 9+ years of relevant experience in data engineering and especially must have experience in the following fields:
What will you do?
Your day-to-day responsibility include:
- Analyzing requirements and perform technical feasibility study/analysis
- Developing integrations in ETL+SQL+Java between source RDBMS and DWH
- Being first point of contact for any production issue or for any technical advices
- Working closely with Ops engineer for interface deployments, PROD Data Analysis, UAT debugging
- Learning new tools and implement them on the interface like Azure DevOps, GIT, Ansible code snippets etc.
- Assisting/developing the Deployment Automation Strategies
- Carrying out Unit Test and System Integration Testing
- Preparing Regulatory Reports by understanding the asks
- Supporting audits with documentation/Proofs/run through the code base
Your key responsibilities are:
- Developing high performance solutions with best practices on tools used
- Completing full test cycle before implementation
- Using CI/CD pipeline to implement the solution
- Communicating with the stakeholders to analyze and understand the need and design the solution accordingly
- Using advanced SQL query language to support stakeholder for Audits / Regulatory request
- Supporting other squad members whenever needed with your experience and knowledge
Who are you?
You are an enthusiastic Data Engineer with the following skillset:
- Experience on integrating data using Oracle data integrator(ODI)
- Thorough understanding of data warehousing, data modelling techniques and entity relationship diagram
- Experience on Oracle RDBMS, tables, views, indexing, tuning and data types
- Experience on Oracle SQL Developer or other SQL client tools
- Data Analysis and cleansing techniques
- Advanced skills of SQL (analytical functions etc.) and PLSQL
- Experience on data transformation techniques
- Experience on Scrum methodology
- Basic java knowledge and experience is also preferred
- Agile way of working
- Ability to communicate effectively and present/demo ideas and solutions
- Keen on documenting her/his work
- Knowledge on Linux OS/shell scripting
- Experience on CI/CD pipeline and relevant tools such as Ansible, Jenkins, Git, Microsoft TFS/Azure
- Capable of solving complex problems
