Data Engineer w/Spark

Your connection with Aubay starts in the following lines: 

Aubay Portugal is a multinational French company, in Portugal since 2007. We have offices in Lisbon and Oporto and we are a specialized consultant in Management, Implementation, Development and Maintenance of Information Systems. We have more than 150 active partners and we operate in sectors such as banking, insurance, telecommunications, services, energy and transports. 

What are you going to do? 

• Develop and optimize distributed data pipelines using Apache Spark, ensuring the efficient processing of large datasets;
• Implement advanced caching techniques and optimize distributed computation workflows to improve data retrieval times and resource utilization;
• Optimize partition key joins to speed up query processing and enhance overall system performance in distributed environments;
• Optimize SQL queries for better performance and scalability, particularly in large-scale, distributed database systems;
• If applicable, leverage the Cloudera platform to manage and scale data workflows in big data ecosystems, ensuring reliability and efficiency.

What are we looking for? 

• More than 5 years of professional experience as a Data Engineer;
• Expertise in Apache Spark and distributed computation techniques;
• Experience with advanced SQL optimization and caching strategies;
• Knowledge of the Cloudera ecosystem is a valuable asset for managing big data platforms;
• Fluency in English (written and spoken). 

What do we have to offer you? 

• Health Insurance; 
• Feedback&Coffee – the system that includes Aubay’s Performance Management Cycle, with regular moments of feedback and the Career Progression Model; 
• Working model: hybrid; 
• A Training Academy designed to think of you and your needs. You can count on technical and behavioural training sessions (e-Learning and classroom), Meet&Techs, Webinars and Mentoring; 
• Events and Teambuildings. 

What makes us different? 

• Our organizational culture is based on values such as transparency, team spirit, regular feedback and continuous learning; 
• Reference prizes and birthday present; 
• We don’t have a dress code; 
• We know your name and all address each other informally; 
• You will grow in good company. Isn’t this one of the ways in which to develop professionally? 

If we got your attention, we now hope to spark your enthusiasm. Ready for the first phase?   

We are waiting for you at ihabrykh@aubay.pt! 

We will use personal information that you have sent us to consider your application for the relevant function. By giving us your information/documents by email, you consent to Aubay Portugal treating your personal information. Your privacy is important to us. Please check our Privacy Policy, which explains how we will use and store your personal information. It also explains the rights you have regarding your information and how you can contact us for clarification of questions or requests.