Data Streaming DevOps - Lisbon

What are you going to do? • Collaborate with cross-functional teams to construct and manage a data lake on AWS for real-time and local market data feeds; • Implement and maintain Elasticsearch, Logstash, Beats, Kibana, Elastic Common Schema (ECS) and Elastic Security components; • Utilise AWS services such as Lambdas, S3, CodePipeline, and CodeCommit to automate data lake processes; • Develop and maintain data ingestion pipelines using Apache Flink and Apache Beam; • Deploy, configure, and optimize AWS services to support data storage, processing, and analysis; • Index data, design complex queries, create aggregations, and manage mappings within Elasticsearch; • Serve as the go-to expert for ELK implementation and configuration; • Collaborate with teams to integrate Elasticsearch with other operational data platforms and tools, including Kafka, SIEM, and more. What are we looking for? • Bachelor's degree in Computer Science, Information Technology, or a related field; • Extensive experience as a developer with a strong focus on AWS Elastic services and Python; • In-depth knowledge of Elasticsearch, Logstash, Kibana, Beats, Elastic Common Schema (ECS) and Elastic Security; • Familiarity with AWS services, including Lambdas, S3, CodePipeline, and CodeCommit; • Proven expertise in data pipeline development using Apache Flink and Apache Beam; • Proficiency in Python for scripting and automation; • Background in cyber security or data engineering is highly advantageous; • Strong problem-solving and troubleshooting skills; • Excellent communication and collaboration abilities; • Ability to excel in a fast-paced, team-oriented environment. What do we have to offer you? • Health Insurance; • Feedback&Coffee – the system that includes Aubay’s Performance Management Cycle, with regular moments of feedback and the Career Progression Model; • Possibility of working remotely; • A Training Academy designed to think of you and your needs. You can count on technical and behavioural training sessions (e-Learning and classroom), Meet&Techs, Webinars and Mentoring; • Events and Teambuildings. What makes us different? • Our organizational culture is based on values such as transparency, team spirit, regular feedback and continuous learning; • Reference prizes and birthday present; • Lounge; • We don’t have a dress code; • We know your name and all address each other informally; • Coffee and varied snacks at your disposal; • You will grow in good company. Isn’t this one of the ways in which to develop professionally? If we got your attention, we now hope to spark your enthusiasm. Ready for the first phase? We are waiting for you. We will use personal information that you have sent us to consider your application for the relevant function. By giving us your information/documents by email, you consent to Aubay Portugal treating your personal information. Your privacy is important to us. Please check our Privacy Policy, which explains how we will use and store your personal information. It also explains the rights you have regarding your information and how you can contact us for clarification of questions or requests.