Data Engineer
Data Masters is one of the largest data science consultancy comp
За позицијата
Are you a data wizard passionate about unraveling the mysteries hidden within vast datasets? Do you thrive on architecting robust data pipelines and crafting scalable solutions? Data Masters is/ We are on a mission to harness the raw potential of data, and we need a Data Engineer player to join our league of extraordinary minds in our data-driven journey. You will have the opportunity to work with cutting-edge technologies, collaborate with cross-functional teams, and drive impactful outcomes through innovative data solutions. If you’re ready to embark on a dynamic career where your expertise in data engineering will be valued and rewarded, we invite you to explore this opportunity with us.
Responsibilities
- Spearheaded the adoption of cutting-edge Big Data tools and frameworks for innovative insights.
- Manage the full data lifecycle from design through implementation and ongoing maintenance.
- Design and implement robust ETL processes for seamless data flow and transformation.
- Monitor system performance metrics and provide strategic recommendations for infrastructure enhancements.
- Establish and enforce data retention policies to ensure compliance and maximize data value.
- Collaborate across teams to translate evolving business needs into scalable data solutions.
- Stay updated on industry trends and emerging technologies to continuously improve data engineering practices.
- Foster a culture of collaboration, innovation, and growth within the data engineering team, inspiring excellence and shared success.
Skills and Qualifications
- Bachelor’s degree in Computer Science, Engineering, or a relevant field
- 3 + years in the business intelligence or data engineering role
- Experience with integration of data from multiple data sources
- Knowledge of various ETL techniques and frameworks
- Minimum 3 years of Python experience
- Experience with PySpark
- Knowledge of stream processing frameworks such as Apache Kafka or Apache Flink
- Experience in developing ETL pipelines in at least one of the cloud providers (AWS, Azure, GCP)
- Understanding DevOps principles, including CI/CD pipelines and automated testing
- Familiarity with containerization technologies like Docker and Kubernetes.
We Offer
- Opportunities to work on international projects
- Private Health Insurance
- Referral Bonuses
- Event and team building
- Travels and the possibility of relocation to Portugal
- Paid sport activities