Senior Data Engineer

היי-טק תוכנה מרכז תאריך פרסום: 08/10/2024 מספר משרה: 3144

A company in the field of AI is looking for a Senior Data Engineer
Responsibilities
  • Design, develop and implement robust data pipelines using ETL/ELT to move data from various sources into our lakehouse while ensuring scalability, security, and performance
  • Ensure quality and integrity of data by implementing validations, testing and monitoring
  • End-to-end feature development and ownership, from design to production
  • Work directly with stakeholders to develop a solid understanding of the business application and requirements for which the application is being designed
Requirements
  • BSC in a related technical field or equivalent practical experience
  • Over 3 years of experience in a Data Engineering role
  • Coding experience with Python
  • Experience with SQL and NoSQL databases 
  • Experience with data modeling, and building ELT/ETL pipelines
  • Experience with common data warehouse and lakehouse technologies
  • Experience with AWS platform
  • Experience working with Git, CI-CD flows and Docker
  • Experience building data pipelines with big data frameworks such as Spark
  • Technologically diverse background and ability/willingness to learn new things quickly
Advantages
  • Experience working closely with data scientists / data science project (MLOps)
  • Experience with big data architectures and infrastructures
  • Experience with BI tools (Tableau, Looker, power bi etc.)
  • Experience with IaC technologies like CDK & CloudFormation

Apply to email: cv+barikr@gefenhasamot.com
Job number 3144