A company in the field of AI is looking for a Senior Data Engineer
Responsibilities
Apply to email: cv+barikr@gefenhasamot.com
Job number 3144
Responsibilities
- Design, develop and implement robust data pipelines using ETL/ELT to move data from various sources into our lakehouse while ensuring scalability, security, and performance
- Ensure quality and integrity of data by implementing validations, testing and monitoring
- End-to-end feature development and ownership, from design to production
- Work directly with stakeholders to develop a solid understanding of the business application and requirements for which the application is being designed
- BSC in a related technical field or equivalent practical experience
- Over 3 years of experience in a Data Engineering role
- Coding experience with Python
- Experience with SQL and NoSQL databases
- Experience with data modeling, and building ELT/ETL pipelines
- Experience with common data warehouse and lakehouse technologies
- Experience with AWS platform
- Experience working with Git, CI-CD flows and Docker
- Experience building data pipelines with big data frameworks such as Spark
- Technologically diverse background and ability/willingness to learn new things quickly
- Experience working closely with data scientists / data science project (MLOps)
- Experience with big data architectures and infrastructures
- Experience with BI tools (Tableau, Looker, power bi etc.)
- Experience with IaC technologies like CDK & CloudFormation
Apply to email: cv+barikr@gefenhasamot.com
Job number 3144