Senior Data Engineer

היי-טק תוכנה השפלה תאריך פרסום: 03/08/2021 מספר משרה: 1608

We are looking for a Senior Data Engineer that is passionate about building large-scale data processing systems and motivated to make an impact in creating a robust and scalable data platform used by every team, come join us.

 

What You'll Be Doing;

 

  • Designing and Building large scale data collection and processing infrastructure in production

  • Designing, implementing, and debugging distributed systems

  • Working on data enrichment in collaboration with our data science team to extract meaningful signals from the data

  • Streaming and batch computation and training ML models

  • Keeping up-to-date with the latest developments in the field

 

Keys For Success;

 

  • +3 years of Experience with programming in Python

  • +3 years of Experience with Java/Spark/Scala.

  • Distributed Queues like celery, RabbitMQ, SQS

  • Protobuf or Parquet

  • Kafka or Kinesis

  • Workflow management (Airflow, or similar)

  • Experience working in AWS (S3)