We are looking for a Senior Data Engineer that is passionate about building large-scale data processing systems and motivated to make an impact in creating a robust and scalable data platform used by every team, come join us.
What You'll Be Doing;
-
Designing and Building large scale data collection and processing infrastructure in production
-
Designing, implementing, and debugging distributed systems
-
Working on data enrichment in collaboration with our data science team to extract meaningful signals from the data
-
Streaming and batch computation and training ML models
-
Keeping up-to-date with the latest developments in the field
Keys For Success;
-
+3 years of Experience with programming in Python
-
+3 years of Experience with Java/Spark/Scala.
-
Distributed Queues like celery, RabbitMQ, SQS
-
Protobuf or Parquet
-
Kafka or Kinesis
-
Workflow management (Airflow, or similar)
-
Experience working in AWS (S3)