Senior Data Engineer
Negotiable salary
Postmates
Responsibilities
Design, build and operate large scale data infrastructure systems across all environments to store, aggregate and process large amounts of data
Implement various ETL infrastructures and guidelines on how to most effectively build and maintain them for reporting, analytics and product features
Write maintainable and self-documenting code, perform code reviews
Build a data platform-as-a-service for internal consumers, operating on open-source technologies on AWS and GCP
Serve in the on-call rotation to make sure our data infrastructure is highly available to all internal customers
Support our Applied Machine Learning team
Requirements
Bachelor’s degree (or equivalent experience) required
Minimum of 5 years of relevant professional experience
Experience building on, deploying, and maintaining open-source data infrastructure systems (HDFS, Spark, ZooKeeper, Druid, etc.) in production environments
Experience with various types of data sources including relational stores such as MySQL, PostgresSQL and NoSQL data stores such as Cassandra or MongoDB and in-memory stores like Redis or Memcache
Understanding of distributed systems and principles (consistency, durability, resilience, consensus)
Experience working with cloud-native infrastructure on the public cloud (we operate on GCP and AWS)
Ability to declare and work with infrastructure-as-code (all our infrastructure is defined in Terraform or Deployment manager)
Ability to write clean and maintainable code (our codebases are in Python, Go, Erlang, and Java)
Perks & Benefits
Postmates has your back. In our impact-first work environment, we value huge company vision. As you strive to build the future with us, we’ll support you with a competitive salary and equity plan, along with access to our 401k plan and robust benefits including: health benefits, flexible paid time off, parental benefits, and food perks.