This job was posted over 90 days ago and may no longer be available.

Senior Data Engineer

We are GovPredict, an exponentially growing, Y Combinator-backed startup in Washington, DC. Our software+data product helps companies predict what the US government will do. We work with Fortune 500 publicly-traded companies, Ivy-League universities, and United States House and Senate offices. Our culture is “build fast and ask questions later.” But we value rigor and best-practices too. Our team of powerful engineers is building the software that no government has ever seen before.

Our team of top-tier software developers is distributed around the world and our sales + business development is in the USA.

Our Stack

Ruby on Rails backend, ReactJS front end, Python scrapers, Postgres, Mongo, Redis, Elastic Search, AWS, and various tools to accommodate a robust data pipeline soon.

About the Job

As a data engineer, you will be focused on rearchitecting, building, then improving our data pipeline. This means you'll be working with databases, queuing systems, distributed architecture, and Python. Our product pulls in data from structured APIs, data dumps (like large CSVs), or from unstructured sources with our python scrapers. We then manipulate, organize, and display it in never before seen ways to our customers.

Our goal is to improve how data flows in our application so we can continue to deliver accurate, reliable, and timely data to our customers as we scale our team and codebase. You'll make sure our architecture will scale with us, that we have monitoring enabled to keep things running, and that our data gets into our DB timely and accurately. You will apply best practices and write smart+scalable code. You will be working with data nobody has ever worked with before.

Other Facts

  • Remote work
  • Full time
  • Competitive pay

Desired Background

  • Strong engineering background
  • 4+ years industry experience
  • Strong Python skills
  • Experience building distributed systems
  • Familiar with at least some of the following (or analogs): Luigi, Cassandra, Hadoop, RabbitMQ, Kafka, Spark
  • Can take a task from gathering requirements to deployment and maintenance
  • Able to communicate effectively in writing and orally in English (other team members speak Russian, Romanian, Spanish, Polish, German, and Portuguese in addition)
  • Eager to learn new things and apply them quickly
  • Ability to mentor and guide fellow team members constructively
  • Willing to work full-time with some overlap on US business hours (8am to 6pm EST)

Desired Skills

How to Apply

Fill out the form here: https://govpredict.typeform.com/to/ae0cXa If you need anything else, email us at: careers@govpredict.com (Do not apply through email!)

Contact Info

Posted: March 2, 2017

Apply


Get Updates