Hypernode changes:

  1. Added fdupes to hypernode stack for deduplicating images
  2. Passive FTP through AWS is now supported

Improvements to our deployment infrastructure:

  1. Tweaks to internal tools for faster access to all nodes
  2. More expansive monitoring of our internal systems
  3. Shorter cycle times for scaling our continuous deployment
  4. Persistent storage of job progress for inspection and resumability
  5. Workers for asynchronous completion of jobs using ZooKeeper for high availability and atomic transfer
  6. Centralized logging using Logstash and Kibana