Hypernode changes:
- Added fdupes to hypernode stack for deduplicating images
- Passive FTP through AWS is now supported
Improvements to our deployment infrastructure:
- Tweaks to internal tools for faster access to all nodes
- More expansive monitoring of our internal systems
- Shorter cycle times for scaling our continuous deployment
- Persistent storage of job progress for inspection and resumability
- Workers for asynchronous completion of jobs using ZooKeeper for high availability and atomic transfer
- Centralized logging using Logstash and Kibana