Aftershock is a multi-task benchmark for Anomaly Detection models that rewards generality and practical utility. We make it easy to draw fair and transparent comparisons between algorithms to spur their practical application in an increasingly complex cyber-physical ecosystem.