Compatibility, Predictions and Optimization in Large-scale Online Decision Making