Staying On a Moving Budget