Does the old secret stop working when I rotate a key? By default, yes, at once. "No, stop it now" is preselected. More: Credentials and scopes, Rotating