Since we always search for the nearest separator (and strip them from the front of the next token) there can't be any separators left at the end of a token.
Since we always search for the nearest separator (and strip them from the front of the next token) there can't be any separators left at the end of a token.