During some operations, like drawing new features, you can undo your last placed point by pressing Ctrl+Z.