Make sure that Move pieces checkbox is checked.
Press the left mouse button on the piece to be moved (and keep it pressed) and move it in the new position. Release the mouse button where you want to place the piece.
While the left button is pressed you can also click with the right mouse button for rotating a piece with 1 rotation step.