It's good data management policy to allow users to delete themselves and Gravatar provides this. In the upper right, click the v next to your email and select "Disable my Gravatar".

Read the instructions on screen:

To permanently delete, you must go to WordPress.com to close the account.