As you'd expect, Movie Maker has common commands for many housekeeping tasks you perform in the Storyboard and Timeline views. Here are the major ones, shown in the Timeline view for simplicity.
Select the asset to delete. Movie Maker highlights the clip.
Do one of the following: