In order to create a new alert, choose Create|Alert from the top menu:
You will be redirected to the search query phase, where you will have to pick the query you place the alert on:
Reminder: If you get the mail server isn't configured error (as shown in the following screenshot), you need to configure the mail server in Redash:
After you find the query you ...