Do the following:

1. Create a new project
2. Check the "Sign package" checkbox in the project settings
3. Select a keystore for the project

Usually when you select a keystore, the password dialog will pop up and it will query the aliases in the keystore. However, in this case nothing happens. You can get the password dialog and list of aliases by unchecking "Sign package" and then checking it again.