In the Project Settings, there is an option to "open package location after build", which is convenient because it is otherwise a bit difficult to navigate to the directory where the APK is built.

But when this is enabled on Windows, it will just spawn a default explorer window when the build finishes, it will not go to the correct directory.