When using CONFIG with testcase and cmdline, if cmdline is specified before testcase, the check rule will have an incorrect path to the binary that references an app bundle. If testcase is specified before cmdline, it works.

Using CONFIG += cmdline testcase  leads to Makefiles with the following incorrect path referencing an app bundle:

check: first
 /path/to/target_wrapper.sh $(TESTRUNNER) ./$(QMAKE_TARGET).app/Contents/MacOS/$(QMAKE_TARGET) $(TESTARGS)

Using CONFIG += testcase cmdline leads to Makefiles with the following statement with the correct path the binary: 

check: first
  /path/to/target_wrapper.sh $(TESTRUNNER) ./$(QMAKE_TARGET) $(TESTARGS)