Running tests fail with OutOfSourceBuild-feature

agent:2019/04/23 08:35:55 build.go:534: Executing instruction 64 of 102 - SetExecutionPhaseName
agent:2019/04/23 08:35:55 build.go:783: 
agent:2019/04/23 08:35:55 build.go:534: Executing instruction 65 of 102 - ScheduleUploadTestResults
agent:2019/04/23 08:35:55 build.go:783: 
agent:2019/04/23 08:35:55 build.go:534: Executing instruction 66 of 102 - SetExecutionPhaseName
agent:2019/04/23 08:35:55 build.go:783: 
agent:2019/04/23 08:35:55 build.go:534: Executing instruction 67 of 102 - RunQtUnitTest
agent:2019/04/23 08:35:55 build.go:616: Running tests in directory /home/qt/work/build/tests/application
agent:2019/04/23 08:35:55 build.go:521: Executing scheduled instruction 1 of 2 - Upload all core dumps if there are some
agent:2019/04/23 08:35:55 build.go:523: 
agent:2019/04/23 08:35:55 build.go:521: Executing scheduled instruction 2 of 2 - Upload test results
agent:2019/04/23 08:35:55 build.go:778: No test results collected
agent:2019/04/23 08:35:55 build.go:523: 
agent:2019/04/23 08:35:55 agent.go:282: Test failed
agent:2019/04/23 08:35:55 agent.go:205: ERROR building: chdir /home/qt/work/build/tests/application: no such file or directory
2019-04-23 08:36:00,544.544 INFO:workitem.py:532: Agent FINISHED FAIL: testing /home/qt/work/build/tests/application: qt/qtapplicationmanager/916958d0d77ff67d9ed942157bddbad8f12e8c45/LinuxUbuntu_18_04x86_64LinuxUbuntu_18_04x86_64GCCqtci-linux-Ubuntu-18.04-x86_64-eff6b0BuildExamples_DeveloperBuild_Documentation_OutOfSourceBuild_QtLibInfix_QtNamespace/750a211223a68ce2a9c41e318e0894e35ee14987/Test
2019-04-23 08:36:05,730.730 INFO:workitem.py:532: Agent FINISHED CANCELED: qt/qtapplicationmanager/916958d0d77ff67d9ed942157bddbad8f12e8c45/LinuxUbuntu_18_04x86_64LinuxUbuntu_18_04x86_64GCCqtci-linux-Ubuntu-18.04-x86_64-eff6b0BuildExamples_DeveloperBuild_Documentation_OutOfSourceBuild_QtLibInfix_QtNamespace/750a211223a68ce2a9c41e318e0894e35ee14987/Test