There are issues with the modeless dialog default button rendering when the dialog loses focus as visible in the following image where the default button in the first one.
 

 
I created a sample application that opens both a "standard" dialog and a tool dialog, here is the issue in a screenshot
 

 
 
The standard dialog is behind the main application, while the tool dialog default button is not properly rendered when the tool dialog loses focus.