ClangCodeModel is very slow sometimes

Even in relatively small projects (that may include many headers) it seems that it has gotten slower than it has been before and it really affects usability.

Follow symbol under cursor for example can easily take 30 seconds or more and by the time you have triggered the action and got frustrated because nothing happens and opened the file manually, got back to where you are and only then Qt Creator actually jumps there.