Selecting a lot of rows one at a time can cause a performance problem, since the rows aren't necessarily selected in one big block they need to be selected individually. When 20% of 5 million rows are selected using this process it shows that it takes a considerable amount of time to do the merging.