Efficient Pairwise Information Collection for Subset Selection