A Robust Framework for Graph Construction in Vision Graph Neural Networks