Graph Based Planning with Guarantees