Harnessing Demand Flexibility To Minimize Cost, Facilitate Renewable Integration, And Provide Ancillary Services