Reshaping Deep Neural Networks For Efficient Hardware Inference