Special fibers of Shimura varieties in the Torelli locus