They paid a price for Adityanath's hate speech – and now have fallen silent