When you pick the harvest from your plants 3 times, they will wither. You'll need to spend some energy to remove these. You will receive a reward for removing a withered plant.