Blight means to suffer over some event or to be affected by something that has happened.
The poem talks about a man who is thinking of the woman which results for him to be blight about it. As seen in the poem, "stern agony, and shroud, and pall" "Make thee to shudder, and grow sick at heart" are expressed in the poem that can show the meaning of "blight".