“Tu Fu had resolved to return with his family” he really drags them around!! Aren’t his wife and kids annoyed?

“I who once sat at play with Grand Tutor Hsieh, now come sword in hand to seek the Lord of Hsü.” Grateful for the explanation of these allusions

Are the final two lines as straightforward as they seem? If so, it’s kind of a soft closer to the poem.