I was, though in no great hurry. As a matter of fact I was more concerned that I might be keeping you from getting home.

[While polite, he is not so retiring as to not say anything when someone is standing in his way. And besides, he's more than relaxed enough to not mind in the slightest either way at the moment.]

I'd been somewhat looking forward to having the opportunity to speak with you.