What does this text mean exactly?

I'm thinking he means you... But he was responding to you're joke in a joking way as well, so don't get freaked out about it.