hm 用英语:

Hm, that's a good idea. Let's go there.

Of course he thought it was a joke and let it slide with a "hm?" but he was seriously annoyed. I mean, just don't say things like that even as a joke!