I wouldn't have tolerated his yelling and subtle digs at Yoon. Their only issues were him "being silly"? He's trying to enforce and respect the boundaries you set, bro. Confront yer feelings.
And with the appearance of Taejoon, that should be his signal to have this convo another day. Preferably indoors.
Setting us up for the upcoming angst spike in the future