it wont fall apart!

as long as you dont get overly dramatic with him and you just tell him that you have those feelings/thoughts i think itll be fine and the friendship wont fall apart.