Wondering how to handle future encounters with estranged husband?

My husband left 2 months ago. We have a 2 year old son together, whom he visits weekly. Just last night, husband came over to make some repairs. After a couple of hours, it became apparent that he wanted to leave. I asked him if we could talk before he came over, so he said he was "dreading" our soon to be talk, and that's why he was wanting to go. Basically, what happens most of the time is that I ask him if he is ever coming back, and he says "No". So last night was more of the same. Then he ask me if all three of us can go see the fireworks on the 4th. Is he just trying to torture me? If I go, I will just want him to come by the house afterwards OR secretely be hoping for his return. He acts like he wants to be cool with me, but what does he expect from me? So should I go, or should I avoid these little plans for all three of us to be together.