I would be put out by the fact he didn't consider you at all when planning the trip ..unless he is going alone& only asked you after it to be considerate? If you can afford to go, but money is tight, don't go. Just tell him you want to spend your extra money on something you want to do :)
I...