Messed up emotionally after situation?

I went on a first date with guy I have never met. He seemed like a really nice guy and we went to a movie. He had kissed me a few times which I was ok with me but then he started to grope my and then put his hand down my shirt. I have never done anything like that with a guy and I was so freaked out. I was so scared I didn't say no and he continued to do it. Once he stopped I said I had to go to the bathroom and never went back. Now I just feel awful and violated. I feel like I somehow brought it upon myself and that I have no right to feel this way because I let him do it and I continued to kiss him. I was seriously afraid. I feel like a victim to something and I'm having a really hard time. I honestly feel traumatized by this and I don't know why. I feel like this is going to haunt me. Does anyone have some advice or input?