can i drop now after a semester?

I rushed, pledged, and joined a fraternity this semester. They are arguably top-tier and southern. I'm actually northern but lived in the south for a while now. I went to some awesome parties, formals, and had a blast but over time I found myself questioning more and more if I even belong here. I only accepted their bid because they were considered a top house and I didn't get a bid to where I really wanted to go.

I don't think I can just "quit" and my concern is that rushing again won't land me into the fraternity I really wanted to be apart of... wtf do I do?