Difficulty of a physics major?

Right now I am just starting my second year of college. I am currently going for Mass Media Communications. I'm currently at a 3.6 right now and have made an honors society and the deans list both semesters of last year. I don't feel challenged in my major and I have been considering switching to majoring in Physics. Any advice or suggestions?

I know physics takes a lot of math. I get math and ibam pretty good at it. I usually make simple mistakes that I fix when I go back and check my work. I understand some calc but I would retake precal to make my foundation for calc 1 sturdy.