I need to shoot some video inside my apartment. Unfortunatly the walls are painted an off white color. So all the light reflecting off the walls give the video a "yellowish color" to it.

Is there a way to counter this in camera?

white balance off your walls.. see if that works