Is there any way I could rid of excess water in my body?

In the morning, before eating or drinking anything I am my usual weight of 115. But whenever I drink the slightest bit of water, or eat a small amount of food it seems like I gain 5 pounds. It sure looks like it. My thighs get bigger and I really don't like it. I understand that its probably my body's way of storing liquid but is there by any chance something I could do about it? Its not like I could just stop drinking water lol. Thanks for any help.