What makes a helium filled balloon lose it's 'rise'?

For example, when I was little, I had a balloon filled with helium in my room (from a birthday party) and eventually it didn't float anymore. What causes this?