The rubber band is almost certainly harmless. If you want something more durable, try an o-ring. I'm not sure what material the standard-issue o-rings are made of, but it's some kind of synthetic rubber, and has proved long-lasting in my tank.