Does the motor push you along OK? If it runs OK, I wouldn't worry about it. A little contact is not a fatal flaw. I've heard some guys even install it so the impeller touches the liner, and let it wear in, especially with a stainless impeller.
Another thought is that the impeller nut could...