That thing will be easier to remove than you realize. I have a similiar setup for a bike rack in my truck bed and can snatch it out by hand. Granted thats with a drop in bedliner, but even with a bit better grip, a few good tugs, a hammer, or a small amount of prying will probably get that bar out.