Brilliant news that you have a tenant in your hog house!
I would be inclined to gradually move the food away from the house. It’s really best to keep feeding and sleeping areas separate, so that if, say, a female was going to have her young there, she wouldn’t be disturbed by some rowdy males biffing each oher, just outside the door! Also food has the potential to attract predators. So I would just gradually move that away, so the hogs can still find it, to a new feeding area. I have my feeding area so that I can watch it easily from the house.