It’s unlikely that a hoglet would still be with an adult at this time of year. (although it’s just possible that a male and female both didn’t hibernate and managed to produce some very early hoglets) Hoglets tend to arrive in June/July and even when they are first left to their own devices are still comparatively tiny. It’s difficult to know what you mean by small (how long is a piece of string!) but last year’s hoglets could still be smaller than an adult, especially a mature male. But it could also have been a smaller female. Hogs can vary in size quite a bit.
But you are right that female hogs are solely responsible for bringing up the hoglets. The male is unlikely to even recognise his offspring, although male hogs are often quite tolerant of hoglets in general when they’re small.