On the structure of halfdiagonal-halfterminal-symmetric categories with diagonal inversions