I have two thoughts for you.
1) Is it possible that you’re squeezing way to hard with your thumb? Perhaps with both thumbs? Try lightening up the pressure and simply make contact.
2) Smoothing the outer edge of the thumb hole shouldn’t have any negative impact on the response of the instrument as long as you don’t overdo it.
