The whole IDEA of the fill concept is that you should be able to trigger it at ANY time during the bar until usually the last quarter note (or eighth if it is a slower style), and it flow smoothly, no matter what.

Having to hit it at any particular beat just to make it work right is NOT part of normal fill operation, at least AFAIK...