I think it depends on the level of fibre release you expect. I don't think the issue is that the fibres bypass an N95 mask, but that if there are many fibres in the air you want to filter out a much higher proportion than 95%.

In the UK for non-licensed work (removing things like asbestos floor tiles which have low levels of asbestos that are bound in another substrate) you only need to wear the equivalent of an N95 mask.

Noted, thanks! Is there any relevant difference between N100 and P100? I think my local hardware store has P100 filters in stock

P = prevents oil penetration

N = doesn't prevent oil penetration

100 = 99.97% effective against pm2.5 infiltration (the hardest size to filter)