The connector is the main issue here for the most part as nothing physically holds it in place secured to the SSD apart from friction between both connectors. Use a glue gun here to secure the connection between the adaptor and the SSD so that it stays in place even during extreme motion.

Don't apply the glue where it connects, but rather over the connection ... or you can put 2 large drops (one on either end/side). When it solidifies, it will hold both in place.

Orla
Denmark