The Physics simulation is based on numerous mathematical calculations and you may observe unstable behavior due to numeric tolerances. The scene will then have to be tuned to achieve a stabler simulation.

You can tune the following parameters:

• contactTolerance of the world and rigid body
• timestep of the world
• substeps of the world.