Can someone explain to me why this happens and how to fix it? It's seriously making the game unplayable

After installing a few mods (none of which mess with inventory) this started frequently happening. Storage containers empty despite the items still technically being in there (if I press transfer all I still get the items inside)

Rejoining the server works but after like one minute it's back.