# JavaScript (ES6), <s>78</s> 75 bytes

    x=>x.map(y=>y.map(z=>+s.splice(Math.random()*s.length,1)),s=eval(`[${x}]`))

This is the first time I can remember using `.splice()` in a code-golf challenge...