Currently, the unitary matrix used in `permutedims` is a `Dict`. It should be some sparse matrix type, possibly using `AxisKeys.jl`