Reuse code to remove overloads via templates

[ZXShady]

UPDATE: I currently now have split it into commits to see if they are fine to be metrged, and I had some issues in local commits with internal compiler errors that I will yet fix.

First of all I want to thank the authors for making this amazing library.

but one thing I really hated is the insanely long error messages for simple mistakes like glm::ivec3() + 1.0f gets me a 210 line error message like this

error_before.txt

but after removing unnecessary overloads I got it down to this (I still could reduce the unneeded overloads even more)

error_after.txt

it also significantly reduced the amount of boiler plate code written in the header files and leaves less room for mistakes.
like unary operator+ for mat was repeated 16 times!! while it had the same definition every time. 16x less code

this pr breaks code though like

--glm::ivec3(0); // no longer compiles

I made it a free function that takes a non const lvalue so that no longer compiles (and it should tbh just write ivec3() -1)