Teaching numerical methods made me realize how tricky derivatives of vectors and matrices can be. So, I gathered some handy notations and basic stuff that could help anyone into machine learning. Hope it helps!