If you toilet handle is loose, first take off the toilet lid, if the metal handle is un-broken you will probably find that the plastic lever arm has a crack (see picture).
It very easy to replace this part as it is only pushes onto the handle shaft and is held with a small screw.
There may be more than one square hole in the lever arm, normally only one will be the right size and put the handle at the correct angle.