In which way I can log at public administration bodies and online services providers (the so-called third parties)?

Always use your Banking IDentity. There is a difference. You will log into a public administration body through Identita občana application which is managed by the State.  On the contrary, in case of third parties you will log in through the Bank ID service  which is run by Bankovní identita a.s.