You can take care of various administrative tasks at the Citizens' Service Centres. For example: registering your place of residence, ask for legalizations of documents or ask for certificate of good conduct.
Citizens' Service Centres in Stuttgart
You will find a service centre in many city destricts. Some services can also be done online.