In the present paper, we examine discourse connectives from the perspective of reference (i.e. a presence of an anaphoric element). We introduce a division of connectives into: i) connectives without an inherent (internal) reference (e.g. and, but, or, if, however, so), and ii) connectives with an inherent (internal) reference that is either optional (e.g. as a result vs. as a result of this), or obligatory – cf. already grammaticalized connectives (e.g. thereafter, therefore or thereby) vs. not yet grammaticalized connectives (e.g. because of this or for this reason). We apply this general division on Czech and German connectives and conduct a contrastive study on the parallel data of the corpus InterCorp 10. Specifically, we focus on the group of Czech connectives in the form of prepositional phrases with an obligatory inherent reference that do not have any fully grammaticalized form in Czech (like kromě toho, lit. “except this”, ‘moreover’) and we search for their most frequent semantic counterparts in German. The results of our research demonstrate that the German counterparts of the selected connectives in Czech are mostly (in 72%) grammaticalized connectives containing a referential morpheme (e.g. außerdem, deswegen, stattdessen, dagegen, demgegenüber, daneben, infolgedessen).