After a number of general considerations, without meaning in any sense a reductionist approach, this paper argues in favour of the mathematics of discrete systems and of the non-classical logics, and claims that a complex thinking both entails and crosses through those domains. Such a proposal, it is argued, has not been a general concern until to-date among the communities of complexologists. At the end, several consequences are withdrawn at understanding what truly thinking about complexity is all about.