Intersections of the Concept of Entropy in General Systems Theory and Information Theory: A Literature Review

Abstract

Concepts and constructs transcend disciplinary boundaries, enabling the transdisciplinary approach required for systemic thinking. The concept of entropy is applied across multiple domains of knowledge, incorporating specific characteristics unique to each field. Different areas of study formulate assertions, employ specific computational approaches, and produce results based on their adopted definitions of entropy. This research was conceived in response to a central question: How do concepts derived from Information Theory and General Systems Theory converge in the application of entropy? Accordingly, the objective of this study was to investigate the scientific literature to determine the contributions of both Information Theory and General Systems Theory in applying the concept of entropy within their respective frameworks. The idea that "the whole is greater than the sum of its parts" can be substantiated through the convergence of these theoretical perspectives. In open systems, the interactions with the environment — as well as the flows of information, energy, and entropy among their subsystems — generate behaviors that differ significantly from those observed in closed systems. As a result, complexity gives rise to structures within real-world systems that are capable of maintaining stable states, even without a corresponding increase in entropy.