Entropy and Natures Nested Relationships

Yield, and maintain integrity.
To bend is to be upright;
to be empty is to be full.
Those who have little have much to gain,
but those who have much
may be confused by possessions.

Excerpted from Tao Te Ching Chapter 22. Stan Rosenthal Translation

Entropy ( like information as discussed in my last post here ) has many meanings and definitions which can lead to confusion. Increasing entropy has been described as; increasing disorder, a dispersal of energy, an increase in information, an increase in uncertainty, a decrease in information, moving closer to equilibrium, and increase in freedom or possibility, and even as the flow of time itself.

Much of the confusion with the term in my view is related to its great potential for wide applicability across domains. The term entropy originated in physics from the laws of thermodynamics. These original thermodynamic laws however refer to closed systems like a gas within a container. Systems in nature however are never completely closed.

The domains in which entropy has been applied range across a wide spectrum from it's origin in the the purely physical theory of thermodynamics to it's more abstract uses in information theory. In between, entropy has also often been used to describe living systems. Here the great physicist Erwin Schrödinger ( of the quantum mechanical 'Schrödinger equation') providing an example from his wonderful book 'What is life':

"Every process, event, happening—call it what you will; in a word, everything that is going on in Nature means an increase of the entropy of the part of the world where it is going on. Thus a living organism continually increases its entropy—or, as you may say, produces positive entropy—and thus tends to approach the dangerous state of maximum entropy, which is death. It can only keep aloof from it, i.e., alive, by continually drawing from its environment negative entropy—which is something very positive as we shall immediately see. What an organism feeds upon is negative entropy. Or, to put it less paradoxically, the essential thing in metabolism is that the organism succeeds in freeing itself from all the entropy it cannot help producing while alive."

As the quote above suggests, the nested quality of natures systems also adds to the potential for confusion. Our interpretation of entropy is relative to our frame of reference. The physicist JB Brissaud authored an interesting article in the journal 'Entropy' in 2005 with title 'The meanings of entropy'. Brissaud speaks to how the nested nature can impact the interpretation:

"Thermodynamics is the physical science which links the microscopic and macroscopic worlds and the meaning of entropy shows a curious mirror effect according to the adopted point of view; what is information for one is lack of information for the other."

Brissaud makes a crucial insight into the paradoxical nature of entropy. For an observer looking from the outside trying to understand a complex system, a low degree of entropy is associated with many interconnected subsystems that constrain each other allowing the system to resist the entropic pull towards dissipation and equilibrium. Yet if we consider the system itself as an observer, then the reverse is true. From the perspective of the system, entropy is associated with possibility, or freedom of choice. In other words from the point of view of an agent/organism, intelligent systems maximize their capacity to extract useful information or energy from their environments. 

Complex living systems are said to have low entropy because they have many inter-related sub-systems which constrain each other in a complex and constant flux of communication. Low entropy systems then are complex due to a large number of internal constraints which provide many pathways to enable the system to flexibly interact with the outside world under conditions of uncertainty. Very simple systems then are less adaptable and more vulnerable to environmental change. 

This resolves a paradox. Low entropy complex systems have an intrinsic intelligence that affords them the opportunity to learn from novel environmental conditions through a receptivity to uncertainty. Highly self-organized systems can be said to have the 'intelligence' to respond to a variety of possibilities. These systems can efficiently exploit resources ( stored energy ) from the environment and dissipate that energy back. Thus from an objective (outside) point of view complex living systems are maximum entropy producers, while from the organisms point of view existence is maintained by keeping internal entropy low.

A fascinating new computer simulation study (bbc news reports on it here) adds support to this conception of entropy by connecting maximum entropy production to the emergence and evolution of intelligence. The simulations are based on a 'causal entropic force' , which is guided by the goal of keeping as many options open as possible. From the BBC report:

"The simplistic model considers a number of examples, such as a pendulum hanging from a moving cart. Simulations of the causal entropy idea show that the pendulum ends up pointing upward - an unstable situation, but one from which the pendulum can explore a wider variety of positions. The researchers liken this to the development of upright walking. Further simulations showed how the same idea could drive the development of tool use, social network formation and cooperation, and even the maximisation of profit in a simple financial market."

"While there were hints from a variety of other fields such as cosmology, it was so enormously surprising to see that one could take these principles, apply them to simple systems, and effectively for free have such behaviours pop out," Dr Wissner-Gross said.

This reminds me very much of the intention one attempts to achieve in tai chi practice. One of the important principles in tai chi is to maintain the ability to respond to an opponent or the environment by moving in any potential direction. The idea is to never over-commit or predetermine ones physical or cognitive awareness or orientation in any given direction. Initially when learning the postures one learns how to place themselves in, and move between specific positions. With practice the awareness becomes more holistic (not on the specific postures), but instead on subtle feedback mechanisms that allow for continuous flowing movement within the context of some core guiding principles.  This is basically a practice in developing an internal body intelligence which once developed frees the awareness so that it may be receptive to the potential surprise that unfolds in an uncertain future.

This is similar to the way human physiology maintains it's vital  systems within a narrow range ( homeostasis ) with the support of other systems that respond more dynamically to unpredictable changes in the surrounding environment ( Allostasis ). Freedom and constraint while seeming to conflict and oppose each other can within the framework of negative feedback systems interact to support an equilibrium where complex self-organizing systems maintain integrity within (core constancy) while flexibly responding to change. The ability to adapt to the unknown represents maximum entropy from the perspective of the self-organizing system. To an outsider observer the same systems ability to maintain it's integrity against the force of entropy represents a far from equilibrium low entropy dynamic.

There is no promise extended however from the nature of entropic forces  that complex systems will maintain a persistent integrity. If the ability to exploit and dissipate the environments stored energy reserves outstrips our capacity to adapt to the entailing environmental changes then the system will no longer be sustainable. Consider our current rate of exploitation with regard to our natural resources (something will have to give).

"Yield, and maintain integrity;

be whole, and all things come to you".

Excerpted from Tao Te Ching Chapter 22. Stan Rosenthal Translation


Update: I had to link this wonderfully produced video of a David Foster Wallace commencement speech which I think beautifully expresses the concept of intelligence, wisdom and meaning being hinged to maximum entropy principles.