Two important aspects of a concise language are as follows: First, the most common words (e.g., "a", "the", "I") should be shorter than less common words (e.g., "roundabout", "generation", "mediocre"), so that sentences will not be too long. Such a tradeoff in word length is analogous to data compression and is the essential aspect of source coding. Second, if part of a sentence is unheard or misheard due to noise — e.g., a passing car — the listener should still be able to glean the meaning of the underlying message. Such robustness is as essential for an electronic communication system as it is for a language; properly building such robustness into communications is done by channel coding. Note that these concerns have nothing to do with the importance of messages. Historical background With it came the ideas of This is justified because. Cybernetics.
Cybernetics is a transdisciplinary approach for exploring regulatory systems, their structures, constraints, and possibilities. Cybernetics is relevant to the study of systems, such as mechanical, physical, biological, cognitive, and social systems. Cybernetics is applicable when a system being analyzed is involved in a closed signaling loop; that is, where action by the system generates some change in its environment and that change is reflected in that system in some manner (feedback) that triggers a system change, originally referred to as a "circular causal" relationship. Some say this is necessary to a cybernetic perspective. System dynamics, a related field, originated with applications of electrical engineering control theory to other kinds of simulation models (especially business systems) by Jay Forrester at MIT in the 1950s. Norbert Wiener defined cybernetics in 1948 as "the scientific study of control and communication in the animal and the machine Definitions W.
Decision theory. Normative and descriptive decision theory Since people usually do not behave in ways consistent with axiomatic rules, often their own, leading to violations of optimality, there is a related area of study, called a positive or descriptive discipline, attempting to describe what people will actually do.
Since the normative, optimal decision often creates hypotheses for testing against actual behaviour, the two fields are closely linked. Furthermore it is possible to relax the assumptions of perfect information, rationality and so forth in various ways, and produce a series of different prescriptions or predictions about behaviour, allowing for further tests of the kind of decision-making that occurs in practice. In recent decades, there has been increasing interest in what is sometimes called 'behavioral decision theory' and this has contributed to a re-evaluation of what rational decision-making requires. What kinds of decisions need a theory?
Choice under uncertainty