•  
  •  
 

Abstract

One of the most controversial issues, in a multidisciplinary area, is information theory. The American Heritage Science Dictionary (2014) defines information theory as “a branch of mathematics that mathematically defines and analyzes the concept of information, statistics and probability theory, and applications include the design of systems that have to do with data transmission, encryption, compression, and information processing and deeply affected many fields.” It has a fundamental contribution to make in multiple disciplines, such as mathematics, statistics, computer science, physics, neurobiology, communication theory, information science, economics, and electrical engineering. Indeed, information theory played a crucial role to achieve many pertinent scientific missions and inventions such as Voyager, Mobile phone, and Internet.