Information Theory• Information theory is a discipline in applied mathematics involving the quantification of data with the goal of enabling as much data as possible to be reliably stored on a medium or communicated over a channel.• The measure of information, known as information entropy, is usually expressed by the average number of bits needed for storage or communication. – The more common the event, the higher the entropy http://en.wikipedia.org/wiki/Information_theory
Claude Shannon• Claude Shannon is the creator of “information theory”• The definition was not a broad definition of “information” nor it was others were referring to information at that time and even now.• However, the definition can be quite useful
Models of Information• Common model: a representation of data – When possible formalize the information process – Interoperability – Standards• What is formalization? – Logical or mathematical representation • Natural language definitions are becoming formal – Why formal definitions of information? – Examples?
Formalization/automation/digitization of InformationAdvantages:• Costs• Reproducibility• Scalability• Automation• Interpretation• Others?
Consequences of Information• Information can lead to – Decisions – Actions – Contemplation – Laws – More information
Models of Information Use• Personal models – Cognitive• Social models – Institutions – Groups – Nations – Commerce – Etc.
What is Information?• There is no standard definition• Context is important; maybe vital – \"Information is produced when data are processed so that they are placed within some context in order to convey meaning to a recipient.\"• Information causes things to happen – Permits decisions, actions, predictions, etc.• An innate aspect of intelligence/universe?
The Philosophy of Information: A Definition What is the Philosophy of Information? a new philosophical discipline, concerned with a) the critical investigation of the conceptual nature and basic principles of information, including its dynamics (especially computation and flow), utilisation and sciences; and b) the elaboration and application of information-theoretic and computational methodologies to philosophical problems. L. Floridi What is the Philosophy of Information? (2002) Open Problems in the Philosophy of Information © L. Floridi
P.3 The GUTI Challenge Is a grand unified theory of information possible? The word “information” has been given different meanings by various writers in the general field of information theory. It is likely that at least a number of these will prove sufficiently useful in certain applications to deserve further study and permanent recognition. It is hardly to be expected that a single concept of information would satisfactorily account for the numerous possible applications of this general field. (Shannon 1993, 180) Reductionism: we can extract what is essential to understanding the concept of information and its dynamics from the wide variety of models, theories and explanations proposed. Non-Reductionism: we are dealing with a network of logically interdependent but mutually irreducible concepts. Open Problems in the Philosophy of Information © L. Floridi
What is information science? wikipediaNot to be confused with informatics or information theory• Information science is an interdisciplinary science primarily concerned with the collection, classification, manipulation, storage, retrieval and dissemination of information. Practitioners within the field study the application and usage of knowledge in organizations, along with the interaction between people, organizations and any existing information systems, with the aim of creating, replacing or improving information systems. Information science is often (mistakenly) considered a branch of computer science. However, it is actually a broad, interdisciplinary field, incorporating not only aspects of computer science, but often diverse fields such as mathematics, business, library science, cognitive science, and the social sciences.
information science vs informatics wikipedia• Informatics is the science of information, the practice of information processing, and the engineering of information systems. Informatics studies the structure, algorithms, behavior, and interactions of natural and artificial systems that store, process, access and communicate information.• It also develops its own conceptual and theoretical foundations and utilizes foundations developed in other fields. Since the advent of computers, individuals and organizations increasingly process information digitally.• This has led to the study of informatics that has computational, cognitive and social aspects, including study of the social impact of information technologies.• Many subfields: X-informatics
Great Predictions• \"Computers in the future may weigh no more than 1.5 tons.” Popular Mechanics, forecasting the relentless march of science, 1949• \"I think there is a world market for maybe five computers.” Thomas Watson, chairman of IBM, 1943• \"Heavier-than-air flying machines are impossible.” Lord Kelvin, president, Royal Society, 1895.• \"Man will never reach the moon regardless of all future scientific advances.\"Dr. Lee De Forest, inventor of the vacuum tube and father of television.• \"Everything that can be invented has been invented.” Charles H. Duell, Commissioner, U.S. Office of Patents, 1899.• “Nobody would ever need more than 640 kilobytes of memory on their personal computer,” 1981, Bill Gates. – Other predictions of Bill Gates?
Great PredictionsRIGHT!• Artificial Intelligence: – speech recognition – Some reasoning; computer beats man in chess – Privacy and security problems – Computers can be a pain in the buttWRONG!• Missed Moore’s law and ubiquity of computers
Predicting the future – “The future ain’t what it used to be” Yogi Berra• Can we really predict the future?• Who predicted the implications of the web and search engines?• Social networking?• Can we understand power laws and their implications? – We have no examples of exponential growth in our evolution except plagues.• Can we understand the pervasiveness of computers?
Everything Gets Bigger“Screens” are larger • Flat screen television • Wall televisions“Screens” are everywhere • Every room of the house • Waiting rooms • Stores • Cars • Phones“ The return of large data centers”
Everything Gets Smaller• Phones• Watches / instruments• Computers – embedded• Glasses• Projectors
Everything Gets Cheaper• World wide cell phone penetration – 5 Billion • Some places 100% penetration – 1 Billion smart phones
Everything gets smarter• Mobile phones - the new computer• The PDA that is really an assistant• Digital immortality
Discussion Questions• Is more and more information being digitized?• Which definition of information do you prefer? Can information be inaccurate? Can you measure it?• Information is the message• How is information accessed?• Is entertainment information? Are music and games information resources?• What is a “fact”? Can it exist without a context? What is objectivity?• Can information be both explicit and implicit?• What does the growth of information mean?• What about Moore’s law?
Thanks to:• Jim Gray, Microsoft• L. Floridi, Hertfordshire• Robert Allen, Drexel• Wikipedia
Search
