Information is physical

I’m still busy digitizing a lifetime’s accumulation of clippings from magazines and journals, along with heaps of old tech reports, memos, and miscellaneous other cruft. There’s something slightly eerie about the process. So far I’ve emptied out a dozen file drawers, run several hundred pounds of paper through the scanner, and created thousands of PDFs. Yet my laptop is not a gram heavier. The glib explanation is that I’m just scraping pure information off the pages, leaving behind the ink and cellulose; I’m saving the bits and recycling the atoms. But is information so readily dematerialized? One of the manila folders I have just dredged up out of a filing cabinet is bulging with publications by the late Rolf Landauer, including several papers on the theme “Information is physical!”

I first met Rolf circa 1980. I had written a brief Scientific American article about some recent developments in optical computing technologies, and Rolf called to tell me I should never do anything so reckless and foolish and tasteless again. He took a dim view of photonics. This initial encounter was not a promising start to a friendship, but we got over it. He put me on his mailing list, which meant that I got a fat envelope once or twice a year, with reprints or preprints of his own latest work and often copies of other papers he thought I should being paying attention to.

Four of the articles in my Landauer folder have very similar titles:

  • Information is Physical (Physics Today, 1991).
  • The Physical Nature of Information (Physics Letters A, 1996).
  • Information is a Physical Entity (Physica A, 1999).
  • Information is Inevitably Physical (In Feynman and Computation, 1999).

If Landauer had lived longer (he died in 1999), I like to think that the next installment in the series would have been titled even more emphatically: Information is Physical, Damn It!

In all of these essays, Landauer’s thesis is straightforward:

Information is inevitably tied to a physical representation. It can be engraved on stone tablets, denoted by a spin up or down, a charge present or absent, a hole punched in a card, or many other alternative physical phenomena. It is not just an abstract entity; it does not exist except through a physical embodiment. It is, therefore, tied to the laws of physics and the parts available to us in our real physical universe.

This notion is obvious and totally uncontroversial–except to those who think it’s totally wrong. Doubters tend to focus on mathematical entities. Surely the integers exist as abstractions, independent of stone tablets and punchcards, no? And triangles would have three sides even if all the matter in the universe were annihilated–right? When it comes to numbers like π and e, one might well argue that they can exist only as abstractions; they can never be given a complete physical representation.

Landauer did not argue strenuously for his constructivist position within mathematics itself, but he did take a hard line about mathematical methods in the physical sciences:

There is a tendency to think of mathematics as a tool which somehow existed before and outside of our physical world. Mathematics, in turn, allowed the formulation of physical laws which then run the world, much as a process control computer runs a chemical plant. Here, instead, we emphasize that information handling has to be done in the real physical world, and the laws of physics exist as instructions for information handling in that real world. It, therefore, makes no sense to invoke operations, in the laws of physics, which are not executable, at least in principle, in our real physical world.

Our accepted laws of physics invoke continuum mathematics, which is, in turn, based on the notion that any required degree of precision can be obtained by invoking enough successive operations. But our real universe is unlikely to allow an unlimited sequence of totally reliable operations. The memory size is likely to be limited, perhaps, because the universe is limited. Even in an unlimited universe it is a strong presumption to invoke the possibility of assembling an arbitrarily large organized memory structure. Furthermore, in a world full of deleterious processes including noise, corrosion, electromigration, incident alpha particles and cosmic rays, earthquakes and spilled cups of coffee, it would be unreasonable to assume that each step in an unlimited sequence of operations can be carried out infallibly.

Those alpha particles and spilled cups of coffee bring me back to my little document-scanning project–my kitchen-table version of Google Books. I am well aware that my digitized archives are not disembodied abstractions, that the information I’ve scanned from Rolf’s preprints is still physical even if it’s less tangible, and that the bits remain vulnerable to all the perils of a material world. Indeed, the thought of losing all the files I’ve scanned–now that the paper originals are beyond recall–makes me itchy to plug in the back-up drive.

But the process of replicating the bits–which is even easier than capturing them in the first place–sends my mind off on another tangent. As Rolf said, we can represent information in many physical forms: as marks on paper, as magnetized domains on a metal-coated disk, as packets of electric charge, as base pairs in a DNA molecule, as beads on an abacus. When we build machinery to process this information, we can choose among many different computing technologies: transistors, brass gears, neurons, rubber bands and tinker toys, quantum dots, even photons in optical waveguides (though Rolf despised that last possibility, and he was skeptical about the quantum dots).

Somehow, this proliferation of physical embodiments for information does not strengthen the conviction that information is subordinate to its physical representation. When we can write the same message in so many forms–everything from lines in the sand to holograms–the message itself begins to seem just as substantial as the physical medium, and perhaps more enduring. I have digital documents that began life on eight-inch floppy disks 20 years ago. The files have migrated a dozen times or more to other media: five-and-a-quarter-inch floppies, three-and-a-half-inch floppies, Zip drives, digital audio tapes, CD-ROMs, a succession of hard disks. Most of the physical objects making up that long chain of transmission have long since succumbed to coffee spills, corrosion and other hazards, or else they have simply gotten lost. Yet the data persists, a sort of standing wave in the river of hardware rushing toward obsolescence and oblivion. Under the circumstances, it can be hard to keep in mind that the information depends for its very existence on those delicate shards of matter. It goes against the grain of the whole apparatus of computer science, where automata theory, the Church-Turing thesis, and the Turing equivalence of programming languages all encourage us to think that abstractions come first, and implementation is secondary.

Euclid1703.png

These musings are not meant as an attempt to refute Landauer’s assertion. I still have to concede that I cannot record or express a pattern of bits without resorting to some physical medium, if only the gray matter in my own head. But the notion sits uncomfortably; it’s a conundrum. I wish I had a chance to chat with Rolf about it. But, sadly, Rolf Landauer is no longer physical.

Note: As far as can tell, none of the four Landauer papers I mention above are available online without payment. I am therefore taking the liberty of posting my scan of Rolf’s preprint of the information-is-a-physical-entity paper. I would also like to call attention to two recent articles about Landauer: a discussion of his contributions to solid-state physics by Bertrand I. Halperin and David J. Bergman, and a biographical memoir by Charles H. Bennett and Alan B. Fowler.

This entry was posted in computing.

12 Responses to Information is physical

  1. Craig says:

    Lovely post, thanks.

    Your musings on the physicality of information put me in the mind of the works of science fiction author Greg Egan. I’ll recommend the short story Luminous in support of the necessity of information being tied to the physical universe, and perhaps the novel Permutation City as an exposition on the opposite view. Happy reading!

  2. John Cowan says:

    If this stuff is really precious you might want to consider off-premises storage of your digital data. JungleDisk, which uses Amazon S3 (at least three copies of all data in Amazon data centers), is what I use, but I don’t have any video and not too many images, so costs are trivial — a few dollars a month.

    (I promise this is not sp*m.)

  3. Pingback: Twitter Trackbacks for bit-player » Blog Archive » Information is physical [bit-player.org] on Topsy.com

  4. Barry Cipra says:

    There is a very simple explanation for why your laptop has gained no weight from all the information you’ve been putting in it: By organizing files there, you are reducing the entropy inherent in the bits and bytes of your machine’s memory. And we all know what a dense, heavy concept entropy is….

  5. jofr says:

    Interesting post. I think it is the representation of an information which is material and physical, not the information itself. For example the prime number 171 looks in base 16 like 0xAB and in base 2 like 10101011. The representation in a certain base is physical, not the number itself.

  6. Daeniken says:

    There is one question that cuts to the core of this matter:

    Can one give any example of the presence of information without it being tied to some physical representation?

    Representation of information might be inkblots on a paper – certainly physical. What makes those inkblots a representation of information? I’ts their connection to something else in an observer capable of processing them. So it can say to me “beware” and it has a meaning to me because my mind connects that configuration of inkblots into ideas about danger. Information itself in that situation is this connection and it’s no less physical than the representation, because at any given time it embodies some physical form – pattern of photons, my neural pathways etc.

    Numbers are representations of quantities, not pure information whatever that means. They make a reference to some quantity in a mind of an observer and that relation constitutes the information – the match between a physical instance of a symbol and observers ability to connect that symbol to a certain quantity.

    There is a distinction between representation of information and information itself but both of these have always a physical form.

  7. ox69 says:

    I tend to think about information as pattern of something. However in general information is ambigous term. For example – what information is here ?
    ___
    | |

    One may be able to say that it is
    1) Number Pi.
    2) Nail head
    3) Simply 3 distinct lines
    n) …
    n+1) Just some set of black pixels on screen
    n+2) Places on monitor which emits no photons.
    n+m) …
    So what really is that “thing” depicted above ???
    The answer is – there is no answer without the chosen rules about How to extract information from that, or How to map given “thing” to the knowledge which we already have ?
    Clearly, this kind of transformation is done only by intelligent being – us humans (so far). So this leads to conclusion that information (or modelling of reality) is clearly a property of mind.
    In the end, in reality there are no things such as Integers,Pi, Nail, Lines, pixels, screen or photons, /insert other abstraction here/. There is only a plain reality from which we always try to capture some patterns or construct new patterns by the needs we have – which is of course very nice.

  8. Agnius says:

    But the number 171 is itself representation of quantity in decimal system. Can we think about quantities without representation of it in ANY numeral system ? Obviously NOT.
    Think about history of counting – in prehistoric times counting was only done with the help of body parts – especially fingers (even now this is used for teaching children of counting). Only in Upper Paleolithic appeared other forms of counting – by using tally sticks for example. And with the help of progressing civilization we learned counting with many other things – including computers. So we can say that with the evolution of human, abstraction of numbers (and counting) gets “more abstracted”. But what this means in reality ? By looking back into our history, we can safely claim that “more abstracted” integers just means our ABILITY of transfering one representation of numbers into bigger amount of numbering systems. So abstraction is only indicator of how much we understand patterns in nature – the better our knowledge about nature – the better abstractions we are capable to produce. And of course as Daeniken said – abstractions (be it number, or something else) always exists in physical form, in our heads as movement patterns of electrical charges in brain cells – neurons.

  9. Mike Cane says:

    What a shock it was for me to trip across this post. I had this revelation on my own about a decade ago and friends would look at me as if I’d dropped my brain when I tried to explain this to them. Thanks!

  10. Pingback: A Question Concerning Data | The Informational Turn

  11. bart says:

    Here’s another article by Landauer available without payment: http://qi.ethz.ch/edu/qisemFS09/papers/64_Landauer_The_physical_nature_of_information.pdf

  12. To counter the “triangle always has three sides” example, a triangle only has three sides by definition, and it requires a physical agent (say, yourself or myself) to assert that definition. If the entire universe were annihilated, that would include annihilation of those defining agents. Then there would be no “triangle” to speak of (or indeed, no way to speak of anything at all).

    In my opinion.