Wikipedia

Data physicalization

Not to be confused with computer physicalization, the use of physical hardware to replace virtual machines in performing multiple tasks.

A data physicalization (or simply physicalization) is a physical artefact whose geometry or material properties encode data.[1] It has the main goals to engage people and to communicate data using computer-supported physical data representations.[2][3][4]

History

edit

Before the invention of computers and digital devices, the application of data physicalization already existed in ancient artifacts as a medium to represent abstract information. One example is Blombo ocher plaque which is estimated to be 70000 – 80000 years old.[5] The geometric and iconographic shapes engraved at the surface of the artifact demonstrated the cognitive complexity of ancient humans. Moreover, since such representations were deliberately made and crafted, the evidences suggest that the geometric presentation of information is a popular methodology in the context of society.[6] Although researchers still cannot decipher the specific type of information encoded in the artifact, there are several proposed interpretations. For example, the potential functions of the artifact are divided into four categories, categorized as "numerical", "functional", "cognitive", and "social".[7] Later, at around 35,000 B.C, another artifact, the Lebombo bone, emerged and the encoded information became easier to read. There are around 29 distinct notches carved on the baboon fibula. It is estimated that the number of notches is closely related to the number of lunar cycles. Moreover, this early counting system was also regarded as the birth of calculation.[8]

Right before the invention of writing, the clay token system was spread across ancient Mesopotamia. When the buyers and sellers want to make a trade, they prepare a set of tokens and seal them inside the clay envelope after impressing the shape on the surface.[9] Such physical entity was widely used in trading, administrative documents, and agricultural settlement.[10] Moreover, the token system is evidence of the early counting system. Each shape corresponds to a physical meaning such as the representation of "sheep", forming a one-to-one mapping relationship. The significance of the token is it uses physical shape to encode numerical information[11] and it is regarded as the precursor of the early writing system.[12] The logical reason is the two-dimension symbol would record the same information as the impression created by the clay token.[9]

From 3000 BCE to the 17th century, a more complex visual encoding, Quipus, was developed and widely used in Andean South America.[13] Knotted strings unrelated to quipu have also been used to record information by the ancient Chinese, Tibetans and Japanese.[14][15][16][17] The ancient Inca empire used it for military and taxation purposes.[18] The Base-10 logical-numerical system can record information based on the relative distance of knots, the color of the knots, and the type of knots. Due to the texture (cotton) of Quipus, very few of them survive. By analyzing those remaining artifacts, Erland Nordenskiöld[19] proposed that Quipus is the only writing system used by Inca, and the information encoding technique is sophisticated and distinctive.[20]

The idea of data physicalization become popular since the 17th century in which architects and engineers widely used such methods in civil engineering and city management. For example, from 1663 to 1867, Plan-relief model was used to visualize French territorial structure and important military units such as citadels and walled cities. Therefore, one of the functions of the Plan-relief model was to plan defense or offense. It is worth noting that the model can be categorized as a military technology and it did not encode any abstract information.[21] The tradition of using tangible models to represent buildings and architectures still remains today.

One of the contemporary examples of data physicalization is the Galton board designed by Francis Galton who promoted the concept of Regression toward the mean. The Galton board, a very useful tool in approximating the Gaussian law of errors, consists of evenly spaced nails and vertical slats at the bottom of the board. After a large number of marbles are released, they will settle down at the bottom, forming the contour of a Bell Curve. Most marbles will agglomerate at the center (smaller deviation) with few on the edge of the board.[22]

In 1935, three different electricity companies (e.g. Pacific Gas and Electric Company, Commonwealth Edison Company) created an electricity data physicalization model to visualize the power consumption of their customers so that the company can better forecast the upcoming power demand.[23] The model has one short axis and one long axis. The short axis indicates "day", whereas the long axis spans the whole year.[24] The viewers can gain perspective on when customers consume electricity the most during the day and how does the consumption change across different seasons.[24] The model was built manually by cutting wooden sheets and stacked all pieces together.

Researchers began to realize that data physicalization models can not only help agents manage/plan certain tasks, but also can greatly simplify very complex problems by letting users manipulate data in the real world. Therefore, from an epistemic perspective, physical manipulation enables users to uncover hidden patterns that cannot be easily detected.[25] Max Perutz received Nobel Prize in Chemistry in 1962 for his distinguished work in discovering the structure of the globular protein. When a narrow X-ray passes through the haemoglobin molecule, the diffraction pattern can review the inner structure of the atomic arrangements.[6] One of Perutz's works within this research involved creating a physicalized haemoglobin molecule which enables him to manipulate and inspect the structure in a tangible way.

In the book, Bertin designed a matrices visualization device called Domino which let users manipulate row and column data. The combination of row and column can be considered as a two-dimensional data space. In Semiology of Graphics, Bertain defined what variables can be reordered and what variables cannot. For example, time can be considered as a one direction variable. We should keep it in a natural order.[26] Compared with the aforementioned work, this model emphasized the visual thinking aspect of data physicalization and supports a variety of data types such as maps, matrices, and timelines. By adjusting the data entries, an analyst can find patterns inside the datasets and repeatedly use Domino on different datasets.[24]

More recent physicalization examples include using LEGO bricks to keep track of project progress. For example, people used LEGO to record their thesis writing progress. Users can use the LEGO board to set concrete steps before pushing to real publications such as data analysis, data collection, development, etc.[27] Another application involves using LEGO in bug tracking. For software engineers, keeping track of the issue of the code base is a crucial task and LEGO simplify this progress by physicalize the issues.[28]

A specific application of data physicalization involves building tactile maps for visually impaired people. Past example include using microcapsule paper to build tactile maps.[29] With the help of digital fabrication tool such as laser cutter, researchers in Fab Lab at RWTH Aachen University has used it to produce relief-based a tactile map to support visually impaired users. Some tangible user interface researchers combined TUI with tactile maps to render dynamic rendering and enhance collaboration between vision impaired people (e.g. FluxMarkers).[30]

References

edit
  1. ^ Jansen, Yvonne (2014). "Opportunities and Challenges for Data Physicalization" (PDF).
  2. ^ Dragicevic, Pierre; Jansen, Yvonne; Vande Moere, Andrew (2021). "Data Physicalization" (PDF). Handbook of Human Computer Interaction. pp. 1–51. doi:10.1007/978-3-319-27648-9_94-1. ISBN 978-3-319-27648-9. {{cite book}}: |journal= ignored (help)
  3. ^ Vande Moere, Andrew (2010). "The Physical Visualization of Information: Designing Data Sculptures in an Educational Context" (PDF). Visual Information Communication.
  4. ^ Signer, Beat (2018). "Towards a Framework for Dynamic Data Physicalisation" (PDF).
  5. ^ Henshilwood, Christopher S.; d'Errico, Francesco; Yates, Royden; Jacobs, Zenobia; Tribolo, Chantal; Duller, Geoff A. T.; Mercier, Norbert; Sealy, Judith C.; Valladas, Helene; Watts, Ian; Wintle, Ann G. (2002-02-15). "Emergence of Modern Human Behavior: Middle Stone Age Engravings from South Africa". Science. 295 (5558): 1278–1280. Bibcode:2002Sci...295.1278H. doi:10.1126/science.1067575. ISSN 0036-8075. PMID 11786608. S2CID 31169551.
  6. ^ a b Henshilwood, Christopher S.; d'Errico, Francesco; Watts, Ian (2009-07-01). "Engraved ochres from the Middle Stone Age levels at Blombos Cave, South Africa". Journal of Human Evolution. 57 (1): 27–47. doi:10.1016/j.jhevol.2009.01.005. ISSN 0047-2484. PMID 19487016.
  7. ^ Cain, Chester R. (2006-08-01). "Implications of the Marked Artifacts of the Middle Stone Age of Africa". Current Anthropology. 47 (4): 675–681. doi:10.1086/506287. ISSN 0011-3204. S2CID 143150907.
  8. ^ Phakeng, Mamokgethi Setati (2010). African mathematics : from bones to computers. Abdul Karim Bangura. Lanham, MD: University Press of America. ISBN 978-0-7618-5349-7. OCLC 698590244.
  9. ^ a b Visible language : inventions of writing in the ancient Middle East and beyond. Christopher Woods, Geoff Emberling, Emily Teeter, University of Chicago. Oriental Institute. Chicago, Ill.: Oriental Institute of the University of Chicago. 2010. ISBN 978-1-885923-76-9. OCLC 664327312.{{cite book}}: CS1 maint: others (link)
  10. ^ Englund, Robert K. (2011-09-22). Accounting in Proto-Cuneiform. Oxford University Press. pp. 32–50. doi:10.1093/oxfordhb/9780199557301.013.0002. ISBN 978-0199557301.
  11. ^ Schmandt-Besserat, Denise (1996). How writing came about. Denise Schmandt-Besserat (1 ed.). Austin: University of Texas Press. ISBN 0-585-23438-8. OCLC 45727266.
  12. ^ Wilding, Denise; Rowan, Clare; Maurer, Bill; Schmandt-Besserat, Denise; Wilding, Denise; Rowan, Clare; Maurer, Bill; Schmandt-Besserat, Denise (2017-10-27). "Tokens, Writing and (Ac)counting: A Conversation with Denise Schmandt-Besserat and Bill Maurer". Exchanges: The Interdisciplinary Research Journal. 5 (1): 1–14. doi:10.31273/eirj.v5i1.196. ISSN 2053-9665.
  13. ^ Neuman, William (January 2, 2016). "Untangling an Accounting Tool and an Ancient Inca Mystery". New York Times. Retrieved January 8, 2016.
  14. ^ "平成29年度 琉球大学附属図書館・琉球大学博物館（風樹館）企画展 石垣市制施行70周年記念企画展". www.lib.u-ryukyu.ac.jp. Archived from the original on 2021-06-04. Retrieved 2021-06-04.
  15. ^ "Das Arithmeum »Frühere Veranstaltungen» Warazan – Datenspeicher aus Stroh". 2006-02-06. Archived from the original on 2006-02-06. Retrieved 2021-06-04.
  16. ^ "Ancient Chinese Version Of Quipu -Tradition Of Tying Knots Dates Back To Antiquity". MessageToEagle.com. 2017-03-15. Retrieved 2021-06-04.
  17. ^ "新唐書/卷216上" [New book of Tang]. Wikisource. Archived from the original on 14 July 2020. Retrieved 14 July 2020.
  18. ^ D'Altroy, Terence N. (2002). The Incas. Malden, Mass.: Blackwell. ISBN 0-631-17677-2. OCLC 46449340.
  19. ^ Ascher, Marcia; Ascher, Robert (1972-01-01). "Numbers and relations from ancient Andean quipus". Archive for History of Exact Sciences. 8 (4): 288–320. doi:10.1007/BF00328435. ISSN 1432-0657. S2CID 121290006.
  20. ^ Ascher, Marcia (July 1983). "The Logical-Numerical System of Inca Quipus". IEEE Annals of the History of Computing. 5 (3): 268–278. doi:10.1109/MAHC.1983.10090. ISSN 1058-6180. S2CID 16957684.
  21. ^ Ellis, Patrick (2018-01-02). "The Panstereorama: City Models in the Balloon Era". Imago Mundi. 70 (1): 79–93. doi:10.1080/03085694.2018.1382116. ISSN 0308-5694. S2CID 134912917.
  22. ^ Kozlov, Valerii V.; Mitrofanova, M.Yu. (2003). "Galton board". Regular and Chaotic Dynamics. 8 (4): 431. doi:10.1070/RD2003v008n04ABEH000255. ISSN 1560-3547.
  23. ^ Jansen, Yvonne; Dragicevic, Pierre; Fekete, Jean-Daniel (2013-04-27). "Evaluating the efficiency of physical visualizations". Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (PDF). CHI '13. New York, NY, USA: Association for Computing Machinery. pp. 2593–2602. doi:10.1145/2470654.2481359. ISBN 978-1-4503-1899-0. S2CID 8476089.
  24. ^ a b c Brinton, Willard (1939). Graphic presentation. New York city, Brinton associates.
  25. ^ Kirsh, David; Maglio, Paul (October 1994). "On Distinguishing Epistemic from Pragmatic Action". Cognitive Science. 18 (4): 513–549. doi:10.1207/s15516709cog1804_1. S2CID 963901.
  26. ^ Griffin, Trevor (1987-03-01). "Semiology of graphics: diagrams, networks, maps. Bertin, Jacques (trans. W. j. Berg). The University of Wisconsin Press, Madison, 1983. 416 pages. ISBN 0 299 09060 4. US$75.00, cloth". Cartography. 16 (1): 81–82. doi:10.1080/00690805.1987.10438353. ISSN 0069-0805.
  27. ^ "Lego-compatible thesis project board".
  28. ^ T. Kakeda. Tangible bug tracking using lego bricks, Agile 2008 conference, 2008
  29. ^ Edman, Polly (1992). Tactile graphics. American Foundation for the Blind. New York: American Foundation for the Blind. ISBN 0-89128-194-0. OCLC 25675045.
  30. ^ Suzuki, Ryo; Stangl, Abigale; Gross, Mark D.; Yeh, Tom (2017-10-19). "FluxMarker". Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility. ASSETS '17. New York, NY, USA: Association for Computing Machinery. pp. 190–199. doi:10.1145/3132525.3132548. ISBN 978-1-4503-4926-0. S2CID 12207549.
Retrieved from "https://en.wikipedia.org/w/index.php?title=Data_physicalization&oldid=1259747207"