MINI REVIEW article

Front. Earth Sci., 18 November 2020

Sec. Solid Earth Geophysics

Volume 8 - 2020 | https://doi.org/10.3389/feart.2020.590295

Holding the Cosmos in Your Hand: Developing 3D Modeling and Printing Pipelines for Communications and Research

  • NASA's Chandra X-ray Observatory, Center for Astrophysics, Harvard and Smithsonian, Cambridge, MA, United States

Article metrics

View details

5

Citations

5,6k

Views

1,3k

Downloads

Abstract

Three-dimensional (3D) visualization has opened up a Universe of possible scientific data representations. 3D printing has the potential to make seemingly abstract and esoteric data sets accessible, particularly through the lens of translating data into forms that can be explored in the tactile modality for people who are blind or visually impaired. This article will briefly review 3D modeling in astrophysics, astronomy, and planetary science, before discussing 3D printed astrophysical and planetary geophysical data sets and their current and potential applications with non-expert audiences. The article will also explore the prospective pipeline and benefits of other 3D data outputs in accessible scientific research and communications, including extended reality and data sonification.

Introduction

This paper will summarize recent achievements made in astronomy, astrophysics, and space science using three-dimensional (3D) technology to help reach beyond expert audiences, and discuss best practices that can be shared with other sciences such as geophysics. This type of 3D work also allows for new media—both virtual and in tangible physical form—to help non-experts interact with and learn about these discoveries. We contend that the lessons learned from these space-based 3D projects could have broader impacts for many fields throughout science, technology, engineering, and mathematics (STEM) fields and provide educational benefits to a great number of people.

Parallel advances in acquiring 3D data from Earth and space and in 3D printing mean that today technologists can translate digital data into something that we can touch and feel, expanding the ways we can understand and communicate science, including with diverse communities including the blind or visually impaired (BVI) (Trotta et al., 2020). Currently, the amount of astronomical and planetary geological objects able to be 3D printed is low compared to the vast range of objects being studied (Arcand et al., 2017). One practical challenge is making 3D modeling easier and more accessible as a research tool. This issue can be improved with the advent of enhanced data from the next generation of more technically advanced telescopes and sensors (Gerloni et al., 2018). Creating awareness among scientific researchers of 3D data representation is also essential to increasing this technique’s frequency and convenience of use.

This article describes recent innovative 3D processes and explores the developing pipelines and contributions of 3D visualization outputs in multimodal scientific study and communications. 3D printing, for example, is a potential place of interaction between terrestrial and space science through representations of discipline-specific and interdisciplinary data alike, aimed at both non-experts and experts that can use specific accessible outputs and products. Indeed, best practices for 3D printing of scientific data can and should be shared across traditionally separate disciplines.

Astronomical and other scientific information can be shared through various human senses including touch, smell, and even taste (Trotta, 2018). The use of, and meaning-making from, scientific visualizations and related expressions of data “depend strongly on who is viewing” (Steffen, 2016, para. 4) or interpreting them. Consequently, accessibility and diversity are a critical area of emphasis for this topic, and we will summarize current evidence of and future needs for the impact of 3D visualization on enhancing equity via modeling and printing. Our analysis briefly encompasses extended reality (XR)—a suite of multisensory applications which typically involves augmented, virtual, and mixed reality formats (Najjar, 2020) for diverse communities of users.

The COVID-19 pandemic has shown the potential for 3D modeling and printing—from making personal protective equipment to respirators1 and ventilators (e.g., Molitch-Hou, 2020) to understanding the structure and impact of the coronavirus through 3D printing (Grove, 2020) and virtual reality (VR) (e.g., Pearson, 2020). Although geophysics and astrophysics data typically cover very different phenomena, they can benefit from multidimensional data delivery to diverse audiences during times of disruption and beyond.

3D Visualizations and Related Outputs

Learning about the mental manipulation of 3D images is an important step in the process of science education in both astronomy (Eriksson et al., 2014) and geology (Carneiro et al., 2018). 3D modeling skills can form the basis of a framework for teaching astronomy and related topics in a manner that enables non-experts to use and understand the same visual and conceptual assets as professional astronomers (Eriksson, 2019). Multidimensional models are also useful as teaching tools in geophysics to share the textures and geological arrangement of surfaces including sedimentary basins with students and the public (Carneiro et al., 2018). Simultaneously, the ability to research celestial or geophysical objects from multiple angles and viewpoints can help improve understanding of how scientific objects are structured or how the underlying physics works (Ferrand and Warren, 2018), making them a valuable tool. Once a 3D visualization has been created, there are multiple output potentials from interactive 3D digital models or physical 3D prints to immersive XR experiences (Arcand et al., 2018). 3D printing and other outputs involving touch can help encourage more “control” (Isenberg, 2013) and interactivity on behalf of users (Madura, 2017) than computerized 3D visualization usually allows.

3D printing is a process where a type of material such as plastic, metal, or an organic substance is continually added layer by layer to formulate the object (Grice et al., 2015). Recently, “on-demand processes” of 3D printing—typically characterized as fused deposition modeling—have become increasingly accessible and affordable for consumers (Takagishi and Umezu, 2017), including those in libraries and related educational and community settings. This opens the opportunity to produce scientific or educational tools in these learning environments that may have been unachievable before (Hasiuk et al., 2017). On consumer scales, 3D printing is still rather new, but the production possibilities are far-reaching. 3D printing applications in science range from plans for an on-demand and sustainable lunar base 3D printed from Moon dust (De Kestelier et al., 2015) to medical 3D printing of skin cells to help treat burn victims (Everett-Green, 2013; Brown, 2017).

The prominence of VR as an entertainment product in recent years has made such technologies more widely available for scientific communications and research in astronomy as well (Baracaglia and Vogt, 2020). Due to the extensive time and technical effort often needed to develop VR applications for astronomical or geological objects, modifiable generic VR templates could be helpful for the scientific community, and could help spark greater adoption for observational exploration (Baracaglia and Vogt, 2020). VR is another 3D tool that can potentially be used by scientists for visualizing the immense amount of “big data” making up modern astronomy, in particular for data mining, detection, removal, and quick-look rendering (Comparato et al., 2007; Donalek et al., 2014). Interactive VR is also able to take advantage of human depth perception as an ergonomic factor that enables quick identification and characterization of complex structures (Steffen, 2016). Augmented reality (AR), which overlays digital elements onto a user’s perception of the surrounding world, and VR can be important support tools in the processing of massive and complex scientific data sets. However, for any XR product, individual differences in the way people experience multimodal information should be taken into account (Olshannikova et al., 2015).

Importance of Audience in Scientific Visualization: Inclusivity and Diversity

Astronomy and astrophysics (Rector et al., 2015) and geology and geophysics (Pound, 2019) are often recognized as highly visual fields both historically and today. This can create challenges in sharing data from these disciplines with BVI audiences. Evaluative studies have shown benefits in using 3D astrophysical models (Christian et al., 2015; Grice et al., 2015; Bonne et al., 2018; Arcand et al., 2019; Argudo-Fernández et al., 2020) for generating or positively impacting learning gains, inclusive practices, STEM identity, and mental visualization. Applications of 3D models in geology and geophysics have been demonstrated for use in museums and similar informal learning environments (Neitzke Adamo et al., 2019) and by other educators (Hasiuk et al., 2017).

In the past several years, research has shown that 3D printed scientific data from astrophysics and geophysics with tactile features can help communicate with BVI participants across a spectrum of abilities (Bonne et al., 2018) as well as with sighted people (European Southern Observatory, 2019), and also to promote inclusivity more broadly (Christian et al., 2015; Arcand et al., 2019). XR technologies particularly have been broadly shown to provide low-risk, high-impact virtual spaces that can accommodate physical barriers to interaction by providing learner-specific experiences (Chandrashekar, 2018), when crafted particularly through universal design techniques (McMahon and Walker, 2019; Menke et al., 2020).

Human and interpersonal issues must be considered in order to enable meaningful use of 3D prints and dynamic virtual spaces for science communication with BVI and other audiences. Audience awareness and the resulting specific development of visualizations with audience needs in mind is critical for the development of inclusive practices in 3D visualizations, facilitated by 3D printing and other emerging technologies (Díaz-Merced et al., 2011; Steffen et al., 2011; Díaz-Merced, 2013; Díaz-Merced, 2014; Steffen et al., 2014; Christian et al., 2015; Grice et al., 2015; Madura et al., 2015; Madura, 2017; Hurt et al., 2019).

Across the United States (Smithsonian Institution, 2014; ADA National Network, 2019) and around the globe (United Nations Disability, Department of Economic and Social Affairs, 2006), there are firm legal requirements to provide and maintain access to information, communication, and participatory opportunities for people with disabilities. Differently-abled populations need to be able to discover and share information in a way directly equivalent to how others complete such tasks (United Nations Disability, Department of Economic and Social Affairs, 2006). People with visual impairments, for example, exist with a specific spectrum of needs that can be affected by variables such as the timing and cause of their blindness’ onset (National Federation of the Blind and Finkelstein, 1994) or the amount of Braille literacy instruction (National Federation of the Blind Jernigan Institute, 2009).

Therefore, any effort should take into account how to effectively disseminate 3D prints and related Braille or tactile materials. Incurred costs can be problematic for organizations and individuals (Weferling, 2007; Beck-Winchatz and Riccobono, 2008; Arcand et al., 2019) as well as intended audiences, including BVI communities. These issues are particularly relevant during times of disruption and upheaval, as illustrated during the COVID-19 pandemic (McEvoy, 2020).

Key Examples of 3D Visualizing in Planetary Geophysics and Astrophysics

Planetary geology and geophysics are particularly well suited areas of study for the development of 3D visualization outputs including 3D models, 3D prints, and XR. 3D visualizations of the Earth can clarify geological phenomena to the public (Kyriakopoulos, 2019), while also supplementing instruction (Koelemeijer et al., 2019) and making it more accessible (Dolphin et al., 2019) In exoplanet research, studies on the habitability of exoplanet bodies like the TRAPPIST-1 system2 (NASA, 2019; Jet Propulsion Laboratory, 2020), and synthetic exoplanet systems (Alesina et al., 2018) have led to head-set based VR experiences for expert and non-expert audiences. 3D models have been useful in the study of asteroids (Kim, 2018) and aspects of other planetary bodies such as the atmospheres of Venus (Korycansky et al., 2002) and Titan (Charnay et al., 2014) as well as landscape evolution (Cornet et al., 2017). A wealth of data on our nearest neighbors, our Moon and Mars, has resulted in extensive 3D mapping of the various local topographies and geological structures (Edwards et al., 2005; Löwe and Klump, 2013; Ellison, 2014; Mars Exploration Rovers, 2014; Gwinner et al., 2015), and morphometric globes (Florinsky and Filippov, 2017) of these objects with outputs of 3D visualizations, primarily for scientific analysis.

In astronomy and astrophysics, data and simulation driven 3D printed objects include multiple object types across a range of scales. In high-energy astrophysics, supernova remnants have been particularly conducive to 3D modeling, encompassing such examples as Cassiopeia A (Arcand et al., 2017; Arcand et al., 2018; Arcand et al., 2019; DeLaney et al., 2010; Orlando et al., 2016), Tycho’s supernova remnant (Chandra X-ray Observatory, 2019; Ferrand et al., 2019), Supernova 1987a (Arcand et al., 2017; Orlando et al., 2018; Arcand et al., 2019), and the Crab Nebula (Figures 1A,B) (Arcand et al., 2020; Summers et al., 2020). Beyond supernovae, other areas of 3D research and output range from star formation regions such as M16 (McLeod et al., 2015), a massive star system with colliding winds called Eta Carinae (Steffen et al., 2014; Madura et al., 2015; Arcand et al., 2017; Madura, 2017), double star system V745 Sco (Chandra X-ray Observatory, 2017; Arcand et al., 2019), protostellar jets like DG Tau (Ustamujic et al., 2016; Ustamujic et al., 2018; Orlando et al., 2019; Chandra X-ray Observatory, 2020a), and beyond to much larger structures including the South Pole Wall (Pomarède et al., 2020), the Cosmic Web (Diemer and Facio, 2017) and the Cosmic Microwave Background (Clements et al., 2016; Arcand et al., 2017).

FIGURE 1

FIGURE 1

The Crab Nebula is the remnant of a massive stellar explosion, or supernova, that was seen on Earth in 1054 AD. The nebula is about six light years across, or 60 trillion kilometers, and expanding outward at about 3 million miles/h. At the center of the bright nebula (A) is a rapidly spinning neutron star, or pulsar, that emits pulses of radiation 30 times a second. In this 3D print (B) of the inner region of the nebula is a ringed disk which is made up of energized material. Additionally, there is a pair of jets of particles firing off from opposite ends of the pulsar (the pulsar is hidden inside the ringed disk). Credits: 2D Image: NASA/CXC/SAO; 3D file: NASA/STScI/F. Summers et al.; NASA/Caltech/IPAC/R. Hurt; NASA/CXC/SAO/N. Wolk et al.; 3D Print: NASA/CXC/SAO/A. Jubett, K. Arcand et al.

Multidimensional renderings of astronomical and geological data in accessible formats can simplify the discovery of previously hidden or overlooked structures in objects and, through the presence of interactive features, can enable close-up views of data via a personalized perspective (Madura, 2017). This variety of technologies that have proven useful for accessible public engagement has helped to clarify the context of current observational science data (Madura et al., 2015; Arcand et al., 2017). The catalog of data-driven astrophysical or geological models continues to grow (Hurt et al., 2019), and can be used in communicating contemporary science with non-expert audiences (Löwe and Klump, 2013). Additionally, artistic imaginings with scientific underpinnings (Pauwels, 2020), in contrast to data-driven or simulation based 3D models, can tangibly provide perceptual value in communicating information that can be abstract, esoteric, or perhaps invisible to the human or robotic eye (Keefe et al., 2005) particularly in this area of multidimensional visualization.

One important factor for the accessibility of 3D models, particularly with non-experts, is the availability of open access or creative commons data. The National Aeronautics and Space Administration (NASA)3 and the Smithsonian Institution (Pearlman, 2020), for example, each maintains open access or public domain databases of 3D objects, ranging from supernova remnants to geological maps of the Apollo lunar landing sites. Open access and creative commons materials can reduce complexities or legalities regarding the adaptation of content to customized learning experiences for multiple audiences (Zhang et al., 2020). Flexible, customizable materials, derived from openly accessible materials, can potentially improve experiences for all learners, particularly for those with special access requirements (Zhang et al., 2020).

Discussion

3D Visualization Pipelines

Once a 3D visualization has been created, there are myriad options for how to output that data into a usable product, specific to an intended audience. This underlines the importance of understanding and establishing pipelines in creating 3D data sets, whether ultimately working with files types from .vtk to .obj to .stl. to .unity3d or beyond, for scientific research or for scientific engagement. Narrative information should be provided to interpret context and scale.

Extended Reality Technology Examples Related to the Data Pipeline

Preliminary astrophysical VR applications of simulated worlds (such as Farr et al., 2009) through recent astronomical VR experiences as individual applications (e.g., Russell et al., 2017; Arcand et al., 2018; Ferrand and Warren, 2018; Chandra X-ray Observatory, 2020b), include artistically illustrated worlds, simulated data mapped to astronomical observations, and three-dimensional models derived from scientific observations. Users can comb Martian surfaces based on observational data from NASA’s Jet Propulsion Laboratory (2017), travel to the TRAPPIST-1 exoplanets via scientifically-influenced 3D artists’ impressions that were converted into VR applications (NASA, 2019), and explore the solar surface based on observational data from the Hinode spacecraft (Hinode Science Center at NAOJ, 2018). Explorers equipped with emerging technologies can also virtually walk inside the remains of an exploded star (Arcand et al., 2018) or experience a spiral galaxy like NGC 3198 via radio data cubes (Ferrand et al., 2016). Computational models and simulations constrained by scientific observations also provide numerous options for VR application development, including simulation and time-domain based applications of Sagittarius A, the supermassive black hole at our Galactic Center (Russell, 2017; Davelaar et al., 2018).

Expert analysis of scientific data in XR spaces can provide active and immersive simulations of astrophysical topics like photometry of the billions of stars in our Milky Way (Ramírez et al., 2019). And at even greater scales, cosmological topics such as dark matter can be rendered in VR with particular attention towards accessibility, for example haptic (vibrational) cues that work together with wheelchair use (Aviles, 2018). Current research into, and evaluation of, such immersive projects that take advantage of human perception in 3D spaces are investigating potential outcomes in enabling better detections and manipulations of large or complex data sets on behalf of the scientist (Ferrand et al., 2016). Additionally, in geology and geophysics there are projects across topographical maps (Woods et al., 2016), geological surveys (Westhead et al., 2013) and other ways to provide 3D data in a digestible way to “enable non-expert users to begin to interact with a complex science in an expert way which was not possible for previous generations” (Westhead et al., 2013, p. 189; see e.g., Mathiesen et al., 2012; Gerloni et al., 2018; Trexler et al., 2018).

Data sonification is another example of a potential extension or output of 3D data sets. Sonification can help improve upon analysis of big data through vision alone by taking advantage of the unique capacities of sound to provide information from different dimensions simultaneously, with quick interaction or playback (Cooke et al., 2017). This strategy can work with XR in order to speedily evaluate features of 3D data (Ribeiro et al., 2012). Díaz-Merced (2013) demonstrated that listening function can be improved through targeted interventions as applied to such data sonification outputs. Beyond data sonification there are additional 3D visualization outputs and enhancements that can be considered to reach specific audiences, from holograms (Royal Astronomical Society, 2019) and haptic information (Isenberg, 2013; Trotta et al., 2020) to tactile tablets (Touch Graphics, Inc., 2015) and multisensory experiences (Najjar, 2020).

Conclusion

At this time, the COVID-19 pandemic continues to result in monumental challenges that reach nearly every aspect of life. The pandemic does not spare the fields of science research, visualization or engagement, but instead presents particular obstacles—and opportunities—to these areas. Some of the recent difficulties related to the use of 3D printed materials include reliance on tactile surfaces while combating a virus that can spread through surface contact (Centers for Disease Control and Prevention, 2020) and a reduction in tangible resources presently available to populations who need enhanced accessibility, such as BVI audiences (McEvoy, 2020). However, due to social distancing there is now a greater demand than ever before in modern times for remote learning and work. The 3D astrophysical and geophysical models, prints, and virtual spaces could serve scientists, educators, learners and others who are unable to spend their usual time in physical settings. We propose partnering with groups who both advocate for and engage with affected audiences so the science and engagement communities can best serve the needs of their audiences.

Funding

This paper was written with funding from NASA under contract NAS8-03060 with the authors working for the Chandra X-ray Observatory. NASA’s Marshall Space Flight Center manages the Chandra program. The Smithsonian Astrophysical Observatory’s Chandra X-ray Center controls science and flight operations from Cambridge and Burlington, MA.

Statements

Author contributions

KA, as the principal investigator, provided the main points, literature references and scientific topics, as well as technical writings for the article. SP, as the research assistant, formatted the outline and citations, organized the literature review, and provided summative text on specific subsections. MW provided detailed editing and drafting, gave input on overall organization, and wrote summary texts as needed.

Acknowledgments

The Authors gratefully acknowledge Lisa Frattare for her stellar copy editing skills. The Authors also acknowledge the Chandra communications and public engagement group members, NASA’s Universe of Learning, and the many scientists, technologists and researchers that have contributed to the ever growing library of 3D printed objects of our Universe.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/feart.2020.590295/full#supplementary-material

Footnotes

1.^https://medeng.jpl.nasa.gov/covid-19/respirators/ (Accessed June 26, 2020).

2.^http://www.spitzer.caltech.edu/vr (Accessed June 17, 2020).

3.^https://nasa3d.arc.nasa.gov/models (Accessed June 16, 2020).

References

Summary

Keywords

3D printing, 3D visualization, virtual reality, astrophysics, geophysics, science communication, inclusivity

Citation

Arcand KK, Price SR and Watzke M (2020) Holding the Cosmos in Your Hand: Developing 3D Modeling and Printing Pipelines for Communications and Research. Front. Earth Sci. 8:590295. doi: 10.3389/feart.2020.590295

Received

31 July 2020

Accepted

21 October 2020

Published

18 November 2020

Volume

8 - 2020

Edited by

Paula Koelemeijer, Royal Holloway, University of London, United Kingdom

Reviewed by

Bernhard Maximilian Steinberger, Helmholtz Centre Potsdam, Germany

Luciana Bonatto, University of La Serena, Chile

Updates

Copyright

*Correspondence: Sara R. Price,

This article was submitted to Solid Earth Geophysics, a section of the journal Frontiers in Earth Science

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics