The Virtual UCF Arboretum Research Project

UCFArboretumFigure 1: The Virtual UCF Arboretum Virtual Nature Model and Educational Simulation, credits: The Harrington Lab, UCF, 2018.

About:

The Virtual UCF Arboretum (2016- present), project is a Virtual Nature model annotated to work as an educational simulation. Constructed as a large open world, using sparse GIS data sets required for information fusion and domain expertise to achieve accuracy and realism, the data was visualized with photorealism accuracy to match the real environment.  All photorealistic 3D plant models are botanically correct, and each is dispersed by real plant population data to reach parity with the real. The one hector virtual model was constructed in the Unreal game engine. The virtual environment is unique as it integrates a complementary website, a digital media plant atlas on facts and concepts to allow point of interest inquiry at the moment of individual personal curiosity.

The Virtual UCF Arboretum project is an augmented reality (AR) and virtual reality (VR) collaboration between the Nicholson School of Communication and Media, in the College of Arts and Humanities, and the UCF Arboretum, Landscape and Natural Resources in the Department of Biology, in the College of Sciences, at the University of Central Florida.

History:

Launched in the fall of 2016, photographs and video of the real UCF Arboretum were gathered in this wild and beautiful place on the university campus. The project's mission is to provide beautiful and accurate educational material on plants and wildflowers in Florida to schools and to the public free of charge, and as a research and cybe-infrastructure system development effort to inform best practices in digital media design for educational impact. More broadly envisioned, this research program aims are to investigate truth and beauty through art and science and on the human and cultural transformations made possible with the execution of accurate data visualizations of virtual nature in real time interactive game engines and sparse GIS data sets.

In the spring of 2017, undergraduate students joined the effort as research assistants to help build the digital media. Work started on building the website and the 3D models for use in augmented and virtual reality educational applications.

In the summer of 2017, undergraduate students joined a multidisciplinary team to create content and art for a full prototype. The 2017-2018 year focused on the completion of about 35 AR/VR ready 3D plant models and reviewed with botanists and scientific experts with the Arboretum to ensure accuracy. All models were posted on SketchFab.com for review and publication access with the educational website: https://sketchfab.com/VirtualUCFArboretum

A major deliverable is the ability to use all of the models with inexpensive VR headsets, such as Google Cardboard (https://vr.google.com/cardboard/)  and most smartphones for educational lessons, anywhere and anytime, some now with AR technology.

All models are ready for use with smartphones capable of such functionality, ideal for use in educational programming with museums or science centers, schools, and homes everywhere, much like the Google Expedition program (https://edu.google.com/expeditions/#how-it-works )

The models allowed the Unreal Engine team to build and deliver a large open world model on AWS, based on GIS data of plant populations and locations representative of the real UCF Arboretum. The first prototype was demonstrated at the NASA Young Investigators Workshop held January 2018 in Galveston, TX.

Over the summer of 2018, the virtual team of  students continued to refine and develop optimized 3D plant models for large open environments, and worked on VR tests and probes for the light weight AR plant models required for use in the field.  The open world model is an information fusion of sparse GIS data, terrain data, plant population data sets from field  work of the UCF Arboretum, drone images, and accurate plant models, all used to simulate one hector (1,000 meters x 1,000 meters) of the 800 acre real UCR Arboretum. The model was constructed in the Unreal Game Engine to run at acceptable FPS levels.

Programing and integration of the Unreal model with the website was completed in the fall of 2018 to support learning at points of interest, linking all 35 plants in the game engine to the educational facts and concepts on the website.  Thus, combining a highly realistic, high fidelity, accurate information data sets in a virtual nature environment, a Virtual Nature model for use in for art, research, and education.

Artistic refinement of details was achieved through visual inspection of photographs to bring the model to life. Ambient life,  such as butterflies, dragonflies, fish, and American Bald Eagles complete the model. The textures for the insects were kindly provided by the UCF Bug Closet.

The Harrington Lab

The Harrington Lab at UCF investigates virtual nature, using AR and VR as a technical artifact, to better understand perceptual phenomenon as it relates to human-computing-environment interactions that cause emotional, learning, and aesthetic outcomes. The lab is highly collaborative with several active multidisciplinary partnerships. Efforts focus on extending prior work in the development of Simulated Ecological Environments for Education (SEEEs) used for research and art. The lab is under the direction of Dr. Harrington at the University of Central Florida.

The Harrington Lab Digital Media Team

It is all about teamwork! True partnerships require shared values, shared vision, and complementary skills!

Primary Creators and Contributors for the Unreal Engine model:

  • Zachary Bledsoe: Current:   Leidos, 3D Modeler, Undergraduate Research Assistant: Team Lead, Environmental Artist, 3D Artist and Modeler, Unreal Engine Production Pipeline Lead, August 2017 – August 2018. Internship, Carnegie Museum of Natural History, AR Diorama Exhibit, Pittsburgh PA, January 2018 – May 2018
  • James Miller: Undergraduate Research Assistant: Lead Developer and Programmer, Unreal Engine, January 2018 – August 2018.
  • Chris Jones: Current: Independent contractor with CMNH, Powdermill Nature Reserve, Undergraduate Research Assistant: Lead 3D Artist and Modeler, Environmental Artist, and Unreal Engine, October 2017 – August 2018. Internship, Carnegie Museum of Natural History, AR Diorama Exhibit, Pittsburgh PA, January 2018 – May 2018.
  • Thomas Pring: Undergraduate Research Assistant: Programmer, Unreal Engine, HTC VIVE, January 2018 – Present.
  • Kellie Beck: Undergraduate Research Assistant: Arboretum Content Liaison, Graphic Designer, and Website and WordPress Developer, January 2016 – Present.


Past Members: work not included in the Unreal model, but engaged in learning and skill development:

  • Jeremy Blake: Undergraduate Research Assistant, Environmental Artist, 3D Artist, Modeler, Unreal Engine Art. October 2017May 2018.
  • Bailey Estelle: Undergraduate Research Assistant, Environmental Artist, 3D Artist, Modeler, Unreal Engine Art. October 2017 – May 2018.
  • Sebastian Hyde: Undergraduate Research Assistant, Environmental Artist, 3D Artist, Modeler, Unreal Engine Art. October 2017 – December 2017.
  • Seun (Oluwaseun) Ademoye: Current: UCF FIEA Instructor. Undergraduate Research Assistant, 3D Artist, Modeler, and Character Animation, 2017.
  • Yasiman Ahsani: Current: Epic Games, Unreal Engine, Environmental Artist. Undergraduate Research Assistant, Environmental Artist, 3D Artist, Modeler, and Unreal Engine Production Pipeline Lead, 2017.
  • Katherine Ryschkewitsch: Undergraduate Research Assistant, 3D Artist, Modeler, and Character Animation, 2017. Current: Mountain Savage Games, LLC, Character Designer
  • Marchand Venter: Current:  The Florida Interactive Entertainment Academy Masters Program at UCF, and past at Rockwell Collins. Undergraduate Research Assistant, Environmental Artist, 3D Artist, Modeler, and Unreal Engine Production Pipeline Lead, 2017.
  • Aubri White: Undergraduate Research Assistant, Environmental Artist, 3D Artist, October 2017 – May 2018.

 

UCF Arboretum

My warmest thanks to the entire group, Patrick Bohlen the UCF Director of Landscape and Natural Resources and Arboretum, Jennifer Elliott the Assistant Director, Raymond Jarrett, one of the most knowledgeable botanists and biologists I know, Amanda Lindsay a biologist with amazing knowledge, foresight and initiative, and John Guziejka a biologist with a gift for fun and informative interpretive narratives. In the fall of 2016, we gathered over 50 GB of field data on over 36 native local plants, and over 20 video narratives on site with their help. All 3D plant models were vetted and approved by the botanists and all environmental data sets were provided by this magnificent team.

  • Dr. Patrick Bohlen: Director of Landscape and Natural Resources and Arboretum
  • Jennifer Elliott: Assistant Director, Natural Resource and Arboretum Programs
  • Ray Jarrett: Coordinator of Urban Forestry and Land Management Programs
  • Amanda Lindsay: Senior Biologist
  • John Guziejka: Biologist / Urban Forester
  • Rafael Pares: Media Producer

 

Figure 2: VR 3D Model of the Forked Blue Curl (Trichostema dichotomum), 3D artist credit: Katherine Ryschkewitsch.