Tidmarsh is a 600-acre property near Plymouth, Massachusetts. After over a century as a large operational cranberry farm, Tidmarsh has undergone construction to transform it back to wetland and is now the Mass Audubon Tidmarsh Wildlife Sanctuary. Researchers in the Media Lab's Responsive Environments group are developing sensor networks that document ecological processes and allow people to experience the data at different spatial and temporal scales. Small, distributed, low-power sensor devices capture climate, soil, water, and other environmental data, while others stream audio from high in the trees and underwater. Visit any time from dawn till dusk and again after midnight; if you're lucky you might just catch an April storm, a flock of birds, or an army of frogs.
Many current projects in the group are making use of the Tidmarsh site and the data. The flagship project is a cross-reality sensor data browser constructed using the Unity game engine to experiment with presence and multimodal sensory experiences. We're looking for new ways to explore and experience data about the environment. Built on LIDAR-scanned terrain data, the virtual Tidmarsh experience integrates real-time data from the sensor networks with real-time audio streams and other media. The soundtrack is based on real-time sensor data—flashes and ukulele notes occur when new data comes from each sensor. The music is driven by the sensor readings: higher pitches indicate warmer temperatures, for example.
This work is part of the Living Observatory, a learning collaborative of scientists, artists, and wetland restoration practitioners engaged in the documenting, interpreting, and revealing aspects of change as it occurs prior to, during, and following the Tidmarsh Farms Restoration Project, the largest freshwater wetland restoration project to date in Massachusetts.
- Deep Learning Locally Trained Wildlife Sensing in Real Acoustic Wetland Environment. Clement Duhart, Gershon Dublon, Brian Mayton and Joseph Paradiso. In Communications in Computer and Information Science, ISSN 1865:0929 Springer. September 2018. Best Paper Award - SIRS’18.
- Sensor(y) Landscapes: Technologies for New Perceptual Sensibilities. (Ph.D. Thesis). Gershon Dublon — June 2018.
- The Networked Sensory Landscape: Capturing and Experiencing Ecological Change Across Scales. Brian Mayton, Gershon Dublon, Spencer Russell, Evan F. Lynch, Don Derek Haddad, Vasant Ramasubramanian, Clement Duhart, Glorianna Davenport, and Joseph A. Paradiso. Presence: Teleoperators and Virtual Environments, 26(2), MIT Press, 2017.
- Resynthesizing Reality: Driving Vivid Virtual Environments from Sensor Networks. Don Derek Haddad, Gershon Dublon, Brian Mayton, Spencer Russell, Xiao Xiao, Ken Perlin, Joseph A. Paradiso. Presented at SIGGRAPH17 30 July - 3 August, Los Angeles, CA