If you haven’t had a chance to check out the installation ‘Calling Thunder: Unsung NYC’ it’s a fantastic example of using digital storytelling methods that connect with hidden hydrology. The project extends the work of the Welikia Project. which provides ecological history of New York along with some great visualizations of pre-development in the form of maps and 3D graphics. A little background comes from the article in the NY Times from April 25th, ‘The Sounds of ‘Mannahatta’ in Your Ear’:
““Calling Thunder,” is an aural bridge across four centuries. It builds on Dr. Sanderson’s stunning work, with Markley Boyer, in creating visualizations of the rolling landscape of 1609 Manhattan — known by the Lenape people as Mannahatta, “the island of many hills” — that are twinned with photographs of the same points in the modern city. We see hills and streams at places now occupied by skyscrapers and subway tunnels; a red maple swamp where an H&M store stands in Times Square.
Drawing on the work on Mannahatta, the immersive video and 360 video and soon VR animate the lovely maps that populated the original books. As one moves through the pre-1600s aerial imagery, it transitions to the modern cityscape, The visuals showcase the heart of the book “…published in 2009, and its classic, bookly virtues — visual beauty, wit and imagination, all underwritten by deep scholarship — persuasively deliver its most astounding revelation: Manhattan in the 17th century had more ecological communities per acre than Yellowstone, more than most rain forests or coral reefs.”
The soundscapes are the best part, a collaboration between “… Bill McQuay, a former sound engineer with NPR who is now an audio producer with the Cornell Lab of Ornithology, and David Al-Ibrahim, an interactive storyteller and graduate student at the School of Visual Arts.” Using sounds from the Macaulay Library at Cornell, the soundscapes piece together species, for instance, in recreating the Collect Pond, the species of American Crow, Marsh Meadow Katydid, Bullfrog, American Bittern, Baltimore Oriole, and Black-capped Chickadee are culled from the site specific ecologies of Welikia and the range of possible species present, which is a fascinating way to experience the site. A snapshot of the area near the Collect Pond Park shows a wide range of species to drawn sounds from,
I was a bit disappointed with the visuals that accompanied the soundscapes, simple, abstract, placeless sketches that distracted, more than accentuated the experience. Looking around, one wished the simple site-specific scenes were rendered in the same graphic style as the larger renderings, only more animated scenes with residual movement, wind, rustling leaves, and environmental cues that evoke the historical places, perhaps transitioning between new and old.
Maybe a fitting next stage for the project, a simple immersive VR experience could be done without a lot of work, but the sketches aren’t going to cut it. The goal of capturing a vision of what was and what is, with a measure of interactivity that heightened awareness of the habitat sounds would be attainable, as seen through the myriad . I found that closing your eyes and immersing in the sounds was the best way to experience this. The dilemma is hinted at in the article: “At first, Mr. Al-Ibrahim said, he considered presenting only the sound from each of the sites. “It turns out people don’t respond well when put in pitch blackness with a headset on,” he said. By offering readers and listeners the choice of technologies, the project sidesteps the trap of endorsing one storytelling technique to the detriment of the actual message.”
The method of disseminating historical ecology, and pair the experience with soundscapes showcases. As a quote from Sanderson mentions, which is clear from the work on Welikia and Mannahatta, the abundance of species. For a city known as one of the most dense and urban, the previous natural resource is somewhat surprising. This is the beauty of connecting the past and the present.
As mentioned, “The Unsung website offers various ways to take in the weave of history, research and informed speculation in “Calling Thunder,” each with its own rewards: as a simple audio recording, 360-degree video, or, coming soon, virtual reality.” I can’t wait to see the next installment and appreciate the inspiration of full-sensory experiences.
