Embodied Simulation

‘Embodied Simulation’ is a multiscreen video and sound installation that aims to provoke and nurture strong connections to the global ecosystems of which we are a part. The work combines artificial intelligence with dance and research from neuroscience to create an immersive, embodied experience, extending the viewer’s bodily perception beyond the skin, and into the environment.
The cognitive phenomenon of embodied simulation (an evolved and refined version of ‘mirror neurons’ theory) refers to the way we feel and embody the movement of others, as if they are happening in our own bodies. The brain of an observer unconsciously mirrors the movements of others, all the way through to the planning and simulating execution of the movements in their own body. This can even be seen in situations such as embodying and ‘feeling’ the movement of fabric blowing in the wind. As Vittorio Gallese writes, “By means of a shared neural state realized in two different bodies that nevertheless obey to the same functional rules, the ‘objectual other’ becomes ‘another self’.”

Shell of

FILE 2024 | Installations
International Electronic Language Festival
Marc Vilanova – Cascade – Spain

Waterfalls are a continuous source of infrasonic frequency found in nature. Although inaudible to humans, they play a crucial role in ecosystems, especially for migratory birds who use them as a compass. However, many waterfalls have lost their frequencies due to climate change. The work creates an immersive experience in which the audience interacts with the visualization of sound waves, experiencing the vibration of sound through illuminated strings.

Bio

Marc Vilanova is a sound and visual artist who works at the intersection of art, science and nature. Vilanova’s artistic production has always been led by a spirit of innovation fueled by an interest in new media. His practice combines sound/light installations, performance, and sculpture.

Credits

This work was partially carried out within the scope of the EMAP program at gnration, with the support of the Creative Europe Culture Programme, the Avatar Center in Quebec City and the Ramon Llull Institute.

Photo:
Eloise Coomber

Speculative Evolution, Prototype 1

FILE 2024 | Installations
International Electronic Language Festival
Speculative experiment on a future ecosystem under strict control. The narrative takes place in a simulation, 30 years in the future, where artificial intelligence and synthetic biology collaborate to optimize an environment for cultivated species. An AI-powered simulator helps visitors generate new species to balance the ecosystem. Inspiration comes from the book Under the White Sky by Elizabeth Kolbert and artists’ stories about life on a damaged planet.

Bio

Marc Lee is a Swiss artist focused on real-time rendered audiovisual installations, AR, VR and mobile applications, critically exploring creative, cultural, social, ecological, political and speculative themes. His work has been exhibited in important museums and new media art spaces. Shervin Saremi is an Iranian musician and audio engineer specializing in sonic computing, procedural sound design and production. Currently researching immersive audio at UdK Berlin.

Bare Life
Bare Life depicts a loosely structured, contested concept of freedom tied to various cases and agents: killing and being killed, machines recognizing pain, and the complex ecosystem of empathy that occurs in response.

Colourfield
Colourfield is an evolutionary ecosystem of colour. Colour agents try to exist in a simple universe by producing colours that are suited to their environment. This environment is determined by the other agents and the colours they produce. Entering into complex feedback cycles, Colourfield presents an evolving palette of shifting colours. Different configurations emerge based on the strategies the ecosystem discovers for co-existance and co-dependency. Harmonious configurations often remain stable for a short while, before eventually being replaced by new relations, better able to survive in the ever shifting environment.

Networked Ecosystem
In Networked Ecosystem, natural phenomena have been replaced by digital and artificial systems as forces that drive development: Electricity/battery = sustenance, WIFI signals = nutrition, Lidar data = fire/heat. Data Organisms populate this digital ecosystem as native life forms in the form of bots, AI’s, and avatars. Visitors to this networked landscape develop new kinds of digital senses to experience data as environmental changes, and interact with the simulated world and each other in an ever-changing online environment.

Infinite Herbarium
Infinite Herbarium heeft tot doel onze ervaring van de uitgestrekte, diverse botanische wereld uit te breiden – door connectiviteit te creëren met planten en hun bedreigde ecosystemen. Via een proces van interactief leren en kunstproductie worden de ontmoetingen van deelnemers met echte planten gefilterd door datasets en historische archieven met behulp van een combinatie van Machine Learning (ML)-technieken. Verbindingen tussen botanie, data en kunst leiden tot fantasierijke ontmoetingen met merkwaardige hybride soorten – het creëren van een digitale weerspiegeling van de constante stroom van levende systemen.

LIFE SUPPORT SYSTEM (AKA. THE FARM)
This artistic provocation seeks to estimate the orders of magnitude of critical ecosystem services fundamental to all planetary life processes. This experiment consists of 1 square meter of wheat, cultivated in a closed environment. Critical inputs such as water, light, heat, and nutrients are measured, monitored and displayed for the public. This procedure makes palpable the immense scale of ecosystem contributions, and provides a speculative reference for a reckoning of the undervalued and over-exploited “work of the biosphere.”

Vertical Migration
Unsettling our perceptions of scale and otherness, Vertical Migration is an intimate encounter with a life form that bears no resemblance to human beings, though we share a planet, an ecosystem, and a future. Because of sea-level rise, humans will also be migrating vertically in the coming centuries, to higher elevations and raised buildings. The siphonophore’s story is our story. Though we can never experience its journey through the pitch-black ocean depths, we can shift our perspective to recognize that we’re connected, that our actions affect each other, and that we share a common fate.

FLORALIA I
Inspired by the writings of Donna J. Haraway, Ursula K. Le Guin, and Greg Egan, the work plunges us into a speculative future, where samples of then extinct plant species are preserved and displayed in a virtual archive room. Through editing and visual strategies, this archive room is sporadically transformed under the effect of interference caused by the memory emanating from the listed plants, revealing traces of a past that continues to haunt the place. Floralia is a simulation of ecosystems born from the fusion of technology and organic matter, where past and future coexist in a perpetual tension of the present.

BOB

Cheng’s work explores mutation, the history of human consciousness and our capacity as a species to relate to change. Drawing on principles of video game design, improvisation and cognitive science, Cheng develops live simulations – virtual ecosystems of infinite duration, populated with agents who are programmed with behavioural drives but left to self-evolve without authorial intent, following the unforgiving causality found in nature.

Photo: Andrea Rossetti

DEPART
The Entropy Gardens
.
The Entropy Gardens is an artistic VR experience that explores one of humanity’s most archetypical artforms – garden making. It challenges its myths, aesthetics and modes of perception. Like a garden, The Entropy Gardens attempts to become a spatiotemporal poem — a poetic organism. In the form of a sprawling journey it constructs a hermetic, virtual garden as a poetic ecosystem — a psychic landscape that is foremost a complex audiovisual experience. It admits the visitor into a place that is equally challenging and contemplative (and of course profoundly weird).

Waldian
Waldian is a standalone, wall hanging sound and light fixture capable of playing a near infinite amount of melodic permutations over a predetermined musical scale, complemented by emerging light patterns from twelve separate LEDs spread across the sculpture. In technical terms, Waldian contains two oscillators, an envelope generator and a voltage controlled amplifier, all controlled by impulses from a network of logic gates akin to those of early computers. These impulses are essentially the nerves in the electronic ecosystem, deciding over pitch and amplitude changes as well as creating bursts of light to highlight the entrances of each note. Finally, there is a tube overdrive stage that creates harmonic and subharmonics based on how far away the two oscillators are from each other in frequency. Most parameters are customizable, such as the aforementioned pitch, amplitude and overdrive, but the responsiveness and envelope of the light bursts can also be adjusted, directly affecting the appearance of the light patterns.

The tides within us
‘The Tides Within Us’ explores the journey of oxygen from the lungs to the heart and body in a series of installations that echo the ecosystems within nature using medical imaging technology.

Meander
Meander is a large-scale immersive testbed environment constructed within a historic warehouse building at the centre of a residential highrise development in Cambridge, Ontario. The meshwork scaffolds which comprise the testbed are organized as a series of species within an artificial ecosystem, gently flexing and responding to the movement of viewers. Similar to natural environments such as rivers and clouds, large groups of parts pass physical impulses and data signals back and forth, enabling the entire environment to work as an interconnected whole. The innovations in Meander suggest ways of making adaptive, sensitive buildings of the future.

Scale
‘scale’ is an interspecies art project: an audience-interactive installation that involves nocturnal electric fish from the Amazon River Basin. Twelve different species of these fish comprise a choir whose sonified electrical fields provide the source tones for an immersive audiovisual environment. The fish are housed in individual tanks configured in a custom-built sculptural arc of aluminum frames placed around a central podium. The electrical field from each fish is translated into sound, and is thus heard — unprocessed or with digital effects added, with immediate control over volume via a touchscreen panel — through a 12-channel surround sound system, and with LED arrays under each tank for visual feedback. All software is custom-designed. Audience members interact as deejays with the system. Amongst the goals of the project is our desire to foster wider public awareness of these remarkable creatures, their importance to the field of neurological research, and the fragility of their native ecosystem.The project leaders comprise visual/conceptual artist Marlena Novak, composer/sound designer Jay Alan Yim, and neural engineer Malcolm MacIver. MacIver’s research focuses on sensory processing and locomotion in electric fish and translating this research into bio-inspired technologies for sensing and underwater propulsion through advanced fish robots. Novak and Yim, collaborating as ‘localStyle’, make intermedia works that explore perceptual themes, addressing both physical and psychological thresholds in the context of behavior, society/politics, and aesthetics.

CMD
Here are 2 artificial ecosystems sharing a light source. Access to this light source is granted through a market. Each colony of photosynthetic bacterias can claim access to light thanks to credits earned for their oxygen production. The rules driving the market are optimized through a genetic algorithm. This artificial intelligence is testing different populations of financial systems on these 2 sets of Cyanobacteria. Like so, the photosynthetic cells and the computer are experimenting with different political systems granting access to this resource. The system oscillates between collaborative and competitive states. The genetic algorithm pictures the rules of these proto-societies as genes. By breeding populations of societies, new generations of markets arise. Like so, the sum of microscopic series of events determines the status of the system at a macroscopic scale.

Atmospheric Forest
Atmospheric Forest is a large scale VR point-cloud installation that visualizes and sonifies the relations between the forest and climate. It reveals the interaction patterns between the pine-tree emissions in Pfynwald, an ancient Swiss Alpine forest, and weather conditions in this valley, effected by drought. The trees do not only produce oxygen, but they are living bodies who breath too. I.e., they emit part of carbon dioxide, sometimes even up to 20 perc. from what they have consumed. When trees die, they release all the carbon they have collected during their lives back into the atmosphere. Atmospheric Forest explores the effects of drought on local forest ecosystems, and how such stress situations influence production of resin and volatile emissions (such as usual pine-tree scent).

Opulent Virulence
“My collection is inspired by my fascination with nature; an interpretation of the complexity and unrestrained beauty of nature, which I express through complex layering, colour and a maximalist aesthetic that takes joy in abundance and opulence. I create my own ecosystems of layered and built fabrics in knit, print and unconventional embroidery. My clothes are in a state of rewilding – I infect the silhouettes with rich colourful textiles, giving them life. I grow my embroideries over graphic and sculptural silhouettes to emphasise and contrast the organic and the built landscape.” Rosie Danford Phillips

Eco Warriors

A Beginner’s Guide for Eco Warriors is inspired by the current dramatic changes in Earth’s ecosystem due to the human impact, the so-called age of Anthropocene. This short film represent, with certain level of exaggeration, tips and inspirations how to lower your ecological footprint and contribute to the slowing down of global warming and the protection of natural habitats. This short film then becomes a small guide for Eco Warriors and urges for reflection and reaction from each of us.

“Science,Fiction”

Through a combination of the temporal qualities of video and the architectural dimension of its physical installation, Thater’s work explores the artifice of its own production and its capacity to construct perception and shape the way we think about the world through its image. Natural diversity, wildlife, and conservation have been persistent themes in the artist’s work, and she has dedicated herself to an examination of the varied kinds of relationships humans have constructed with animals. While her in-depth studies of ecosystems and animal behavior propose observation as a kind of understanding in itself, her ethical position is implicit in the work, which, while subtly political, provides views of the sublime in all its incarnations—stunning, beautiful, and simultaneously terrifying.

Adaptive Urban Ecologies
Adaptive ecologies explores the emergent logics of adaptation and evolution that are constitutive of ecosystems in nature. Chimera’s vision is to define an urban ecosystem which supports housing and cultural programs and has the ability to adapt, transform, mutate, and adjust according to the specific urban and social character of the site and of Manhattan. This urban ecological system is taking as a model an organism in nature, specifically the mangrove plant.

أغوستينو دي سكيبيو
stanze private
Stanze Private – Private Rooms” amplifies the noise inside these small rooms, these few jugs and glass ampoules, transparent. And it amplifies the noise in the surrounding environment, in the largest room where the installation is placed. It produces sound from the audience. We as listeners can not only be part of this small ecosystem, our physical presence alters the acoustics of the surrounding space, altering the dynamic. Listening thus interferes on listening, the listening is never something objective, is always something that changes the listening itself.

via highlike submit
“While marketing drives demand and justifies the over-production of consumer electronics, I create sculptural landscapes and video installations from the circuit boards left behind in the wake of obsolescence. The majority of this material would be in landfills or contaminating our ecosystem from the recycling of precious metals and other natural resources.”

Samorost 3
Prague-based Amanita Design, creators of the award-winning Mechinarium, recently released what may be their best game yet: Samorost 3. This deeply immersive puzzle game spans the ecosystems of 9 unusual planets as you encounter strange inhabitants and unlock increasingly complex secrets to advance to the next level. Amanita Design’s approach to creating completely non-verbal/non-textual games relies heavily on intuition, sound design, and symbolism to create environments that are practically interactive artworks.

Theo Watson, Emily Gobeille and Nick Hardeman
Connected Worlds
Connected Worlds is an immersive, interactive ecosystem that was designed for the New York Hall of Science. It’s an installation of six smaller ecosystems, actually—all of which are connected, much like real ecosystems are. The difference here is that the environments only exist on massive screens connected by a 3,000-ft² interactive floor.

Magnavox Odyssey
Even if you’re a devoted fan of video games, there’s a decent chance you’re not familiar with the name Ralph H. Baer. This should be considered gamer high treason considering Baer’s importance in creating the concept of home video games and the vast, varied entertainment ecosystem now built upon them. Despite being the one to push the dominoes toward an industry that currently makes billions of dollars annually, the bulk of the gaming community has largely forgotten about him.Now a 91-year-old widower, the German-born Baer is the inventor of the Magnavox Odyssey, the world’s first video game console. The Odyssey is predated in the games-on-screens space only by experiments like Willy Higinbotham’s Tennis for Two and the coin-op dud Computer Space. But Baer also has a long and distinguished record as an engineer and inventor. The list of patents and gadgets in his name encompasses surgical-cutting equipment, “muscle-toning pulse generators,” submarine-tracking radar systems, video simulations for trainee pilots, talking books and talking doormats, iconic ‘80s toys like SIMON and Laser Command, and even launch displays and a lunar-resistant camera grip for the Saturn V and Apollo 11 space programs.

VORTEX

Architectural fragment made from scaffolding, VORTEX has a raw wood skin highlighted by 12 lines of LED light as many generative and constructive project’s lines. Merging organic materials with new technologies, this hybrid architectural artwork wraps around and embraces the footbridge between the complex’s two buildings, revealing and enhancing the venue’s dynamic energy while working as a live visualizer of energy consumption. VORTEX evolves like a living organism; it breathes, trembles and emits pulses of light created using 1024’s MadMapper software. Manually controlled via a joystick, the structure can be synchronized to music and also displays its location’s energy consumption through a series of illuminated tubes. It ultimately answers to the ambient environment around it, capturing the Darwin Ecosystem Project’s unique energy consumption footprint, and converting it into data that is processed to spawn realtime visuals.
.

Джон Маккормак
Eden – an evolutionary sonic ecosystem

Eden is an interactive, self-generating, artificial ecosystem. A cellular world is populated by collections of evolving virtual creatures. These creatures move about their environment, making and listening to sounds, foraging for food, encountering predators and possibly mating with each other. Over time, creatures evolve to fit their landscape. Eden has four seasons per year and each year lasts 600 Eden days. One Eden year passes by in about fifteen minutes of real time. A simple physics dictates only three basic types of matter in the Eden world: rocks, biomass and sonic creatures.

Quasi-Objects

ll works are printed using pigment-based inks on Hahnemühle archival paper, variable dimensions, edition of 3+1 ap.
“Quasi-Objects” is an art project consisting of 3d generated videos and prints, a practice of “organic re-design” – started in 2003 and still in progress – that aims to stimulate thought and dialogue on the progressive relativisation of natural forms of life as a result of techno-biological evolution.“Quasi-Objects” regards data actualization, the production of biologically non-functional organisms and ecosystems as transient output of an operative practice: aesthetics of process.
“Life is a real and autonomous process independent from any specific material manifestation.”

Augmented Shadow
File Festival

Augmented Shadow is a design experiment producing an artificial shadow effect through the use of tangible objects, blocks, on a displayable tabletop interface. Its goal is to offer a new type of user-experience. The project plays on the fact that shadows present distorted silhouettes depending on the light. Augmented Shadows take the distortion effect into the realm of fantasy. Shadows display below the objects according to the physics of the real world. However, the shadows themselves transform the objects into houses, occupied by shadow creatures. By moving the blocks around the table the user sets off series of reactions within this new fantasy ecosystem. In this installation, the shadows exist both in a real and a virtual environment simultaneously. It thus brings augmented reality to the tabletop by way of a tangible interface. The shadow is an interface metaphor connecting the virtual world and users. Second, the unexpected user experience results from manipulating the users’ visual perceptions, expectations, and imagination to inspire re-perception and new understanding. Therefore, users can play with the shadows lying on the boundary between the real, virtual, and fantasy. Augmented Shadow utilizes this unique interface metaphor for interactive storytelling. Maximizing the magical amusement of AR, it is embedding an ecosystem where imaginary objects and organic beings co-exist while each of them influences on each other’s life-cycle, even though it is not in use by users. Light and shadow play critical roles in this world’s functions causing chain reactions between virtual people, trees, birds, and houses. A set of tangible blocks allows users to participate in the ecosystem. Users can influence on the system by playing with the blocks or observe the changes of the shadows as if kids were playing with an ant farm.