highlike

ELEVENPLAY + Rhizomatiks Research

24 drones
24 Drones is a video demonstration of the incredible drones made by Rhizomatiks and their ability to move around 3d space in ways never before seen. With intricate sensor systems both on the drones and in the room the drones are constantly checking their surroundings and mapping them in order to move without colliding with each other or a speaker who stands in the middle of the swarm of drones directing them with gestures and movements. The movement of the drones is not only controlled and safer than ever, the drones awareness of their surroundings makes them appear conscious and gives them a sense of personality.

MARTIN HESSELMEIER & ANDREAS MUXEL

CAPACITIVE BODY
file festival

The installation “capacitive body” is a modular light system that reacts to the sound of its environment. Each custom-built module consists of an electro-luminescent light wire linked to a piezoelectric sensor and a microcontroller. Through its modular setup it can easily be adapted to various urban spaces. The sensors are used to measure vibrations of architectural solids in a range of low frequencies. These oscillations are triggered by surrounding ambient noise, for example traffic noise. The data sensor controls the light wires, which are tensed to a spatial net structure. According to the values of the measurement, light flashes are generated. With increasing vibrations the time between flashes becomes shorter and shorter. The stability of this nervous system gets to an end where it collapses and restarts again. A dynamic light space is thereby created, which creates a visual feedback of the aural activity around the installation.

Hiroshi Matoba

Sun and Moon Room
Sun and Moon Room in the Art Museum of Nature and Human Non-Homogeneity, located in Bungotakada City, Oita, houses one of the interactive art installations designed to extend one’s physicality in contact with the nature. The concept of this work is a room where visitors can play with sunlight. As visitors walk through the room, small apertures on the ceiling automatically open and close, following their movements. The aperture system is designed to envelop the visitors’ bodies in light and to change the shape of the light cast at their feet, mimicking the waxing and waning of the moon. Visitors’ movements are detected by sensors, which trigger to open only the apertures located in the direction of the sun. The room is controlled to create an interior condition that represents the weather of the moment using a program for analyzing live data released by the Japan Meteorological Agency.

YAMAHA & KAIJI MORIYAMA

17Mai Hi Ten Yu
Die künstliche Intelligenz (KI) von Yamaha ermöglichte es dem weltberühmten Tänzer Kaiji Moriyama, ein Klavier durch seine Bewegungen zu steuern. Die im System verwendete KI kann die Bewegung eines Tänzers in Echtzeit identifizieren, indem sie Signale von vier Arten von Sensoren analysiert, die am Körper eines Tänzers angebracht sind. Dieses System verfügt über eine Originaldatenbank, die Melodie und Bewegungen verknüpft. Mit dieser Datenbank erstellt die KI im System sofort geeignete Melodiedaten (MIDI) aus den Bewegungen des Tänzers. Das System sendet dann die MIDI-Daten an ein Yamaha Disklavier ™ -Player-Klavier und übersetzt sie in Musik.

Stelarc

StickMan
StickMan is a minimal but full-body exoskeleton that algorithmically actuates the artist with 6 degrees-of-freedom. It is a gesture generating system capable of 64 possible combinations. Sensors on StickMan generate sounds that augment the pneumatic noise and register the limb movements. A ring of 6 speakers directs and circulates the sounds.

TERMINALBEACH

The Heart Chamber Orchestra
File Festival – Hipersonica 

In the TERMINALBEACH Heart Chamber Orchestra (made up of artists Erich Berger and Peter Vatava), twelve musicians played pieces from the heartbeat, recorded by an electrocardiogram from data sent by sensors placed on their bodies. As the live score created in real time from the physical and emotional states of the musicians, their beats further influenced the resulting musical composition. In this way, the biological feedback loop becomes a self-generating, organic and evolving system, which creates a musical score and a show that adopts the form of open or network art, in which chance and interdependence, thus how emotional changes and computational reasoning create a biological and psychological dynamic at the same time.

erina kashihara

light dress

Erina Kashihara is a light artist. She has been creating light dresses and accessories since 1985. She gives a name for these art works “LIGHT MODE ART”. This is the first challenge to use wireless sensor system. If a model moves the blue sphere which she has in the hand, the light of a dress will change.

ELEVENPLAY + RHIZOMATIKS RESEARCH

24 Drohnen
24 Drohnen ist eine Videodemonstration der unglaublichen Drohnen von Rhizomatiks und ihrer Fähigkeit, sich auf noch nie dagewesene Weise im 3D-Raum zu bewegen. Mit komplizierten Sensorsystemen sowohl an den Drohnen als auch im Raum überprüfen die Drohnen ständig ihre Umgebung und kartieren sie, um sich zu bewegen, ohne miteinander zu kollidieren, oder mit einem Sprecher, der mitten im Drohnenschwarm steht und sie mit Gesten und Bewegungen steuert . Die Bewegung der Drohnen ist nicht nur kontrolliert und sicherer als je zuvor, das Bewusstsein der Drohnen für ihre Umgebung lässt sie bewusst erscheinen und gibt ihnen ein Gefühl der Persönlichkeit.

localStyle (Marlena Novak & Jay Alan Yim) in collaboration with Malcolm MacIver

Scale
‘scale’ is an interspecies art project: an audience-interactive installation that involves nocturnal electric fish from the Amazon River Basin. Twelve different species of these fish comprise a choir whose sonified electrical fields provide the source tones for an immersive audiovisual environment. The fish are housed in individual tanks configured in a custom-built sculptural arc of aluminum frames placed around a central podium. The electrical field from each fish is translated into sound, and is thus heard — unprocessed or with digital effects added, with immediate control over volume via a touchscreen panel — through a 12-channel surround sound system, and with LED arrays under each tank for visual feedback. All software is custom-designed. Audience members interact as deejays with the system. Amongst the goals of the project is our desire to foster wider public awareness of these remarkable creatures, their importance to the field of neurological research, and the fragility of their native ecosystem.The project leaders comprise visual/conceptual artist Marlena Novak, composer/sound designer Jay Alan Yim, and neural engineer Malcolm MacIver. MacIver’s research focuses on sensory processing and locomotion in electric fish and translating this research into bio-inspired technologies for sensing and underwater propulsion through advanced fish robots. Novak and Yim, collaborating as ‘localStyle’, make intermedia works that explore perceptual themes, addressing both physical and psychological thresholds in the context of behavior, society/politics, and aesthetics.

Klaus Obermaier

克劳斯奥伯迈尔
the concept of … (here and now)

In front of a giant screen, two dancers interact with a cohort of cameras… Their movements are captured by infra-red sensors and projected onto the screen, whereby their bodies become the canvas on which new images take shape. The result is a shifting kaleidoscope of strange, living, quasi-mathematical visual worlds which sometimes seem to be emanating or even escaping from the dancers’ bodies. “Who decides which movement to make: the man or the machine?” Blurring the line between the real and the virtual, Klaus Obermaier loves to subsume his performers’ bodies and physicality in a disconcerting digital universe. With his latest creation, the choreographer/artist has taken a bold new step. He has constructed a system of projectors and infra-red sensor-cameras, trained upon the movements of two dancers. The performers thus find themselves thrown headlong into a living, moving graphical universe: their movements are projected onto the screen, but at the same time their bodies are illuminated by more projected images. This is a true artistic performance, pushing well beyond the frontiers of a standard dance recital, or even a contemporary dance show. A corporeal, temporal performance. A choreography which makes subtle use of its raw materials, deftly combining lights, video, perspectives and the real-time power of bodily movement.

Void

Abysmal
Abysmal means bottomless; resembling an abyss in depth; unfathomable. Perception is a procedure of acquiring, interpreting, selecting, and organizing sensory information. Perception presumes sensing. In people, perception is aided by sensory organs. In the area of AI, perception mechanism puts the data acquired by the sensors together in a meaningful manner. Machine perception is the capability of a computer system to interpret data in a manner that is similar to the way humans use their senses to relate to the world around them. Inspired by the brain, deep neural networks (DNN) are thought to learn abstract representations through their hierarchical architecture. The work mostly shows the ‘hidden’ transformations happening in a network: summing and multiplying things, adding some non-linearities, creating common basic structures, patterns inside data. It creates highly non-linear functions that map ‘un-knowledge’ to ‘knowledge’.

Yamaha & Kaiji Moriyama

Mai Hi Ten Yu
Yamaha artificial intelligence (AI) technology enabled the world-renowned dancer Kaiji Moriyama to control a piano by his movements. The AI adopted in the system can identify a dancer’s movement in real time by analyzing signals from four types of sensors attached to a dancer’s body. This system has an original database that links melody and movements, and, with this database, the AI on the system creates suitable melody data (MIDI) from the dancer’s movements instantly. The system then sends the MIDI data to a Yamaha Disklavier™ player piano, and it is translated into music.

DAITO MANABE

真鍋 大 度

One of the new technology projects from the programmer and artist Daito Manabe based in Tokyo, Japan, centres on experimental music performances and connects a person’s face to electric sensors. This innovative system lets you ‘play’ your face like a musical instrument with the help of facial movements that trigger sounds. Electrical stimulation makes a face twitch involuntary, each twitch matches the beat of the music.

 

Bill Vorn

Prehysterical Machine

The Prehysterical Machine has a spherical body and eight arms made of aluminum tubing. It has a sensing system, a motor system and a control system that functions as an autonomous nervous system (entirely reactive). The machine is suspended from the ceiling and its arms are actuated by pneumatic valves and cylinders. Pyroelectric sensors allow the robot to detect the presence of viewers in the nearby environment. It reacts to the viewers according to the amount of stimuli it receives. The perceived emergent behaviors of this machine engender a multiplicity of interpretations based on single dynamic pattern of events.The aim of this project is to induce empathy of the viewer towards a “character” which is nothing more than an articulated metal structure. The strength of the simulacra is emphasized by perverting the perception of the creature, which is neither animal nor human, carried through the inevitable instinct of anthropomorphism and projection of our internal sensations, a reflex triggered by any phenomenon that challenges our senses.
FILE FESTIVAL

Thibault Brevet

DRM Chair (Chair that self-destructs after 8 uses)
The DRM Chair has only a limited number of use before it self-destructs. The number of use was set to 8, so everyone could sit down and enjoy a single time the chair.
A small sensor detects when someone sits and decrements a counter. Every time someone sits up, the chair knocks a number of time to signal how many uses are left. When reaching zero, the self-destruct system is turned on and the structural joints of the chair are melted.

YING GAO

Living pod
file festival
Light, shape variations and mimicry meet in Living Pod. In front of the false twin pieces, the user can slowly set garment A in motion using a light source. Garment B then imitates piece A in an exaggerated and unbalanced fashion, changing structure through miniature electric motors activated by light sensors that are sown through the garment. Using flat-pattern cutting techniques, Ying Gao was able to give the process fluidity and flexibility. In addition to the mechanical movements of the garments, Living Pods underlines two fundamental aspects of today’s fashion system: confrontation and imitation. The garment plays a mediating role between man and his environment. By using light, Living Pod is similar to project Walking City, which uses air to make the pieces look like they are breathing.

HERMAN KOLGEN

INJECT
A HUMAN BODY IS INJECTED IN A CISTERN. OVER THE COURSE OF 45 MINUTES, THE PRESSURE OF THE LIQUID EXERTS UPON HIM MULTIPLE NEUROSENSORIAL TRANSFORMATIONS. FROM HIS EPIDERMAL FIBER TO HIS NERVOUS SYSTEM, HE REACTS TO INFLUXES OF VISCOSITY IN THIS LIQUID CHAMBER. HIS CORTEX, LACKING OXYGEN, GRADUALLY LOSES ALL NOTIONS OF THE REAL. LIKE A HUMAN GUINEA PIG: A MATTER-BODY WHOSE PSYCHOLOGICAL STATES ARE THE OBJECT OF KINETIK TABLEAUX, OF SINGULAR TEMPORAL SPACES.

KEN RINALDO

Autopoiesis

Autopoiesis ist eine Roboter-Skulptur-Installation, die vom Kiasma-Museum in Helsinki, Finnland, im Rahmen von Outoaly, der von Erkki Huhtamo 2000 kuratierten Alien Intelligence Exhibition, in Auftrag gegeben wurde. Sie besteht aus fünfzehn Roboter-Klangskulpturen, die mit der Öffentlichkeit interagieren und ihr Verhalten im Laufe der Zeit ändern . Diese Verhaltensweisen ändern sich aufgrund des Feedbacks von Infrarotsensoren, der Anwesenheit des Teilnehmers / Zuschauers in der Ausstellung und der Kommunikation zwischen den einzelnen Skulpturen. Diese Serie von Roboterskulpturen spricht über ein Computernetzwerk und hörbare Telefontöne miteinander, die eine musikalische Sprache für die Gruppe sind. Die Autopoese ist „selbstgemacht“, ein Merkmal aller lebenden Systeme, das von Francisco Varella und Humberto Maturana definiert und verfeinert wurde. Die Interaktivität bindet den Betrachter / Teilnehmer ein, der wiederum die Entwicklung und Entstehung des Systems beeinflusst. Dies schafft eine Systementwicklung sowie eine Gesamtgruppe skulpturaler Ästhetik. Autopoiesis bricht von Standardschnittstellen (Maus) und Wiedergabemethoden (CRT) ab und bietet eine interaktive Umgebung, die umfassend, detailliert und in Echtzeit entwickelt werden kann, indem Feedback und Interaktion von Zuschauern / Teilnehmern genutzt werden.

JAIME E OLIVER

Silent Percussion
File Festival
The “Silent Percussion Project” (SPP) consists in building a set of computer musical instruments that use human gestures to control sounds, composing and performing with them in an attempt to re-incorporate the body in music performance practice. The “SPP” is a response to the question: what kinds of musical instruments does live computer music performance need? To answer this question it researches the aesthetic qualities and language of non-live electronic music, action-perception systems and new media theory to experiment new ways of bridging between gesture and sound. In that sense, the “SPP” looks to address the problem of sound control by introducing new sensing techniques that take advantage of our sensorimotor capabilities. The Silent Drum and MANO instruments analyze shapes made by hands and transform them into multiple streams of continuous data. These streams, or variables, are directly applied to sound control, avoiding the key paradigm. Continuous data is analyzed to extract discrete features of the signals. The variables resulting from analysis are interdependent, that is, changes in one result in changes in the others, creating complex systems that the performer learns by experimentation.

Chris Klapper & Patrick Gallagher

Symphony in D Minor

‘Symphony in D Minor’ is an interactive sound and video installation on an epic scale. A thunderstorm contained within a series of large hand cast resin sculptures, each individual form is a unique instrument hanging from the ceiling. Suspended just within reach and activated by touch, the viewer sets the symphony in motion by pushing the forms through the air to trigger the various sound elements of the storm. Sensors relay individual recordings of thunder, lightning, wind and rain with alternating intensities to a full-scale sound system. Acting as both conductor and musician, the viewer creates an evolving composition out of atmospheric sounds, forging an environment that envelops the audience. Housed within each piece are 2 video projectors employing mapping software to evenly fill the surface of the forms. Like giant illuminated pendulums each sculpture radiates video projections that in their dormant state display abstractions of water droplets and slow moving clouds. As the sensors detect movement different ranges initiate more visual elements of the storm. Once activated, the form then shifts to a swirling torrent of clouds.

Gilles AZZARO – Voice Sculptor

질 아자로
BARACK OBAMA: NEXT INDUSTRIAL REVOLUTION
This monumental 3D Printed sculpture is the three-dimensional materialisation of President Obama’s voiceprint. The 3D voiceprint portrays an extract of President Obama’s February 2013 State of the Union Address. It represents the materialisation of the very thoughts and words of the President of the USA. The sculpture is interactive. A movement sensor activates the system and a laser beam scans the 3D recording to reveal the President’s words and message. The work was printed using a 3D desktop printer and the housing designed by Patrick SARRAN.

PETER FLEMMING

Instrumentation

Alle Dinge haben eine natürliche Resonanzfrequenz. Interessanterweise deutet dies auf eine grundlegende Verbindung zwischen fast allem hin, aber lassen Sie uns auf der Ebene des Physischen bleiben. Wasser in einem Weinglas vibriert stark, wenn ein Finger über den Rand gezogen wird. Unser Körper hat Resonanzfrequenzen; Ebenso der Hefter auf meinem Schreibtisch, die Wolkenkratzer in der Innenstadt, die Brücke, die ich beim Verlassen von Montreal überquere, und die tektonischen Platten, die alles tragen. Inspiriert von dieser Resonanz ist Instrumentation eine ortsvariable, kinetische Klanginstallation. Beim Betreten des Hauptinstallationsraums hört man eine schimmernde Polyphonie aus Harmonischen, plötzlichen Crescendos und arrhythmischen Beats. Im Widerspruch zur Eleganz dieser Klänge stehen die unwahrscheinlichen Resonatoren, von denen sie ausgehen und die aus Altholz, Klammern, Eimern, Trommeln, geborgenen Fenstern und handgewickelten elektromagnetischen Spulen zusammengeschustert sind. Weitere Erkundungen zeigen einen sekundären Raum, der die Quelle der Aufführung enthält: eine Reihe kleiner mechanischer Geräte und scheinbar zufällige Schaltkreise. Ein großer Holztisch dient diesen nichtmenschlichen Darstellern als Bühne: Ein Hebel zieht eine Schnur, die an einem Elektrodenkolben in einem Gefäß mit elektrifiziertem Salzwasser befestigt ist; Das Zifferblatt eines Lichtdimmers dreht sich langsam unter der Kontrolle eines kleinen Motors. Vibrierende elektromagnetische Felder erzeugen Klavierdrähte und erzeugen Schlagimpulse in Trommeln und Metalldosen. Joghurtdeckel, die an Stöcken befestigt sind, schwanken über Lichtsensoren hin und her. Diese Elemente bilden zusammen spontan den hypnotischen Refrain von Instrumentation. Um schwingende Magnetfelder zu erzeugen, verwende ich einfache Oszillatorschaltungen, Seltenerdmagnete und billige oder handgewickelte elektromagnetische Spulen. Diese Felder aktivieren eine Reihe von Materialien wie Glasschrott, Metallgegenstände und gespannten Draht. Mit lichtempfindlichen Fotozellen in den Schaltkreisen können die Frequenzen durch Umgebungslichtpegel variiert werden, die von den mechanischen Leistungsträgern reguliert werden – motorisierte Lichtdimmervorrichtungen und automatische Lichtblockierklappen. Zusammen mit Büroklammern, Blue-Tack und Heißschmelzkleber bewahrt das behelfsmäßige Erscheinungsbild der Anordnung einen Sinn für die Experimente, aus denen sie hervorgegangen ist. Die Gesamtästhetik ist insofern offen, als die zugrunde liegende Technologie so transparent wie möglich belassen wurde. Obwohl sie auf ungewohnte Weise verwendet werden können, stammen Hinweise von vertrauten Gegenständen; wie Nähmaschinenspulen-Elektromagnete oder Mülleimer-Resonatoren. In Verbindung mit dem überzeugenden Klang bieten häusliche Teile eine unmittelbare körperliche Auseinandersetzung mit ansonsten immateriellen Phänomenen. Ein primäres Ziel, das ich als Künstler habe, ist es, Systeme zu bauen, die ich nicht vollständig verstehe, mit Verhaltensweisen, die ich nicht vollständig vorhersagen kann. In Instrumentation überlappen sich die Zyklen, synchronisieren sich und treten aus der Phase aus, wodurch gemeinsam eine endlos schwankende Tonspur erzeugt wird. Sie wurden in den USA, Europa und Asien in Auftrag gegeben – alle sind ortsspezifisch und vom umgebenden Raum und der Landschaft inspiriert.

STANZA

Capacities Life in the Emergent City

“Capacities Life In The Emergent City” captures the changes over time in the environment (city) and represents the changing life and complexity of space as an emergent artwork. Capacities goes beyond simple single user interaction to monitor and survey in real time the whole city and entirely represent the complexities of the real time city as a shifting morphing and complex system. What you see is a sculpture which represents the emergent properties of the environment where the sensor network is situated.