|
‘fabricative knowledge’ the capacity ‘to know’ through making and to manifest ideas through the creation of artefacts across multiple and varying disciplines |
VISUAL DOCUMENTATION
The video and photo documentation on the website is separated into three parts;
- Art Practice - Interactive Installations -
represented by "InTime" an FRQSC funded research/creation project 2015-18 | "Einstein's Dream" an FRQSC - Appui au Project Novateurs Program 2013
- Interactive Performance -
represented by two interactive theatrical works "Practices of everyday life | cooking" and "Frankensteins Ghost"
- Research | Knowledge Transfer -
application of our research within the fields of architecture and medicine | examples include "Solar Decathlon China" and "Sonifeye"
|
All of the examples included on this page represent the many faces of our creative vision. Our hope is that they clearly illustrate the processes that energize and drive our search for new and dynamic ways in which to develop interactive technologies and responsive environments that are capable of crossing the boundaries between disciplines. The documented outcomes also represent important milestones and new compositional paradigms for activating responsive environments and apparatus, and form the foundation on which we will build our proposed project.
|
Art Practice - Interactive Installations | represented by "InTime", an FRQSC funded research/creation project
|
InTime
FRQSC funded | Research Creation Project | 2015-2018
Rather than using technology as an instrument for measuring time, our project focuses on creating an interactive environment that uses technology as an organic means for altering its perception? Saint Augustine once said, “God did not create the world in time but with time. InTime is inspired by this proposition, as it clearly describes our desire to create a responsive environments that challenges our perception of time, while steering clear of crafting clockwork like installations simply made up of regions of mimetic time. This avenue of investigation and hybridization, which combines theatrical techniques and new technology, has changed not only the way we design responsive environments but how we create new conceptual frameworks and devise strategies for affecting how these responsive environments are experience
FRQSC funded | Research Creation Project | 2015-2018
Rather than using technology as an instrument for measuring time, our project focuses on creating an interactive environment that uses technology as an organic means for altering its perception? Saint Augustine once said, “God did not create the world in time but with time. InTime is inspired by this proposition, as it clearly describes our desire to create a responsive environments that challenges our perception of time, while steering clear of crafting clockwork like installations simply made up of regions of mimetic time. This avenue of investigation and hybridization, which combines theatrical techniques and new technology, has changed not only the way we design responsive environments but how we create new conceptual frameworks and devise strategies for affecting how these responsive environments are experience
InTime - Finished Project | Exhibited
AQUAPHONEIA | - Paris Biennale - Némo December 2017 - ARS Electronica, Linz 2016
2016 -2017
Aquaphoneia is an alchemical installation centred around the poiesis of time and transmutation of voice into matter.A large horn floating mid space echoes the ghosts of Edison, Bell, and Berliner’s machines. But unlike early recording, herding sound energy to etch pressure patterns in solid matter, this odd assemblage transmutes voice into water and water into air. Disembodied voices abandon their sources to cross the event horizon of the horn. Estranged, the schizo-phone falls into the narrow depths of the bell, squeezed into spatiotemporal infinity, calcinated, liquified and released: The aqueous voice then flows into three alchemical chambers where inner time is surrendered to the tempi of matter: unbound, yet lucid and sound.In one corner, voices bubbling inside a sphere of fire are brought to entropy and transmuted into a timeless concentration of spectral mist and phonetic vapour. An ouroboros chamber twists fermented vowels into distilled consonants to release a thin blade of prosody. This viscous alchemical matter lowers itself to the terra beneath where matter dances to its own affective tonality. Another module separates speech into vital elements a drop at a time: words into phonemes, into phono particles, and the invisible quanta of silence.
2016 -2017
Aquaphoneia is an alchemical installation centred around the poiesis of time and transmutation of voice into matter.A large horn floating mid space echoes the ghosts of Edison, Bell, and Berliner’s machines. But unlike early recording, herding sound energy to etch pressure patterns in solid matter, this odd assemblage transmutes voice into water and water into air. Disembodied voices abandon their sources to cross the event horizon of the horn. Estranged, the schizo-phone falls into the narrow depths of the bell, squeezed into spatiotemporal infinity, calcinated, liquified and released: The aqueous voice then flows into three alchemical chambers where inner time is surrendered to the tempi of matter: unbound, yet lucid and sound.In one corner, voices bubbling inside a sphere of fire are brought to entropy and transmuted into a timeless concentration of spectral mist and phonetic vapour. An ouroboros chamber twists fermented vowels into distilled consonants to release a thin blade of prosody. This viscous alchemical matter lowers itself to the terra beneath where matter dances to its own affective tonality. Another module separates speech into vital elements a drop at a time: words into phonemes, into phono particles, and the invisible quanta of silence.
|
|
|
|
|
TangibleFlux - ARS Electronica, Linz 2018
In search for the hidden mysteries of matter from the borders of table-top astrophysics and natural fiction, three microcosms orchestrate states of sensory access to the phenomenological emergence of order out of chaos. tangibleFlux φ plenumorphic ∴chaosmosis is an installation that invites participants to intimately encounter the ontogenesis of vital patterns through the spontaneous formation of temporal textures that emerge from material-energy fields. Physically investigated through collaboration with forces of complex harmonic motion, patterns-of-interaction between magnetism, gravity, and light spiral out of theories of complexity and into an improvisatory dance of hallucinatory forms. Eventually, the kinetic event unveils messy realness chaosing into balance: things doing… stuff seeking a minimum-energy-state under magnetic flux. Sensually binding, spatially confusing, and temporally unsettling, tangibleFlux pulls everything into immediate vibrational relation with its vertiginous ritual.
In search for the hidden mysteries of matter from the borders of table-top astrophysics and natural fiction, three microcosms orchestrate states of sensory access to the phenomenological emergence of order out of chaos. tangibleFlux φ plenumorphic ∴chaosmosis is an installation that invites participants to intimately encounter the ontogenesis of vital patterns through the spontaneous formation of temporal textures that emerge from material-energy fields. Physically investigated through collaboration with forces of complex harmonic motion, patterns-of-interaction between magnetism, gravity, and light spiral out of theories of complexity and into an improvisatory dance of hallucinatory forms. Eventually, the kinetic event unveils messy realness chaosing into balance: things doing… stuff seeking a minimum-energy-state under magnetic flux. Sensually binding, spatially confusing, and temporally unsettling, tangibleFlux pulls everything into immediate vibrational relation with its vertiginous ritual.
|
|
|
InTime - Prototype - Phase 2 | Projects to be completed 2018-2020
ORGAN·ISM
A Casavant organ built in 1910 is brought back to life. Using Data produced from the intensity and movement of a candle….it sings. The final installation will use weather data as a source for activating the organ. A second version is also being constructed as a compositional tool for performance.
|
|
|
|
|
PASSING LIGHT
In a darkened room sits a precariously balanced metal plate. Alchemically transformed, light in liquid form rests on its surface. Entering the space, you are shadowed by luminescence, equilibrium is disturbed. Light cascades down the tilted steel sheet creating a waterfall of illuminated atoms that find their way onto the floor and across the space. In this installation the line that separates the physical properties of water and light are blurred in an ever changing cycle of animated play.
In a darkened room sits a precariously balanced metal plate. Alchemically transformed, light in liquid form rests on its surface. Entering the space, you are shadowed by luminescence, equilibrium is disturbed. Light cascades down the tilted steel sheet creating a waterfall of illuminated atoms that find their way onto the floor and across the space. In this installation the line that separates the physical properties of water and light are blurred in an ever changing cycle of animated play.
|
|
|
|
|
SHADOW PLAY
Traces of light are left as vestiges of time. While shadows are burned into the nearly visible landscape. Leaving behind still moments encased in light.
Traces of light are left as vestiges of time. While shadows are burned into the nearly visible landscape. Leaving behind still moments encased in light.
|
|
|
|
|
Parle
2015-2017
Parle is an alchemical apparatus that turns speech into air. Like the breath behind the voice, phrases are transformed into a concoction of words and wind, accumulating deep inside an inflatable chamber. Metal trumpets form the final stage of translation. From herevocal patterns are released back into the atmosphere.
2015-2017
Parle is an alchemical apparatus that turns speech into air. Like the breath behind the voice, phrases are transformed into a concoction of words and wind, accumulating deep inside an inflatable chamber. Metal trumpets form the final stage of translation. From herevocal patterns are released back into the atmosphere.
|
|
|
|
|
Einstein's Dreams |FRQSC -Appui au Project Novateurs Program | 2013
Einstein's Dream proposes to build time conditioning installations & techniques that create palpable alternatives to the everyday time that’s governed by calendars, universal clocks, and Internet services that never sleep. We’ll do this by building physical zones in which objects and fields of lighting, sound, and video change in concert with the inhabitants’ movement to create powerfully alternative senses of time, rhythm and pattern. We will thus develop a new architecture of kinetic material and digital media in which time becomes an elastic medium of expression, learning, and invention - a new art of time for the 21c. The floor of the space was covered with 13 metric tons of sand in order to provide an organic surface with which the body could interact. The ability to play with the material that one walks on and the ability to change the spaces architecture by moulding the sand provided a unique opportunity to interact with reality and its technologically augmented cousin at the same time.
Einstein's Dream proposes to build time conditioning installations & techniques that create palpable alternatives to the everyday time that’s governed by calendars, universal clocks, and Internet services that never sleep. We’ll do this by building physical zones in which objects and fields of lighting, sound, and video change in concert with the inhabitants’ movement to create powerfully alternative senses of time, rhythm and pattern. We will thus develop a new architecture of kinetic material and digital media in which time becomes an elastic medium of expression, learning, and invention - a new art of time for the 21c. The floor of the space was covered with 13 metric tons of sand in order to provide an organic surface with which the body could interact. The ability to play with the material that one walks on and the ability to change the spaces architecture by moulding the sand provided a unique opportunity to interact with reality and its technologically augmented cousin at the same time.
|
|
|
|
|
Interactive Performance | represented by two interactive theatrical works "Practices of everyday life | cooking" and "Frankensteins Ghost"
|
Practices of Everyday Life |Cooking - Premiere Société de Musique Contemporain du Montreal |Montreal New Music International Festival - February 2015, ARS Electronica, Linz 2018
A performance choreographed around a chef and sonified objects: fruit, vegetables, meat, knives, pots and pans, cutting board and table. Cooking*, the most ancient art of transmutation, has become over a quarter of a million years an unremarkable, domestic practice. But in this everyday practice, things perish, transform, nourish other things. Enchanting the fibers, meats, wood and metal with sound and painterly light, we stage a performance made from the moves (gestures) of cooking, scripted from the recipes of cuisine both high and humble. Panning features virtuosic chefs who are also movement artists, such as Tony Chong. "Cooking"is the first part in a series of performances exploring how everyday gestures/events could become charged with symbolic intensity. We use responsive media to poetically charge everyday actions and objects in ways that combine sound and visual composition with the participant's contingent nuance. As the participants grow accustomed to the instrument’s responsive quality, everyday gestures may become aesthetically invested or charged with emotion or social meaning. Participant’s gestures not only lead to unexpected musicality but to narratives about shaping relationships with the world. "Practices of everyday life" synthesizes state of art techniques in continuous gesture tracking and sonification in a paradigm of calligraphic gestural media developed by Navid Navab at the Topological Media Lab. Technical methods include corpus-based concatenative synthesis, haptic-acoustic transcoding, gesturally driven granular processing, physical models, real-time machine-learning, and gesture following
A performance choreographed around a chef and sonified objects: fruit, vegetables, meat, knives, pots and pans, cutting board and table. Cooking*, the most ancient art of transmutation, has become over a quarter of a million years an unremarkable, domestic practice. But in this everyday practice, things perish, transform, nourish other things. Enchanting the fibers, meats, wood and metal with sound and painterly light, we stage a performance made from the moves (gestures) of cooking, scripted from the recipes of cuisine both high and humble. Panning features virtuosic chefs who are also movement artists, such as Tony Chong. "Cooking"is the first part in a series of performances exploring how everyday gestures/events could become charged with symbolic intensity. We use responsive media to poetically charge everyday actions and objects in ways that combine sound and visual composition with the participant's contingent nuance. As the participants grow accustomed to the instrument’s responsive quality, everyday gestures may become aesthetically invested or charged with emotion or social meaning. Participant’s gestures not only lead to unexpected musicality but to narratives about shaping relationships with the world. "Practices of everyday life" synthesizes state of art techniques in continuous gesture tracking and sonification in a paradigm of calligraphic gestural media developed by Navid Navab at the Topological Media Lab. Technical methods include corpus-based concatenative synthesis, haptic-acoustic transcoding, gesturally driven granular processing, physical models, real-time machine-learning, and gesture following
|
|
|
Frankenstein's Ghosts - SSHRC funded | Interactive performance piece - 2009-2011
Frankenstein’s Ghosts is a collaborative creation-research project. The aim of the project is to generate a hybrid performance work based on the substantive issues raised in Mary Shelley’s novel. In June 2007, several of the project collaborators received SSHRC funding to bring together an interdisciplinary team of academics and artists to share in a deconstruction, analysis and exploration of Mary Shelley’s Frankenstein. This came from a desire among academic scholars to explore artistic transformations of their discourse as a way of pushing their thinking even deeper into the subject matter - working with artists who will transform their research into another “language.” For the artists, the impulse came from a desire for deep understanding of the many substantive themes emerging from the novel before embarking on artistic creation.
Frankenstein’s Ghosts is a collaborative creation-research project. The aim of the project is to generate a hybrid performance work based on the substantive issues raised in Mary Shelley’s novel. In June 2007, several of the project collaborators received SSHRC funding to bring together an interdisciplinary team of academics and artists to share in a deconstruction, analysis and exploration of Mary Shelley’s Frankenstein. This came from a desire among academic scholars to explore artistic transformations of their discourse as a way of pushing their thinking even deeper into the subject matter - working with artists who will transform their research into another “language.” For the artists, the impulse came from a desire for deep understanding of the many substantive themes emerging from the novel before embarking on artistic creation.
|
|
|
|
|
Research | Knowledge Transfer | application of our research within the fields of architecture and medicine | "Solar Decathlon China" and "Sonifeye"
|
SOLAR DECATHLON
A collaborative project that explores the concept of “Deep-Performance”. which implies a socially, culturally,and technologically advanced architecture that embodies qualitative and quantitative notions of performance in addressing energy efficiency, comfort, wellbeing, affordability, environmental sustainability and ecological awareness. Custom built media/data architectural features, aesthetically codify, translate and transform performance data, from an array of sensors, as visual and sonic experiences to raise awareness of consumption, performance, and behaviour.
http://teammtl.ca/index.html
A collaborative project that explores the concept of “Deep-Performance”. which implies a socially, culturally,and technologically advanced architecture that embodies qualitative and quantitative notions of performance in addressing energy efficiency, comfort, wellbeing, affordability, environmental sustainability and ecological awareness. Custom built media/data architectural features, aesthetically codify, translate and transform performance data, from an array of sensors, as visual and sonic experiences to raise awareness of consumption, performance, and behaviour.
http://teammtl.ca/index.html
Liquid Light - one of several projects being produced by the Topological Media Lab for Solar Decathlon
In "liquid light", one of several projects being produced by the Topological Media Lab for Solar Decathlon, water consumption data is gathered and the weekly usage is compared to the recommendation index provided by Ministry of Natural Resources, ambiently giving residents a general sense of adequate consumption on one end of the spectrum, to excessive levels of consumption on the other end, and any gradient in between. Through refraction of light in mineral oil and manipulation of this liquid, which acts as a filter, a textural palette is created. On the periphery of sight, the visualization remains peaceful and non-intrusive; however, when at the focal point, this gradient of textures allows for a generalized comprehension of overall consumption habits. Controlled drops of water create ripples that get magnified and mapped. The poetic language is simple here, drops of water correspond to gallons used per week. Multiple drop falling simultaneously symbolizes the excessive amounts of water used during that time period. The material texture of sensor data (water) is directly tied to the visualization strategy, which uses the same medium to communicate with the resident.
|
|
Concept
In-Situ
|
|
|
Sonifey - Collaboration - Technical University Munich - John Hopkins
Sonic interaction as a technique for conveying information has advantages over conventional visual augmented reality methods specially when augmenting the visual field with extra information brings distraction. Sonification of knowledge extracted by applying computational methods to sensory data is a well-established concept. However, some aspects of sonic interaction design such as aesthetics, the cognitive effort required for perceiving information, and avoiding alarm fatigue are not well studied in literature. In this work, we present a sonification scheme based on employment of physical modeling sound synthesis which targets focus demanding tasks requiring extreme precision. Proposed mapping techniques are designed to require minimum training for users to adapt to and minimum mental effort to interpret the conveyed information. Two experiments are conducted to assess the feasibility of the proposed method and compare it against visual augmented reality in high precision tasks. The observed quantitative results suggest that utilizing sound patches generated by physical modeling achieve the desired goals of minimizing the cognitive load while improving the user experience and general task outcome.
Sonic interaction as a technique for conveying information has advantages over conventional visual augmented reality methods specially when augmenting the visual field with extra information brings distraction. Sonification of knowledge extracted by applying computational methods to sensory data is a well-established concept. However, some aspects of sonic interaction design such as aesthetics, the cognitive effort required for perceiving information, and avoiding alarm fatigue are not well studied in literature. In this work, we present a sonification scheme based on employment of physical modeling sound synthesis which targets focus demanding tasks requiring extreme precision. Proposed mapping techniques are designed to require minimum training for users to adapt to and minimum mental effort to interpret the conveyed information. Two experiments are conducted to assess the feasibility of the proposed method and compare it against visual augmented reality in high precision tasks. The observed quantitative results suggest that utilizing sound patches generated by physical modeling achieve the desired goals of minimizing the cognitive load while improving the user experience and general task outcome.
|
|
|