Category Archives: Art

Théatre Mécanique

Theatre Mécanique is a proposed interactive storytelling system for recreating a wide range of stories with animated puppets.

Theatre Mécanique is a proposed interactive storytelling system featuring animated puppets and computer-controlled multimedia.

I propose to create a Théatre Mécanique — a project which I would like to work on in coming years, in collaboration with others. (For a visual overview, check out these slides.)

The idea is to build an interactive storytelling system that would let you experience and remix some of the great myths and legends shared by all cultures around the world. It would enable small groups of people to collaboratively reenact some of these universal stories, connect them with their daily lives — and better understand each other as a result.

This theater cart would enable small groups of people to experience some of the universal myths we all share.

This theater cart would enable small groups of people to experience universal myths, and select plot elements.

This mini theater would be mobile, like a hot dog stand, so it could be located anywhere, from birthday parties to street fairs or even on the Playa. It would feature animated puppets, which could either be controlled manually by live performers, or automatically by small computers like Arduino: the puppets could slide in and out of the stage, face one another and/or move their heads and limbs, as shown in the prototype we’re now developing for a balinese cuckoo clock.

Animated puppets would act out short stories selected by participants, set against colorful images on a rear-projected screen.

Animated puppets would act out short stories against colorful images, rear-projected on a background screen.

This mixed media system would include a good sound system for amplifying background music, sound effects and character voices, either live or pre-recorded. A rear-projection screen would set the mood by displaying a wide range of images for each scene, from landscapes from around the world to historical or futuristic scenes. An interactive controller at the front of the stage would let visitors and performers select different types of stories, characters, images and sounds.

Participants would be invited to approach the theater and pick a topic, place or time on the controller. The puppets would then act out a short 1-3 minute scene based on your selection. At the end of each scene, they would ask you for more plot ideas, to guide what happens next. The performance would be recorded on video, which could be emailed to you afterwards, as shown in this first example.

This is an ambitious project, but it appeals to me deeply, because it has the potential to support a wide range of applications: from simple party entertainment to more creative uses, like a time machine simulation — or even scenario planning for group discussions.

In coming months, I would like to explore this idea with friends and collaborators, starting with simple low-tech theatrical experiments and eventually building small prototypes for key parts of the system. I am quite aware this is a large, multi-year project, so I am proposing to start small, and spread research and development over time, with actual fabrication starting a year later. This process is inspired by our collaborative work on the Pataphysical Slot Machine, which we aim to exhibit in public this year.

For this Theatre Mécanique, I hope we can find the right balance between existing storytelling traditions and new interactive technologies — so that the human qualities that make great performances possible are supported by these tools, rather than supplanted by them. Interestingly, this also ties in with the larger challenge we all face as a species, as we look for the right interplay between human and machine intelligence. To that end, I hope that we can tap diverse communities of artists and engineers to participate in this creative experiment.

Fortunately for us, there is a large community of puppeteers already practicing around the world, from Guignol to ‘toy theaters’ to Wayang — and these creative artists have already paved the way for this art form to evolve in a computer-assisted setting! I look forward to discussing these ideas with interested collaborators later this year. For now, I have included below a variety of links that might inspire us in planning this project.

Onward!

Weiwei on Alcatraz

I was really inspired by Ai Weiwei’s new art installation on Alcatraz Island.

It’s a wonderful tribute to freedom and human rights, evoking global issues that impact us all, creatively blending fear and hope in the face of oppression.

Here are my photos from our expedition with art friends from Pataphysical Studios (see the full album for more pix).

IMG_1047

‘With Wind’ features a giant dragon made of kites created by Chinese artisans, with quotes from dissidents.

IMG_1105

‘Trace’ displays pixillated portraits of 176 prisoners of conscience from around the world, created with over 1 million Lego blocks.

IMG_1155

‘Refraction’ is a large metal wing made of solar cookers, evoking the freedom of flight enjoyed by birds on Alcatraz Island.

IMG_1380

‘Stay Tuned’ fills prison cells with the words and music of many poets and activists imprisoned for their views.

Well known for blending art and activism, Weiwei was himself imprisoned by Chinese authorities in 2011 and his travel is still restricted to his native China.

IMG_1496

I highly recommend a trip to Alcatraz to see this exhibit. It’s a short boat ride from San Francisco’s Pier 33 and the round trip lasts about 3 hours. And the unique setting on Alcatraz contrasts the prison’s dark history with amazing views of the Bay and birds in flight.

Learn more about the exhibit and tickets here. For more info on how and why Weiwei created @large, watch this video or this one.

Thanks, Weiwei, for inspiring us to speak up for freedom and human rights!