“Between the lines/書中”, an installation using Kinect and openFrameworks

July 23rd, 2011  |  Published in Uncategorized  |  8 Comments

The installation art I have been working on since last month have been installed. You can now see it in action in Hong Kong Book Fair from 20-26 July at Hong Kong Exhibition and Convention Centre, inside the booth of CityU Press (1D-A28).

Come and join us to play the interactive programme at our bo
By City University of Hong Kong Press  |  View on Facebook

Kinect(OpenNI) is used for motion tracking, running a program I wrote in C++ with openFrameworks. Collision and softbody simulation is done by Bullet.

Artist statement

“Between the lines/書中” is an interactive installation that visualizes the famous Chinese proverb “書中自有黃金屋”, which literally means “A book holds a house of gold”.

Viewers can go into a 3D virtual space where Chinese literature sentences suspended all over the place. By waving and touching, the Chinese characters will be transformed into gold. And with enough golden characters, a house of gold will be constructed.

The Chinese sentences are extracted from The Four Books(四書), which are the authoritative texts of Confucianism(儒家) in China written two thousand years ago. They are displayed in both traditional Chinese calligraphy and modern fonts, in the meaning of those classic texts are relevant to society independent of time.

The interaction is a visual representation of the joyful and rewarding experience of reading books. There can be multiple viewers interact with the installation at the same time, which aligned to the fact that book reading can be a social process, where readers can share thoughts, recommend books to each other.

Chinese sentences that hang inside the screen.

The house of gold appears when there is enough golden sentences.

Viewers can touch the sentences and turn them into gold.


http://www.facebook.com/video/video.php?v=255107494499599

Tags: , , , ,

Responses

  1. Fintan says:

    July 23rd, 2011 at 9:08 pm (#)

    very impressive. what were your reasons to go with C++ openFrameworks rather than using haXe with openframeworks or is that what you did?

    Fintan

  2. Skial says:

    July 23rd, 2011 at 10:00 pm (#)

    It looks amazing. Looks like it was a huge success.

  3. Andy Li says:

    July 24th, 2011 at 5:22 pm (#)

    hi Fintan,

    I need to use 3D drawing API that is introduced in OF 007. hxOF is still using 0062 at the moment.
    And I want to use a 3D physic lib. Although there is JiglibHaxe, but it is quite old that I’m not sure if it works well.
    Learning and practicing C++ a bit more is also useful for working with hxcpp ;)

    hi Skial,

    Thanks for your kind words :)

  4. Fintan says:

    July 24th, 2011 at 9:04 pm (#)

    makes perfect sense to me :-)

  5. Marc Pelland says:

    July 26th, 2011 at 8:54 am (#)

    looks good, glad to see some kinect / of technology going to production

  6. whitetigle says:

    August 5th, 2011 at 3:02 pm (#)

    Hi Andy,
    I am using hxOpenframeworks and I would like to thank you for the good work :)

    Do you have any plans to move the API to 007 ? I would be really intested :)

  7. Andy Li says:

    August 6th, 2011 at 7:34 pm (#)

    hi whitetigle,

    Yes, I am updating it to OF007, but it is quite a lot of work that you have to wait a little bit longer ;)

  8. whitetigle says:

    August 9th, 2011 at 6:32 pm (#)

    Sure ! Thanks !

Leave a Response

*