The installation art I have been working on since last month have been installed. You can now see it in action in Hong Kong Book Fair from 20-26 July at Hong Kong Exhibition and Convention Centre, inside the booth of CityU Press (1D-A28).
Kinect(OpenNI) is used for motion tracking, running a program I wrote in C++ with openFrameworks. Collision and softbody simulation is done by Bullet.
Artist statement
“Between the lines/書中” is an interactive installation that visualizes the famous Chinese proverb “書中自有黃金屋”, which literally means “A book holds a house of gold”.
Viewers can go into a 3D virtual space where Chinese literature sentences suspended all over the place. By waving and touching, the Chinese characters will be transformed into gold. And with enough golden characters, a house of gold will be constructed.
The Chinese sentences are extracted from The Four Books(四書), which are the authoritative texts of Confucianism(儒家) in China written two thousand years ago. They are displayed in both traditional Chinese calligraphy and modern fonts, in the meaning of those classic texts are relevant to society independent of time.
The interaction is a visual representation of the joyful and rewarding experience of reading books. There can be multiple viewers interact with the installation at the same time, which aligned to the fact that book reading can be a social process, where readers can share thoughts, recommend books to each other.

Chinese sentences that hang inside the screen.

The house of gold appears when there is enough golden sentences.

Viewers can touch the sentences and turn them into gold.
http://www.facebook.com/video/video.php?v=255107494499599
The installation art I have been working on since last month have been installed. You can now see it in action in Hong Kong Book Fair from 20-26 July at Hong Kong Exhibition and Convention Centre, inside the booth of CityU Press (1D-A28).
http://www.facebook.com/photo.php?pid=7506253&id=96844704488&fbid=10150280671979489
http://www.facebook.com/photo.php?pid=7506266&id=96844704488&fbid=10150280672364489
http://www.facebook.com/photo.php?pid=7506261&id=96844704488&fbid=10150280672209489
http://www.facebook.com/photo.php?pid=7506250&id=96844704488&fbid=10150280671884489
Kinect(OpenNI) is used for motion tracking, running a program I wrote in C++ with openFrameworks. Collision and softbody simulation is done by Bullet.
Artist statement
"Between the lines/書中" is an interactive installation that visualizes the famous Chinese proverb "書中自有黃金屋", which literally means "A book holds a house of gold".
Viewers can go into a 3D virtual space where Chinese literature sentences suspended all over the place. By waving and touching, the Chinese characters will be transformed into gold. And with enough golden characters, a house of gold will be constructed.
The Chinese sentences are extracted from The Four Books(四書), which are the authoritative texts of Confucianism(儒家) in China written two thousand years ago. They are displayed in both traditional Chinese calligraphy and modern fonts, in the meaning of those classic texts are relevant to society independent of time.
The interaction is a visual representation of the joyful and rewarding experience of reading books. There can be multiple viewers interact with the installation at the same time, which aligned to the fact that book reading can be a social process, where readers can share thoughts, recommend books to each other.
[caption id="attachment_1097" align="alignleft" width="360" caption="Chinese sentences that hang inside the screen."][/caption]
[caption id="attachment_1098" align="alignright" width="300" caption="The house of gold appears when there is enough golden sentences."][/caption]
[caption id="attachment_1099" align="alignleft" width="360" caption="Viewers can touch the sentences and turn them into gold."][/caption]
http://www.facebook.com/video/video.php?v=255107494499599
July 23rd, 2011 at 9:08 pm (#)
very impressive. what were your reasons to go with C++ openFrameworks rather than using haXe with openframeworks or is that what you did?
Fintan
July 23rd, 2011 at 10:00 pm (#)
It looks amazing. Looks like it was a huge success.
July 24th, 2011 at 5:22 pm (#)
hi Fintan,
I need to use 3D drawing API that is introduced in OF 007. hxOF is still using 0062 at the moment.
And I want to use a 3D physic lib. Although there is JiglibHaxe, but it is quite old that I’m not sure if it works well.
Learning and practicing C++ a bit more is also useful for working with hxcpp
hi Skial,
Thanks for your kind words
July 24th, 2011 at 9:04 pm (#)
makes perfect sense to me
July 26th, 2011 at 8:54 am (#)
looks good, glad to see some kinect / of technology going to production
August 5th, 2011 at 3:02 pm (#)
Hi Andy,
I am using hxOpenframeworks and I would like to thank you for the good work
Do you have any plans to move the API to 007 ? I would be really intested
August 6th, 2011 at 7:34 pm (#)
hi whitetigle,
Yes, I am updating it to OF007, but it is quite a lot of work that you have to wait a little bit longer
August 9th, 2011 at 6:32 pm (#)
Sure ! Thanks !