Andy Li's Blog

The installation art I have been working on since last month have been installed. You can now see it in action in Hong Kong Book Fair from 20-26 July at Hong Kong Exhibition and Convention Centre, inside the booth of CityU Press (1D-A28).

103" Plasma HD TV
By City University of Hong Kong Press  |  View on Facebook

Come and join us to play the interactive programme at our bo
By City University of Hong Kong Press  |  View on Facebook

By City University of Hong Kong Press  |  View on Facebook

By City University of Hong Kong Press  |  View on Facebook

Kinect(OpenNI) is used for motion tracking, running a program I wrote in C++ with openFrameworks. Collision and softbody simulation is done by Bullet.

Artist statement

“Between the lines/書中” is an interactive installation that visualizes the famous Chinese proverb “書中自有黃金屋”, which literally means “A book holds a house of gold”.

Viewers can go into a 3D virtual space where Chinese literature sentences suspended all over the place. By waving and touching, the Chinese characters will be transformed into gold. And with enough golden characters, a house of gold will be constructed.

The Chinese sentences are extracted from The Four Books(四書), which are the authoritative texts of Confucianism(儒家) in China written two thousand years ago. They are displayed in both traditional Chinese calligraphy and modern fonts, in the meaning of those classic texts are relevant to society independent of time.

The interaction is a visual representation of the joyful and rewarding experience of reading books. There can be multiple viewers interact with the installation at the same time, which aligned to the fact that book reading can be a social process, where readers can share thoughts, recommend books to each other.

Chinese sentences that hang inside the screen.

The house of gold appears when there is enough golden sentences.

Viewers can touch the sentences and turn them into gold.

http://www.facebook.com/video/video.php?v=255107494499599

The installation art I have been working on since last month have been installed. You can now see it in action in Hong Kong Book Fair from 20-26 July at Hong Kong Exhibition and Convention Centre, inside the booth of CityU Press (1D-A28). http://www.facebook.com/photo.php?pid=7506253&id=96844704488&fbid=10150280671979489 http://www.facebook.com/photo.php?pid=7506266&id=96844704488&fbid=10150280672364489 http://www.facebook.com/photo.php?pid=7506261&id=96844704488&fbid=10150280672209489 http://www.facebook.com/photo.php?pid=7506250&id=96844704488&fbid=10150280671884489 Kinect(OpenNI) is used for motion tracking, running a program I wrote in C++ with openFrameworks. Collision and softbody simulation is done by Bullet. Artist statement "Between the lines/書中" is an interactive installation that visualizes the famous Chinese proverb "書中自有黃金屋", which literally means "A book holds a house of gold". Viewers can go into a 3D virtual space where Chinese literature sentences suspended all over the place. By waving and touching, the Chinese characters will be transformed into gold. And with enough golden characters, a house of gold will be constructed. The Chinese sentences are extracted from The Four Books(四書), which are the authoritative texts of Confucianism(儒家) in China written two thousand years ago. They are displayed in both traditional Chinese calligraphy and modern fonts, in the meaning of those classic texts are relevant to society independent of time. The interaction is a visual representation of the joyful and rewarding experience of reading books. There can be multiple viewers interact with the installation at the same time, which aligned to the fact that book reading can be a social process, where readers can share thoughts, recommend books to each other. [caption id="attachment_1097" align="alignleft" width="360" caption="Chinese sentences that hang inside the screen."][/caption] [caption id="attachment_1098" align="alignright" width="300" caption="The house of gold appears when there is enough golden sentences."][/caption] [caption id="attachment_1099" align="alignleft" width="360" caption="Viewers can touch the sentences and turn them into gold."][/caption] http://www.facebook.com/video/video.php?v=255107494499599

Augmented Mirror is my latest large-scale project. It is a development of the technique that uses an one-way mirror to archive augmented reality. You can read more about it at its web site (still in development).

Using the technique, a sample installation called Mind-Body Interaction is made. As the title suggests, it is about Philosophy of mind. It has just been exhibited in Playful Media (SIG Showcase, Exhibition of BSc Creative Media) and The SCM Annual (graduation show of School of Creative Media).

Here below is an interview done in Playful Media:

I’m glad that the artwork is mentioned in some of the news on the exhibitions:

Augmented Mirror appearing on the CityU News.

Augmented Mirror appearing on HK Headline (頭條日報).

By the way, thanks for my teachers and schoolmates for all the efforts put in the exhibitions!

Augmented Mirror is my latest large-scale project. It is a development of the technique that uses an one-way mirror to archive augmented reality. You can read more about it at its web site (still in development). Using the technique, a sample installation called Mind-Body Interaction is made. As the title suggests, it is about Philosophy of mind. It has just been exhibited in Playful Media (SIG Showcase, Exhibition of BSc Creative Media) and The SCM Annual (graduation show of School of Creative Media). Here below is an interview done in Playful Media: [youtube width="740" height="440"]http://www.youtube.com/watch?v=xDm_wB07gwc[/youtube] I'm glad that the artwork is mentioned in some of the news on the exhibitions: [caption id="attachment_814" align="alignnone" width="235" caption="Augmented Mirror appearing on the CityU News."][/caption] [caption id="attachment_815" align="alignnone" width="450" caption="Augmented Mirror appearing on HK Headline (頭條日報)."][/caption] By the way, thanks for my teachers and schoolmates for all the efforts put in the exhibitions!

My FYP will be a research on a new technique of augmented reality using a one-way mirror. With the help of real-time 3D motion tracking of the viewer, 3D content can be projected on the mirror in the right perspective achieving a augmented reality. In this case, the user can interact with the virtual 3D content in a very intuitive way.

With a one-way mirror, which the reflective side is facing viewers, the back side is attached a thin projection surface. The projection is from the back side of the mirror. Since the reflective side of the one-way mirror is a bit transparent, the light from the projection surface will be able to pass through the mirror and seen by the viewers.

To make the 3D content correctly placed in the viewer’s perspective, real-time 3D motion tracking is used to detect the viewer’s eye position. The data is then pass to the computer with responsible for generating 3D content. The body position data is also used to implement interaction between the viewer and the virtual 3D content.
The 3D tracking will be done by placing two or more web-cam at the back side of the mirror. The image is sent to the computer. A 3D reconstruction with the images from the cameras and all 3D properties of the viewer will be collected.

With the developed technique in this research, a interactive installation will be made. The title of the installation will be “Mind-body interaction”.
It is a large problem in Philosophy that whether there are any interaction between mind and body of a human. If there is, in what form the interaction is taking place. There is several different ideas toward this topic: substance dualism, property dualism, idealism, materialism etc. The installation is trying to introduce a artistic, new way of mind-body interaction which let viewers to think of this Philosophy question through experience.
While the set-up will be nearly the same as what is described above, the added 3D content in the mirror will be some abstract lighting and visual effect generated by the viewer’s brainwave. The visualized brainwave and the reflected body of the viewer are corresponding to the mind and body of the viewer. And the viewer is allowed to manipulate or affect the 3D content in the mirror, a mind-body interaction is achieved in a symbolic way.
For getting the brainwave of the viewer, a brainwave sensor which is wore on the viewer’s head is used. (The sensor will be bought from the Internet.)

My FYP will be a research on a new technique of augmented reality using a one-way mirror. With the help of real-time 3D motion tracking of the viewer, 3D content can be projected on the mirror in the right perspective achieving a augmented reality. In this case, the user can interact with the virtual 3D content in a very intuitive way. With a one-way mirror, which the reflective side is facing viewers, the back side is attached a thin projection surface. The projection is from the back side of the mirror. Since the reflective side of the one-way mirror is a bit transparent, the light from the projection surface will be able to pass through the mirror and seen by the viewers. To make the 3D content correctly placed in the viewer's perspective, real-time 3D motion tracking is used to detect the viewer's eye position. The data is then pass to the computer with responsible for generating 3D content. The body position data is also used to implement interaction between the viewer and the virtual 3D content. The 3D tracking will be done by placing two or more web-cam at the back side of the mirror. The image is sent to the computer. A 3D reconstruction with the images from the cameras and all 3D properties of the viewer will be collected. With the developed technique in this research, a interactive installation will be made. The title of the installation will be "Mind-body interaction". It is a large problem in Philosophy that whether there are any interaction between mind and body of a human. If there is, in what form the interaction is taking place. There is several different ideas toward this topic: substance dualism, property dualism, idealism, materialism etc. The installation is trying to introduce a artistic, new way of mind-body interaction which let viewers to think of this Philosophy question through experience. While the set-up will be nearly the same as what is described above, the added 3D content in the mirror will be some abstract lighting and visual effect generated by the viewer's brainwave. The visualized brainwave and the reflected body of the viewer are corresponding to the mind and body of the viewer. And the viewer is allowed to manipulate or affect the 3D content in the mirror, a mind-body interaction is achieved in a symbolic way. For getting the brainwave of the viewer, a brainwave sensor which is wore on the viewer's head is used. (The sensor will be bought from the Internet.)