Andy Li's Blog

Here below is the work schedule hosted on Google Calendar. The schedule only shows the 1st level of the WBS to allow more flexibility since the school has not release official FYP schedule yet.

1. Research on related projects.
Sun, July 26 – Sun, August 9

2. Research on possible hardware and software.
Sun, August 2 – Sun, August 16

3. Hardware/software design.
Wed, August 12 – Mon, August 31

4. Built the hardware.
Tue, September 1 – Tue, September 22

5. Built the software.
Tue, September 1 – Mon, November 30, 2009

6. Integrated Testing.
Sun, November 22, 2009 – Sun, December 20, 2009

7. Development of “mind-body interaction”
Mon, December 21, 2009 – Sun, February 28, 2010

8. Documentation and others
Mon, March 1, 2010 – Fri, April 30, 2010

Here below is the work schedule hosted on Google Calendar. The schedule only shows the 1st level of the WBS to allow more flexibility since the school has not release official FYP schedule yet. 1. Research on related projects. Sun, July 26 – Sun, August 9 2. Research on possible hardware and software. Sun, August 2 – Sun, August 16 3. Hardware/software design. Wed, August 12 – Mon, August 31 4. Built the hardware. Tue, September 1 – Tue, September 22 5. Built the software. Tue, September 1 – Mon, November 30, 2009 6. Integrated Testing. Sun, November 22, 2009 – Sun, December 20, 2009 7. Development of “mind-body interaction” Mon, December 21, 2009 – Sun, February 28, 2010 8. Documentation and others Mon, March 1, 2010 – Fri, April 30, 2010

1. Research on related projects.
　　1.1 Research on projects related to AR
　　1.2 Research on projects related to Mirror
2. Research on possible hardware and software.
　　2.1 Research on possible hardware
　　2.2 Research on possible software
　　　　2.2.1 AR engine/library
　　　　2.2.2 3D reconstruction/motion tracking
3. Hardware/software design.
　　3.1 Choose the suitable hardware/software combination
　　3.2 Sketch diagrams of hardware setup
　　3.3 Application structure design
　　3.4 Interface design
4. Built the hardware.
　　4.1 Buy the hardware/materials
　　4.2 Set up
5. Built the software.
　　5.1 Programming on configuration settings
　　5.2 Programming on 3D reconstruction/motion tracking
　　5.3 Build a testing prototype
6. Integrated Testing.
　　6.1 Functional testing
　　6.2 Benchmarking on speed and accuracy
7. Development of “mind-body interaction”
　　7.1 Brainwave visualization method and algorithm
　　7.2 Interface/User experience design
　　7.3 Programming and testing
8. Documentation and others
　　8.1 Small leaflet
　　8.2 Video (instruction for user, promotion)
　　8.3 Project website
　　8.4 Final report

1. Research on related projects. 　　1.1 Research on projects related to AR 　　1.2 Research on projects related to Mirror 2. Research on possible hardware and software. 　　2.1 Research on possible hardware 　　2.2 Research on possible software 　　　　2.2.1 AR engine/library 　　　　2.2.2 3D reconstruction/motion tracking 3. Hardware/software design. 　　3.1 Choose the suitable hardware/software combination 　　3.2 Sketch diagrams of hardware setup 　　3.3 Application structure design 　　3.4 Interface design 4. Built the hardware. 　　4.1 Buy the hardware/materials 　　4.2 Set up 5. Built the software. 　　5.1 Programming on configuration settings 　　5.2 Programming on 3D reconstruction/motion tracking 　　5.3 Build a testing prototype 6. Integrated Testing. 　　6.1 Functional testing 　　6.2 Benchmarking on speed and accuracy 7. Development of "mind-body interaction" 　　7.1 Brainwave visualization method and algorithm 　　7.2 Interface/User experience design 　　7.3 Programming and testing 8. Documentation and others 　　8.1 Small leaflet 　　8.2 Video (instruction for user, promotion) 　　8.3 Project website 　　8.4 Final report

My FYP will be a research on a new technique of augmented reality using a one-way mirror. With the help of real-time 3D motion tracking of the viewer, 3D content can be projected on the mirror in the right perspective achieving a augmented reality. In this case, the user can interact with the virtual 3D content in a very intuitive way.

With a one-way mirror, which the reflective side is facing viewers, the back side is attached a thin projection surface. The projection is from the back side of the mirror. Since the reflective side of the one-way mirror is a bit transparent, the light from the projection surface will be able to pass through the mirror and seen by the viewers.

To make the 3D content correctly placed in the viewer’s perspective, real-time 3D motion tracking is used to detect the viewer’s eye position. The data is then pass to the computer with responsible for generating 3D content. The body position data is also used to implement interaction between the viewer and the virtual 3D content.
The 3D tracking will be done by placing two or more web-cam at the back side of the mirror. The image is sent to the computer. A 3D reconstruction with the images from the cameras and all 3D properties of the viewer will be collected.

With the developed technique in this research, a interactive installation will be made. The title of the installation will be “Mind-body interaction”.
It is a large problem in Philosophy that whether there are any interaction between mind and body of a human. If there is, in what form the interaction is taking place. There is several different ideas toward this topic: substance dualism, property dualism, idealism, materialism etc. The installation is trying to introduce a artistic, new way of mind-body interaction which let viewers to think of this Philosophy question through experience.
While the set-up will be nearly the same as what is described above, the added 3D content in the mirror will be some abstract lighting and visual effect generated by the viewer’s brainwave. The visualized brainwave and the reflected body of the viewer are corresponding to the mind and body of the viewer. And the viewer is allowed to manipulate or affect the 3D content in the mirror, a mind-body interaction is achieved in a symbolic way.
For getting the brainwave of the viewer, a brainwave sensor which is wore on the viewer’s head is used. (The sensor will be bought from the Internet.)

My FYP will be a research on a new technique of augmented reality using a one-way mirror. With the help of real-time 3D motion tracking of the viewer, 3D content can be projected on the mirror in the right perspective achieving a augmented reality. In this case, the user can interact with the virtual 3D content in a very intuitive way. With a one-way mirror, which the reflective side is facing viewers, the back side is attached a thin projection surface. The projection is from the back side of the mirror. Since the reflective side of the one-way mirror is a bit transparent, the light from the projection surface will be able to pass through the mirror and seen by the viewers. To make the 3D content correctly placed in the viewer's perspective, real-time 3D motion tracking is used to detect the viewer's eye position. The data is then pass to the computer with responsible for generating 3D content. The body position data is also used to implement interaction between the viewer and the virtual 3D content. The 3D tracking will be done by placing two or more web-cam at the back side of the mirror. The image is sent to the computer. A 3D reconstruction with the images from the cameras and all 3D properties of the viewer will be collected. With the developed technique in this research, a interactive installation will be made. The title of the installation will be "Mind-body interaction". It is a large problem in Philosophy that whether there are any interaction between mind and body of a human. If there is, in what form the interaction is taking place. There is several different ideas toward this topic: substance dualism, property dualism, idealism, materialism etc. The installation is trying to introduce a artistic, new way of mind-body interaction which let viewers to think of this Philosophy question through experience. While the set-up will be nearly the same as what is described above, the added 3D content in the mirror will be some abstract lighting and visual effect generated by the viewer's brainwave. The visualized brainwave and the reflected body of the viewer are corresponding to the mind and body of the viewer. And the viewer is allowed to manipulate or affect the 3D content in the mirror, a mind-body interaction is achieved in a symbolic way. For getting the brainwave of the viewer, a brainwave sensor which is wore on the viewer's head is used. (The sensor will be bought from the Internet.)