The Virtual Reality Telerehabilitation System for Accessibility of the Built Environment: Feasibility Test of Multimedia Decision Supporting System, IP Camera, and Coded Targets

Jing Yue, MD, MS1 , JongBae Kim, PhD2 , Yan Wang PhD3 , Heba Hamza MS3
1 Xi’an JiaoTong University, Xi’an, China, 2 University of Pittsburgh, Pittsburgh, PA, 3 University of Central Florida, Orlando, FL

ABSTRACT:

A Virtual Reality Telerehabilitation System (VRTS) using Virtual Reality was developed by a University of Pittsburgh research team, which enables clinicians to assess the wheelchair accessibility of building environments from a remote location. The system was successful to assess the accessibility without visiting the remote site. However, this system also had several limitations. In order to overcome these limitations, we adapted three new technologies: a web-based multimedia decision supporting system; an IP camera; Coded Targets. In this study, we tested the feasibilities of these technologies by applying them to the actual environments. Through this study, we could confirm that these new technologies can enhance the efficiency and accuracy of our remote accessibility assessment system.

Keywords:

telerehabilitation; virtual reality, web-based, IP camera; coded targets

BACKGROUND:

There are more than 2.2 million people age 15 and over using wheelchairs in the United Stated [1]. Physical, social and environmental limitations prevent these individuals from participating in normal life. So not only is it important to improve the physical condition of the wheelchair user, it is equally significant to modify their living environment. The 1995 American Housing Survey (AHS) discovered that there are 8.9 million families have members with a physical disability, yet 57.4% had no house modifications. 5.1 million individuals with disabilities live in housing inappropriate for their conditions[2].There is a lack of architects and rehabilitation practitioners who have expertise of accessibility assessment, especially in rural areas. Distance and the lack of funds on the behalf of the wheelchair user also limit the possibility of on-site assessments. Therefore we developed a remote accessibility assessment system using virtual reality and 3D reconstruction technology. Prior studies showed that the use of a digital camera and Photomodeler software can make an acceptable virtual environment in which the accessibility can be evaluated without visiting the site [3]. However the previous system showed some limitations. First of all, it is hard to take high quality pictures. Secondly, it requires time-consuming and tedious jobs to construct 3D model and finally there is a lack of communication between clients and clinician [4]. In order to overcome these limitations, we developed a multimedia supporting system and adapted two advanced technologies: the IP camera and Coded Target.

Specific Aims: In this study, we want to test the feasibility of new technologies by:

  1. Verifying whether the use of multimedia decision supporting system can enhance the communication between clinicians and clients;
  2. Verifying whether we can take high quality pictures with the IP camera;
  3. Verifying whether we can enhance the efficiency of 3D reconstruction.

METHODOLOGY:

1) Feasibility of Web-based Multimedia Decision Supporting System;

This photograph shows the Web-based Multimedia Decision Supporting System, and demonstrates that the different members of the project can acquire and exchange the information about modification.FIGURE 1: the Web-based Multimedia Decision Supporting System; (Click image for larger view)

We built a Web-based Multimedia Decision Supporting System. This system includes several parts: document libraries, picture libraries, lists, discussion boards and surveys. We created a pilot project to examine the efficiency of this system. Six project members: a technician, a home modification specialist, a clinician, a client, a caregiver and a family member were provided with an ID and password which allowed them to enter their project and the system common area. They had the right to browse the documents uploaded via internet and upload their information and data. However they were not allowed access to any other projects, also no one else was allowed access to this particular pilot project. The pilot project was base camped at a wheelchair user’s home. Seven architectural parts (two bathrooms, a hallway, a stair way, an entry room, a kitchen, and a back porch) were selected for accessibility assessment.

2) Feasibility of Internet IP camera;

This photograph is taken by IP camera, and shows it has the equal quality with those taken by digital camera. FIGURE 2: coded targets that is detected and processed by Photomodeler Pro 5. (Click image for larger view)

We used D-Link@ IP camera to take pictures which targeted the physical environment is of a 10 square meter office. This kind of camera is supported by a wired and wireless system. We installed the camera as high and as close to the wall as possible. We manipulated the camera’s angle and zoom, and took snapshots via internet.

3) Feasibility of Coded Targets.

This photograph shows the 3D model that constructed by Photomodeler and each isolated point is Coded Target.FIGURE 3: 3D model that constructed by Photomodeler and each isolated point is Coded Target. (Click image for larger view)

We created the Coded Targets utilizing an add-on, software module belonging to Photomodeler@ Pro 5 (Eos Systems Inc.). Each Coded Target has a special code ring that can be automatically detected and processed by the Photomodeler software. Before we took pictures, we attached these targets to each wall. Within each picture we shot, there were included at least 6 Coded Targets. We constructed the 3D model of the target office by Photomodeler Pro 5 with the photos we took by IP camera.

RESULTS:

1) Feasibility of Web-based Multimedia Decision Supporting System;

We uploaded some shared documents about VRTS so that rehabilitation engineers and home modification specialists could update their information about this system and client. Original pictures and constructed 3D models of each part of a wheelchair user’s home were also uploaded into picture libraries. Then the complete 3D model including all parts was created and uploaded. The architect can access a complete or partial view of given wheelchair user’s home easily and measure the target objects in the reconstructed 3D virtual reality environment. Through these measurements, some suggestions can be made regarding possible modification of a wheelchair user’s house. All parties involved in this pilot project can easily discuss all topics regarding any modification of the wheelchair user’s house. We created a preliminary information survey form that requests information regarding such as the wheelchair user’s mobility aids, physical environment, client’s needs, and health professional’s recommendations. The client and his/her regional health professionals can conveniently complete the survey via the internet. This also allows project members to easily access this information.

2) Feasibility of Internet IP camera;

We used an IP camera, to take pictures. Each picture met our qualification standards and included at least 6 Coded Targets. Each significant point of the objects we wanted to build was prominent and obvious. This included the door, the furniture and the wall corner. The quality and definition of the pictures taken by the IP camera were not different from those taken by the digital camera which we used in previous studies. We were able to construct a reliable 3D model using these pictures.

3) Feasibility of Coded Targets.

We used a total of 26 Coded Targets on four walls, averaging 6 targets on each wall. Each Coded Targets either faced the camera directly or was on a considerable angle was easily detected by the Photomodeler software. Before we built a 3D model we needed to orient the pictures we chose. Photomeodelr was able to identify and process automatically the same target regardless of the picture chosen. Each picture which included marked Coded Targets was oriented automatically and accurately. This occurred before we marked the significant point of the aimed objects. With the automatically oriented 3D model, we can mark our target object easily, measure them, and assess the accessibility.

CONCLUSION:

Through these feasibility tests, we investigated the applicability and adaptability of three new technologies: multimedia decision supporting system, IP camera, and Coded Targets. Through multimedia decision supporting system, all participating project members can share their information and data via internet. This system resolves the distributional disproportion of rehabilitation resources especially in rural area where the people with a disability lack the contact with clinical and architectural experts. IP camera and Coded Targets give us more choice during the 3D construction model of the real house environment. We can acquire high quality pictures of our targeted environment by manipulating the IP camera without spending time teaching others to take pictures. With the Coded Target Module, we can speed up our process and enhance the efficiency and accuracy of building 3D construction models. With this research, we can conclude that the new technologies can enhance our Virtual Reality Telerehabilitation System. Now, we are planning more comprehensive research with more field applications in order to evaluate the value of the enhanced system with these new technologies.

REFERENCES:

  1. McNeil, JM. (2001). Americans With Disabilities: 1997 U.S. Department of Commerce, Economics and Statistics Administration Bureau of the Census.
  2. U.S. Department of Housing and Urban Development, U.S. Department of Commerce. (1995). Supplement to the American Housing Survey for the United States. Washington (DC): U.S. Census Bureau, 7896.
  3. JongBae Kim, David M. Brienza. (2006). Development of a remote accessibility assessment system through three-dimensional reconstruction technology. Journal of Rehabilitation Research & Development, 2, 257-272.
  4. Kim J. Brienza DM. (2006). The Virtual Reality Telerehabilitation System for Analyzing Accessibility of the Physical Environment: Field Evaluation. Proceeding of RESNA 29th International Conference.

Acknowledgements:

This work was funded through RERC on Telerehabilitation by the NIDRR. Opinions expressed are those of the authors and do not necessarily reflect those of the funding agencies.

Jing Yue, a doctorial student of Research Centre of Rehabilitation Science and Technology of Xi’an JiaoTong University, China, has worked for this study as an international exchange scholar at University of Pittsburgh since 2006 September.

Contact Information:

Jing Yue, MD, MS.
Research Centre of Rehabilitation Science and Technology
School of Life Science and Technology
Xi’an JiaoTong University
No.28 XianNing West Road
Xi’an, 710049
ShaanXi, China
Tel: 86-29-88263497
Email: jiy24@pitt.edu or xiaojingjj@mail.xjtu.edu.cn

Highlights

  • Source Ordered
  • No Tables
  • Very Compatible

Gargoyles

Disney produced a television show in the mid 1990s called Gargoyles. It's a great show and I'm a big fan. A few years ago Disney started to release the show on DVD. The last release was of season 2, volume 1. That was two years ago. Volume 2 has not been released. Why? Poor sales. So if you should find yourself wanting to support my work, instead I ask you pick up a copy of season 2, volume 1. It's a great show and you might find yourself enjoying it.