Smart Powered Wheelchair Platform Design and control for People with Severe Disabilities

Development of new systems for disabled and elderly people’s assistance requires a multidiscip linary approach based on new technologies according to users’ needs. Intelligent wheelchairs can help this category of people to live more independently. The purpose of this paper is to propose and develop embedded control architecture for smart wheelchair monitoring, leading to gain mobility and independency. The control arch itecture uses virtual impedance principle and is based on some considerations concerning external force-feedback joystick abilities to translate variations of distances between the wheelchair and obstacles into a perceived effort . To test the effectiveness and evaluate performances of the proposed control architecture, some simulat ions and experimentations on a smart wheelchair called LIASD-WheelChair, are designed in this respect.


Introduction
Develop ment of new systems for d isabled and elderly people's assistance requires a mult idisciplinary approach based on new technologies according to the users' needs. Researches in med ical, paramed ical and advanced technologies fields can collaborate d irectly to develop new strategies ranging fro m simp le assistance to various access services such as websites, Smart phone and so on. As a kind of rehabilitation systems, intelligent wheelchairs can play an important role in help ing the handicapped and the elderly people to live more independently and autonomously [1][2].
One of the main trends in s mart wheelchairs development is how to ensure a reliable remote tele-operation task with obstacle avoidance in a constrained environment taking into account system's interactive behav io r. Various methods h av e b een inv estig ated in th is con text s uch as ed ge detection [3], potential field [4] and impedance control [5]. In edge detection methods, the objective is to determine the vertical edges of the obstacle and consequently attempts to steer the mobile system around an edge. The main drawback is the pro ximity between the mobile system and the obstacles which is not suitable for the real time co mputation. Potential field methods allo w a collision avoidance motion planning by generating a virtual force against obstacles and toward the goal. An attractive fo rce between the mobile system and the target, and a repulsive force against obstacles are generated.
As it's mentioned in [1], all these methods have advantage of making the fast motion planning for nearby obstacles, but with a shortcoming of getting into a local min imu m where the attractive and repulsive forces are equal.
To overcome the local minimu m, an extended virtual force field method is proposed, where a free vector is added to the repulsive force. This force becomes larger for the larger obstacles since repulsive forces are co ming fro m all obstacle-detecting sensors, which makes this method unsuitable for certain applications. Impedance methods which are based on the concept of active control constitute a considerable contribution to deal with issues cited above. Both free and constrained motions can be handled by controlling the relat ion between input co mmands and robot-environment contact forces. In the same manner, impedance methods based on virtual aspects [6] are used to determine a repulsive force fo r mobile robot navigation avoiding obstacles. The principle is to generate a virtual force between mobile system and environment using exteroceptive localizat ion tools such as US sensors, LIDAR and so on. In the most cases, these generated virtual forces are transferred and translated to a hu man operator through a joystick as tactile informat ion. In this paper, we are interested by this kind of approach to monitor a smart wheelchair through a wireless communication network based 802.11 standards.
The remainder of this paper is organized as follow: in section 2, we present some related works concerning smart wheelchairs research projects. Section 3 describes experimental setup overview called LIAS D-WheelChair where hardware and software aspects are illustrated. In order to ensure a reliable remote tele-operation task in a constrained environment, in section 4, we've proposed a strategy for wheelchair monitoring and control based on virtual impedance concepts. Experimental and simu lation results are outlined in section 5. Finally, a brief conclusion and perspectives are summarized in the last section.

Some Related Works
Several research projects [7][8][9][10] using novel emerg ing technologies have been directed in the last decade to conceive and develop new hardware and software architectures to enhance the quality of service in terms of autonomy, mobility and accessibility. As an examp le, a TAO-2 project has been developed to increase the efficiency use of smart wheelchair [11] by establishing a methodology to design, imp lement, and test an effective add-on autonomy management system for use in conjunction with most common co mmercially available power wheelchairs. An adaptive, flexib le and intelligent assistive technology has been proposed enabling users to participate fully in their daily lives [12][13]. An anti-co llision and navigation systems aims to provide safe and intuitive means of mobility for people who have cognitive disabilit ies. In [14], intelligent assistance-system has been conceived to facilitate driv ing for severe disabled and elder people with heavy reduced physical and/or mental abilit ies. The idea is to make use of a cognitive model of the user to reduce considerably the amount of necessary user commands in order to enhance the dependability of the wheelchair control. A UT-Intelligent Wheelchair is a project that develops the notion of graceful motion for a robotic wheelchair mot ion [15]. TinMan [16] and Wheelesley [17] are two research projects that have been highlighted by designing control systems based on a graphical user interface that has successfully been integrated with an eye tracking system and single switch scanning as input methods. More recently, in [18], a Smart wheelchair uses a virtual interface displayed by an on-board projection system to implement a shared control framework that enables the user to interact with the wheelchair wh ile it is performing an autonomous task. In [19], a modular smart wheelchair co mponent system SWCS wh ich can be added to a variety of co mmercial power wheelchairs has been elaborated. It is designed for all trad itional input methods accommodations and for co mpatib ility with mult iple brands of wheelchairs. A s mart wheelchair integrating intelligent controllers that helps people with physical disabilities overcome daily problems has been proposed in [20]. It's equipped with onboard processing and mult iple sensors. The system operates as a completely autonomous mobile robot platform. An intelligent control system allo ws giving mo re assistance to the users according to various sensors informat ion such as cameras, laser range finder, and an onboard processing. In [21], a collaborative wheelchair assistant WCA is proposed for a full use of hu man skills by involving the user into the navigation control. The user gives the high-level commands and directly controls the speed, while the lo w-level control is taken over by the mach ine, which is tracking a software defined guide path. Based on some successful experiments results, path guidance brings safe motion and drastically simplifies the control. Hence, the wheelchair user adopts an optimal driving behavior fro m the first trial with a min imu m of intervention. In the same manner, in [22], a research derived fro m the field of mob ile robotics has been investigated to show how collaborative control techniques can be used to insure a best user-powered wheelchair interaction, predict ing user intentions and responding to these predictions with adaptable levels of assistance. The same studies as in [23], illustrate how collaborative controls between user and wheelchair can be benefit. Another project allowing severely disabled people suffering fro m parapleg ia and quadriplegia to steer an automated wheelchair is proposed [24]. It consists on a combination of a non-invasive EEG-based human-robot interface and an autonomous navigation system that safely executes issued commands. In [25], a s mart and automated wheelchair is experimented in co mplex navigational situations. For a given task, a conventional joystick and a proportional head-joystick can be used to assist the operator in his manoeuvring. Altering the translational and rotational velocities in situations where an obstacle blocks the user-commanded way, the driving assistance module significantly imp roves driver-performance by preventing all collisions along the way.
The work p resented in this paper has the same perspectives as those concerning research projects mentioned above. It investigates one of the main trends in smart wheelchairs develop ment area, which is about how to ensure a reliab le remote tele-operation task with obstacle avoidance in free and constrained environments taking into account system' interactive behavior. Thus, Impedance control method based on the concept of active control can be considered also as an important contribution to deal with issues cited above. It provides a unified approach to all aspects of manipulation. Both free motion and contact tasks can be controlled using a single control algorith m. This method imp lements an algorithm that controls the relation between a velocity command and the contact force, which models the interconnection between an uncertain environment and a robot as impedance. In virtual impedance method, impedance is used to determine a repulsive force for mobile robot navigation avoiding obstacles. As an example, the princip le of this method is used in [26], where the objective is to generate a virtual force between a wheelchair and the environment, wh ich, in addition to the visual informat ion, is transferred to a hu man operator through a joystick as tactile informat ion.
In this paper, we are interested by this kind of control and particularly those concerning virtual impedance methods. For this purpose, we've proposed and developed embedded control architecture for smart wheelchair control and monitoring. The approach uses virtual impedance concept and is tested on experimental platform called LIASD-WheelChair. The implementation is based on some considerations concerning external fo rce-feedback joystick abilities to translate variations of distances between a smart wheelchair and obstacles into a perceived effort. The approach explo its also information provided by Wireless Internet Camera Server, wh ich is mounted on the wheelchair headrest, enabling the user to refine the odometry by computing the distance of objects fro m the wheelchair and then determine the safest routes to the desired location.
In what follows, we p resent the experimental p latform called LIASD-WheelChair, developed in our laboratory in collaboration with Engineering Research Center CRIIP of Orsay University.

Embedded Architecture
LIASD-Wheelchair prototype is an adjustable adults' powered wheelchair ( Figure.1). It has the same mechanical structure as Storm3 and can be monitored according to two operating modes: local mode and remote mode via wireless communicat ion network based on 802.11 standards. It is suitable for indoor or outdoor use, has a range of 30km, and has the capacity to climb 35% slopes and 15cm kerbs. The wheelchair includes some standard features: a non-powered seating platform, adjustable removable armrests with embedded joystick, adjustable swinging leg-rests and a head-rest incorporating an embedded camera. The wheelchair is fitted with four u ltrasonic (US) sensors to identify obstacles from distance of 3cm to 6m, with 3 to 4cm of resolution. Our system includes two optical incremental encoders with resolution of 500 Counts per Revolution. The wireless network is based on IEEE 802.11 standard. The wheelchair can be controlled remotely using external force-feedback joystick. An embedded laptop mounted at the rear of the wheelchair allows managing US sensors via Fiveco card and controls Roboteq card using respectively an Ethernet and serial RS232 lin ks.
In order to ensure navigation and anti-collision objectives a Wireless Internet Camera Server (TV-IP110W) is mounted on the wheelchair headrest. Images from the camera can be used to refine the odometry by computing the distance of objects from the wheelchair and then determine the safest routes to the desired location taking into account collision avoidance strategy. The wheelchair embeds also a USB joystick wh ich is a little bit more sophisticated than traditional one. The joystick wh ich is a SpeedLink SL-6612 has many configurable buttons that makes the navigation easier.  The strategy level defines the way the wheelchair can achieve the main goal prev iously defined. Algorithms such as planning trajectories, localization, etc. are imp lemented to fulfill and ensure a desired task. Thus, a set of elementary actions are generated in the tactical level aiming to satisfy reached goals. In the basic control level, a PID control using an AX2550 controller is implemented. It can be configured in a speed or position mode using a selection matrix. An I2C p rotocol is used to manage US sensors module via a Fiveco card, and imp lement USB and RS232 communicat ion bus for embedded laptop (Asus-EeePC-10002H) and AX2550 controller interconnection. Via an adapter, incremental encoders are connected to Roboteq card trough RJ45 lin k.

Communicati on Archi tecture
An embedded Asus-EeePC-1002H laptop use to control the whole architecture of the wheelchair, includes some features allowing a better info rmation handling of different embedded modules (FiveCo, RoboTek, TRENDnet-TV camera,...) as well as those remotely located (server, routers ,...) v ia a wireless network. Based on wireless IEEE 802.11 standard network, the wheelchair can be controlled and monitored continuously using an external joystick. In order to refine the odometry, informat ion derived fro m wireless internet camera server allo w the user to estimate d istances between objects and the wheelchair thus to determine the safest routes to the desired location by avoiding collisions. This kind o f mon itoring can find its usefulness in some constraining situations as binding postures of the wheelchair in the env iron ment, unconscious ness or tiredness of disabled people, and so on.
In this paper, we are interested by this kind of communicat ion network. The objective is to ensure a reliab le remote tele-operation task in a constrained environment by proposing a strategy for LIASD-WheelChair monitoring and control based on virtual impedance concepts. The control strategy is presented in the next section.

Proposed Approach Princi ples
Since the works of Hogan in [27], impedance control approach is considered as one of the most frameworks to control the interactions between system and environ ment. This kind of approach ensures a smooth imp lementation of desired tasks by taking into account some real impedance parameters properties such as inertia, v iscosity and stiffness, so that: Where F e describes the interaction force between system and environment and M e , B e and K e represent respectively the desired inertia, v iscosity and stiffness of the considered system.
The displacement between the current position of the system X e and the desired one X d , can be defined as follows: (2) The principle of classical impedance is clearly illustrated bellow ( Figure.5). Since no effort is exerted until making contact between system and environment, this approach is not useful [16]. Recent researches have been directed towards the development of new concepts based on VI principles using visual information [17] [18].
Based on these works, and particularly on those developed in [16], we propose in this paper a non-contact impedance control approach for smart wheelchair monitoring through wireless communicat ion based on 802.11 standard. As shown on Figure.6, virtual impedance is represented as spherical configuration between a mobile system and environment obstacles. Thus, when the mobile co mes inside the virtual sphere, a v irtual fo rce is then generated before any contact. Let us consider now, the case when the mobile approaches a security zone, and set a virtual sphere with radius r at the center of the mobile.
When the mobile co mes into the interior of the v irtual sphere, the normal vector fro m the surface of the sphere to the mobile dX 0 can be written as: represents the displacement vector of the mobile fro m position X 0 to the center of the sphere X ev .
The vector l n ℜ ∈ is given by: If the mob ile node moves inside the virtual sphere ( ) r X r < , virtual impedance can be highlighted by computing a virtual force-feedback l ev F ℜ ∈ exerted on the center of that sphere as follows: . (5) Where, M ev , B ev and K ev represent respectively the virtual inertia, v iscosity and stiffness. One can note that the virtual force F ev becomes zero when the mobile is not in the virtual sphere or is at the center of that sphere.
Moreover, one can note that a closed loop speed mode is performed using a full featured PID algorith m. The ult imate goal in well tuned PID parameters is to allow reaching the desired speed quickly without overshoot or oscillation. In that way, every 16 milliseconds, the controller can measure the actual motor speed and subtracts it fro m the desired position to compute the speed error. The resulting error value is then mult iplied by a user selectable Proportional Gain. The effect of this part of the algorith m is to apply power to the motor which is proportional with the difference between the current and desired speed: when far apart, high power is applied, with the power being g radually reduced as the motor moves to the desired speed. This approach is implemented according to some considerations concerning force-feedback joystick ab ilities to monitor remotely LIASD-WheelChair taking into account environment obstacles (Figure.7). The proposed algorithm for our application shows that according to US sensors data, the perceived efforts as tactile informat ion on the joystick allo w the users to take the right decisions for wheelchair monitoring.

Software As pects
As shown on Figure.8, we have developed a software architecture including a set of classes taking into account the application entirely. Thus, G_SDL_Jostick and joy_impl represent two classes developed to handle the force-feedback joystick module allo wing the user to monitor remotely the wheelchair.
We note that these classes are developed with Qt and implemented under directInput tool.

Simulation and Experimental Results
The objective is to perform some tests in order to analyse the behavior of the LIASD-WheelChair interacting with environment. Thus, based on generated virtual fo rces that are transferred and translated through a joystick as tactile informat ion, the human operator can perform a set of movements to maneuver the wheelchair. In this context, as a model o f environ ment, we have proposed a circular configuration with a real behavior model of LIASD-WheelChair. One can note that different models of environment can be chosen such as square, ellipse, etc.
First, virtual impedance parameters K ev , B ev and M ev are set arbitrarily and respectively to the following values 50[N/ m], 10[Ns/ m] and 2 [kg]. Notice that the stiffness of the object is much h igher that the positional stiffness of the impedance, so that the environment can be considered rig id. Moreover, for Sa mple-axis, each second corresponds to 100 Samp les. Figure.9, illustrates the exerted efforts by the joystick in the environment (Environment 1). Indeed, fro m samp le 250, we note an increasing of the perceived efforts on the joystick corresponding to the first contact between the wheelchair and the virtual sphere. At this time, the reached value is 1100 and oscillates around 1000 and 1250. After sample 2000, the perceived force decreases to a minimu m value o f 400. Despite this, the intensity remains very weak.  Figure.10, one can see that the real trajectory of wheelchair (Environment 1) doesn't reflect the desired one, but it also goes beyond the specified environ ment. This can be explained by the fact that the virtual stiffness has a small value which leads to a weak force felt on the joystick.
To show the interest of the proposed virtual impedance method, we have simulated another imp lementation with different value of K ev . Thus, we have integrated a value of 250[N/ m]. Thus, as we can see fro m Figure.9 and Figure.10, the joystick set a real trajectory which doesn't go through the desired one (Environment 2). The fact that the stiffness value is significant, the perceived efforts are also significant (Environ ment 2) leading thus, to make the wheelchair follow the trajectory without any direct contact with real environment. These results show that the increasing of the perceived efforts, fro m samp le 300, to the value of 1000 corresponds to an elementary d isplacement dX 0 of 20 [cm]. Th is illustrates the first contact between the wheelchair and the virtual sphere. These efforts tend to oscillate respectively between 1200 and 25 accord ing to X and Y-axis. Figure.11 and Figure.12 show respectively the wheelchair trajectories according to X-axis and Y-axis for different values of environment stiffness K ev = 50[N/ m] and 250[N/ m]. According to changing parameters like those of environment and robot-environment interaction, the controller must be adaptive to time-variable system, which is an important feature for its imp lementation. In fact, when the wheelchair motion is constrained by the environment, its trajectory is modified using contact forces. This can be considered as a disturbance which could rapidly change the global behaviour of the task. In this case, the use of virtual impedance control is very efficient and the corresponding results are very close to the desired ones, except some peaks indicating virtual contacts between the wheelchair and the environment. When contact forces between parts arise, along a direction, the corresponding results exhibit a peaks then decreases and oscillate around the desired values.  To illustrate the usefulness of the proposed virtual impedance approach for LIASD-WheelChair remote monitoring experimentally, we have performed some tests.
For this purpose, information coming fro m various sources, i.e., US sensors and wireless camera, through wireless network allow the hu man operator to ensure a right positioning a sweet manoeuvrability of the wheelchair.
Thus, Figure.13 illustrates different postures of the wheelchair. Here, the monitoring is ensured using both an external and embedded joysticks with identical characteristics. Thus, to ensure a safe control of the wheelchair according to some tele-operated movements of the joysticks, a specific PID parameters related to speed controller have been determined, so that, Proportional, Differential and Integral co mponents values are respectively K p = 2, K d = 2 and K i = 2. Using Wi-Fi co mmunication mode ( Figure.13 (a)-(j)), the wheelchair performs a good trajectory in constrained environment. In this case, an external joystick is requested to ensure the wheelchair mon itoring continuously. This kind of control transition can happen in emergency cases particularly, when the wheelchair doesn't respond to some desired control actions. Moreover, the use of a Wireless Internet Camera Server, wh ich is mounted on the wheelchair headrest, enables the user to refine the odometry by co mputing the distance of objects from the wheelchair and then determine the safest routes to the desired location by avoiding collisions. In Figure.13 (k)-(m), the wheelchair is locally monitored by the user. Here, as in tele-operated mode, via a force feedback joystick the user perceives virtual forces leading him to have a better monitoring.

6.Conclusions
In this paper we have proposed an approach dedicated for improving handicapped people's assistance and particularly those concerning smart wheelchairs. We have presented an approach based on virtual impedance method leading to control and to monitor LIASD-Wheelchair remotely through wireless communicat ion network which is based on 802.11 standards. This kind of approach allows a reliable remote manoeuvring with obstacle avoidance in a constrained environment taking into account system's interactive behavior. In o rder to test the effect iveness of the proposed approach, simulat ions and experimentations have been designed in this respect. Thus, according to the obtained results, some future researches and perspectives involving new techniques such as neural networks and fuzzy logic should be undertaken in order to increase performances in terms of accessibility and autonomy. These pro mising results lead us to further investigation into the use of this control approach for other kinds of tasks Some other research perspectives can be investigated in the same direction as projects mentioned above, contributing to propose new software and hardware architectures based on emerg ing technologies such as wireless sensor network, RFID and web -services in order to improve autonomy, mobility and accessibility of disabled people in their daily live.