Shiuh-Jer Huang* and Jian-Cheng Huang
The Journal of Mechanical Science and Technology, vol. 25, no. 8, pp.2067-2076, 2011

Abstract : Usually, a humanoid robot has two arms and stereo vision system to execute human daily actions. It has complicate mechanism and mechatronics control system structure. The hardware control structure should be planned ingeniously to execute the complicate computation of 3D image processing and manipulate a multi degree of freedom dual arms motion control, especially for mobile robot system. Here a 7 DOF dual arms robot with FPGA hardware control structure and a digital signal processor (DSP) based CMOS stereo vision system are designed and built in our lab. The intelligent fuzzy sliding mode control strategy is employed to establish the visual guided robotic motion control software. This low cost humanoid robotic system has compact control structure and mechanism integration for mobile application purpose. Object detecting and tracking schemes in 3D space were developed for locating the target position and then guided the robot arm to pick and place objects or track the specified moving target. Experimental results show that this delicate robotic system has basic humanoid function.

Keyword : Stereo vision; Fuzzy sliding model control; DSP; FPGA and dual arms robot