In order to establish system to help the human welder to improve their skills and welding quality. It will be important to obtain the human welder’s real-time motion. These days, as the camera systems development, the old methods like IMU sensors seems not accurate enough. The proposal here wants to model the human welders real-time motion based on stereo camera and virtual reality and compare both advantage and disadvantage between them.
For the stereo camera, we could attach an camera on the human welder’s arm, Set up the world coordinate system as constant, when the welder move his arm to do the welding, we could detect the fracture points on each frame, with the algorithm we used, we could obtain the human welder’s movement trajectory and compute the welder’s real-time velocity and direction. By using the efficiency algorithm and send the computation process to the GPU, this could be done in real-time. For the virtual reality part, there are a lot of the commercial product, we could use any of it to set up a model to modeling the human welder’s the biggest different here is that the stereo camera was attached on the welder’s arm, which means the camera was moving and the constant coordinate systems was world system, but the virtual reality’s camera was set up which means in the virtual reality part, the reference coordinate system was the camera system.
Both methods could successfully model the human welder’s and obtain the welders movement trajectory. But the stereo camera was way more sensitive to the welding arc, in some bad cases, stereo camera will have a lot of wrong matching pair which will leads to a wrong result. The virtual system seems more stable, but the accuracy may not as good as the stereo camera system in some situation. The different between those two methods still need some more work to be done.
In this research, two systems have been used to modeling the human welder, one was designed, and the others was a commercial product. They both works well in most situations, but also have their own problem in other situations.