This paper studies the robot arm sorting position control based on robot operation system (ROS), which works depending on the characteristics of the robot arm sorting operation using the top method, to automate the sorting operation and improve the work efficiency of workpiece sorting. Through the ROS MoveIt! module, the sorting pose and movement path of the robotic arm are planned, the inverse kinematics of the sorting robotic arm is solved, and the movement pose characteristics of the sorting robotic arm are analysed. The robot arm model was created using Solidworks software, and the URDF model file of the robot arm was exported through the sw2urdf plugin conversion tool, and the parameters were configured. Based on ROS for 6-degree-of-freedom (DOF) robot motion simulation, random extended tree (RRT) algorithm from open motion planning library (OMPL) is selected. The robot motion planning analysis and sorting manipulator drive UR5 manipulator. The results show that the sorting pose and motion trajectory of the robot arm are determined by controlling the sorting pose of the sorting robot arm, and the maximum radius value of the tool centre point (TCP) rotation of the robot arm and the position of the workpiece are obtained. This method can improve the success rate of industrial sorting robots in grabbing objects. This analysis is of great significance to the research of robots’ autonomous object grabbing.
- industrial robot
- universal robot
- robot operation system
- kinematic simulation
The research of robots on its various applications involves various fields such as military, aerospace, medicine, agriculture, industrial products, etc. It has achieved rapid development, and has gradually become a hot topic in various fields [1, 2]. In recent years, the number of robots in the manufacturing industry has increased rapidly by 500,000 units, including finishing of manufacturing links/operations such as welding, spraying and assembly, loading and unloading, and sorting, and has partially replaced manual operations [3, 4]. Robot applications will arrive in many fields, replace heavy labour, and realise automation and intelligence in the industrial field.
Currently, universities and research institutes have conducted robotics research and achieved important results. Literature  analysed the positive and negative solutions of the kinematics of the robotic with three-dimensional simulation technology and established the visual interface of the robotic arm sorting system, and realised the robotic operation simulation. The literature  analysed the prevention of accidents that may be caused by the entity during the operation of the robot in kinematics simulation [7, 8]. Literature  developed the three-dimensional configuration module, motion simulation module, communication module and main control module of the robot with the surrounding environment, and completed the kinematics simulation of the robot. Aiming to solve the problem of sorting, the literature  studied the robot kinematics and established the human-computer interaction interface of the six degree-of-freedom (DOF) manipulator. Literature  proposed the inverse solution method and robot calibration technology to realise the eye-in-hand calibration of the robot arm. The joint angle was obtained from the positive solution, and the robot calibration technology can perform error compensation [12, 13]. The above-mentioned methods mainly carry out simulation analysis for traditional simulation modules. The methods do not use robot operating system (ROS) for simulation and physical robot communication for its research work.
With the development of Artificial Intelligence (AI), the research level of robot technology has been improved rapidly, and the combined computer vision and robot technology has become the current research hotspot. The convolutional neural network (CNN)  was proposed by Hinton et al., and has achieved success in object recognition, object detection and other fields. Using of computer vision technology to identify objects, and controlling the robot to grasp has become an important field of research [15,16,17]. In order to map between the coordinate information of the object in the three-dimensional space and the pixel information in the image, the camera was calibrated by this method . Reference  connects the robot system and the vision system through eye-to-hand calibration, and then obtains the three-dimensional coordinates of the object in the robot base coordinate transformation, and completes the grasping task of the robot [20, 21]. The deep learning was focussed for robot grasping in the literature from the aspect of robot grasping research [13, 22]. Levine et al., collected the experimental data of robot grasping and trained the neural network model . The objects were grasped by robot successfully using the convolution neural network and the robot completed the grasping action in virtual simulation.
At present, workpieces of complex sorting remain in manual operation phase except the contour occlusion of the workpiece operation. There is a large complex industrial device error and only low success is achieved. Based on the proposed ROS Cartesian space, the experiment achieved an industrial robot for the automatic sorting of complex parts. The use of industrial robot was accomplished in the established simulation environment in ROS software. The application manipulator solved inverse kinematics and achieved the Cartesian space target workpiece. In addition, the use of the ROS Protocol Standard is a great significance for industrial production. By establishing the robot sorting operation, the simulation experiments proved that the proposed method has good stability and accuracy. Section 1 introduces the motivation of this research, and few relevant backgrounds. Section 2 surveys the Robot System Operation, Universal robot (UR) and the software. Section 3 outlines our experiment and the corresponding results, discusses some aspects of operating the robot error and graph as illustrated in graphs. Finally, Section 4 concludes the paper.
ROS is an integrated development platform, composed of complex functions package, which includes a mechanical arm motion planning, operation control, 3D perception, kinematics modules, and the plugins that can be used in industrial, research and other fields. ROS of MoveIt! Mechanical arms control module can be implemented to control a robotic arm manipulator model, including modelling, kinematics, motion planning, and obstacle avoidance research.
Considering the model of the 6-DOF universal robot manipulator, the simulation platform of sorting system based on ROS is shown in Figure 1. The simulation platform of the sorting system is mainly composed of three units: workpiece platform unit, vision unit and manipulator body unit. The workpiece position and trajectory are used to place the workpiece in different positions. The vision part is composed of Kinect V2, camera bracket and computer processing software. The vision system unit calculates the position and posture of the robot and transmits calculated parameters to the control cabinet.
The MoveIt! controller has three features. MoveIt! is a part of the ROS system and used to control the multi-joint robotic arm. It provides control plugins and tools for the robotic arm, which can realise the rapid configuration of the robotic arm control and encapsulate the thousands of APIs, secondary application on MoveIt! module. In addition, the three-dimensional visualisation tool RViz in ROS can reconstruct the working scenes of various industrial robotic arms in the simulation environment. In RViz, the interactive marker on the end-effector can be used to move the manipulator to the target position. Next, one can select a specific planning algorithm from the OMPL library from the drop-down menu in the planning library. Then, one can click the plan button – the Rviz window will appear from the initial position to the target position of the trajectory, and loop constantly plays.
Now, the simulation condition and process of ROS simulation system are described. First, the hardware part of ROS simulation that includes creating subclass, inheriting robot HW parent class are described and some functions and variables in URDF (Unified robot description format) are declared. The joint and motor data are initialised, and the corresponding data (
Customising the URDF file was made from the robotic arm prototype. The structure shape and joint position of this robot arm are shown in Figure 1. The manipulator model used in the article is a UR5 manipulator produced by Universal Robot of Denmark, which has six degrees of freedom, excellent flexibility, safe and a unique and innovative cooperative manipulator. The traditional D-H (Denavit-Hartenberg) modelling method establishes a link coordinate system for each joint. The D-H parameters of the UR5 type robot arm are shown in Table 1.
D-H parameters of UR5 robotic arm.
Through MoveIt! (ROS toolkit), setup assistant was installed the sorting robot arm as shown in Figure 2. The configuration steps include loading the sorting robot arm URDF model, configuring the self-collision matrix, creating a planning group, defining the sorting robot posture (initial position home and front position forward), and configuring the end-effector (Gripper), generate configuration files, etc. For three-dimensional model of the manipulator in an emulation environment and based on the use of mechanical unity arm described format URDF(Unified Description Robot the format) model, three-dimensional modelling Solidworks software created manipulator model exported as URDF robot arm model file using sw2urdf conversion tool in the interface. In this framework, MoveIt! is executed to avoid the collision of the robot arm. By uploading the collision matrix of the robot arm containing the rule set into the integrated toolbox, the motion planning of the robot arm can avoid singular trajectories. The loading robot arm collide toolbox integrated into the matrix so that the mechanical arm motion avoid special tracks and the purpose of avoiding the singular position in ROS toolkit is achieved.
When creating a planning group, select the Random Extended Tree Algorithm (RRT) algorithm in the Open Motion Planning Library (OMPL) to analyse the motion planning of the sorting robot arm. In Robotic arm solution algorithm, starting position
To mark the emulator (Cartesian space) manipulator terminal (target position by tool_link) to a target position – click operation Planning instruction, then the mechanical actuator arm path planning instruction, set RRT path planning for 5 times, and obtain optimal operation path in MoveIt! toolkit. By clicking the Execute command, the robotic arm solves the inverse kinematics solution and runs the shortest path planning result.
Table 1 in UR5 robot arm D-H parameters may establish its coordinates
With the transformation matrix of coordinates between the TCP of the sorting robot arm and the base and input the joint angle
In the formula, the upper left corner of
Transform the matrix
The joint angle is calculated from the space position and posture of the end-effector. The analytical method can obtain all the solutions of the sorting manipulator. The UR5 6-degree-of-freedom manipulator has finite solutions. The intermediate matrix for the process of solving the transformation matrix
Since the corresponding rows and columns of the matrices
Solving the arctangent function (
From the third row and second column, we obtain (
From the above expression, it can be concluded that the UR5 manipulator has 8 sets of inverse solutions. However, for gripping operations, make sure that the tool end of the robotic arm (installation of the end-effector) is vertically downward, approaching the target workpiece from the top. Therefore, set the initial position (position) of the robotic arm to ensure that the wrist joints (E, F) of the robotic arm are perpendicular to the base plane (horizontal plane).
Further, a series of positions (points) are generated between the target position points to ensure that the start and end of the movement are the constraints of the vertical pose. The above positions represent the time optimal path based on the speed and acceleration of each joint, and the time step is 0.1 s. The path is parameterised using the time-optimised path, and the generated path makes the robotic arm to move smoothly and reduces the moving time of the sorting robotic arm.
The ROS simulator RViz performs path planning for the UR5 robotic arm sorting operation. After the sorting robot arm reaches the target position, the robot arm moves from the initial position to the top position of the sorting target, and then to the joint position where it reaches the target position, to simulate the UR5 robot arm object grasping movement process. Select the random extended tree algorithm (RRT) algorithm in the OMPL for the motion planning of the sorting manipulator. The ROS MoveIt! toolkit executes the path planning results (Run Planning and Execute in turn), and finally completes the motion path planning of the robotic arm sorting process, driving the real robotic arm to approach the target fruit from the top and grab the target workpiece. The sorting action of UR5 robotic arm and end-effector approach vertically upwards from the top, as shown in Figures 3 and 4.
Realise topic (rostopic information) through ROS hardware connection of main computer vision processing computer and robotic arm controller (router connected to 3 controllers), and the software program operated in the debugging process. By rqt_plot change View manipulator joint position, velocity, force and the mechanical actuator arm during movement of the joint position change curve as in Figure 4. Randomly robot gripping position of the workpiece by RViz view manipulator torque of each joint (the simulator the Torque) value, are shown in Table 2.
Torque change value of UR5 robotic arm picking action (unit Nm).
|Joint ||Joint ||Joint ||Joint C||Joint ||Joint |
Through the ROS plug-in, we can view the running situation of the real-time robot, as shown in Figures 3 and 4, and we can get the position changes and speed changes of the six DOF running robots. It can be concluded from Figure 4 and Table 2 that the tool end position of the sorting manipulator remains vertical, which ensures that the end-effector can approach the target workpiece from the top and carry out the grabbing and handling actions of the target workpiece. Select the motion path of the manipulator according to the distance of the handling position, execute the path planning result through the ROS MoveIt! toolkit, and finally complete the motion path planning of the robot arm sorting process. In addition, a small joint_state position is defined in the motion control and task decision-making layer of the ROS simulation software in the process of grasping the manipulator, which can select different data according to different task types, object positions and object types and send them to the following motion planning layer.
The robot decision-making module sends a grab status to the task decision-making layer of the manipulator. After receiving the status, the task decision-making layer will search in the state table stored in advance. If the matching and grasping status is successful, it will take out the state chain in the table and put it into the state queue. Each time the state controller analyses the data it needs according to the sub actions in the current state queue. The grabbing state can be divided into many sub actions: initial, preparation, grasping, paw opening, gripper clamping, holding object, etc. At this time, if the first action in the queue is initial one, the controller will take the corresponding position from the preset position pool of the robot, and take the required data from the Moveit! parameters table, and transfer the initial action to the motion planning layer for specification and execution. When the robot has completed the action, the task decision-making layer will compare the difference between the actual position of the manipulator and the expected position.
The Kinect sensor is used as a visual collector to study the object recognition and robot's grasping and handling. The visual recognition model is used to identify the object type in real-time. The internal and external parameters of Kinect V2 are obtained by calibration method, and the object position coordinates are calculated. Finally, the robot joints are controlled to complete the task of grasping and transporting objects. At the same time, the inverse kinematics solution and robot calibration technology are proposed. The joint angle can be obtained effectively by inverse kinematics solution, and the robot calibration technology can be used for error compensation. If the error is less than a certain prescribed value, it will return the execution result to the controller, and the controller will continue to execute the next state until the actions in the whole state queue are executed. If the error is too large, an error exit will be reported to prevent any uncontrollable accident in the manipulator.
In order to realise the industrial robot arm accurately grasp the target objects, the simulation analysis of the motion path planning of the robot arm was carried out. We arrive at following conclusions based on our analysis and work.
Using the ROS MoveIt! module, the robot arm's sorting position and motion path are planned, the inverse kinematics of the sorting robot arm is solved and the motion pose characteristics of the sorting robot arm are analysed to realise the robot arm sorting. The process of approaching and grabbing the target workpiece from the top of the job is achieved. Based on the motion control of the 6-DOF robot arm under ROS software, the shortest motion trajectory and sorting pose of the sorting robot arm are determined, and maximum radius of rotation of the TCP of the sorting robot arm and the target grab point position are obtained.
Torque change value of UR5 robotic arm picking action (unit Nm).
|Joint ||Joint ||Joint ||Joint C||Joint ||Joint |
D-H parameters of UR5 robotic arm.