smarthome:xaal_ros_pepper [roboLabo]

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
====== Combining Pepper and the smarthome: Link ROS and xAAL ======


20180118: Current status naoqi can be imported, and web_video_server can boradbast kinect video and we can see the skeleton on rviz
The source address is : https://redmine.telecom-bretagne.eu/projects/xaalros/repository?utf8=%E2%9C%93&rev=pepper

===== Running the Demo =====

  
  - To start the fall detection with kinect, please plug the USB cable of Kinect into the left USB port of the computer, please make sure that the LED light on the cable of Kinect is green.
Then run in different terminals the following commands or use "command &":
<code>roscore
rosrun openni_tracker openni_tracker
roslaunch openni_launch openni.launch
</code>
In order to follow the movement of the person, the openni tracker first needs to calibrate the person shown before the camera and extracts the skeleton of the person. To realize this, the user can use a "surrender" posture before the camera to help the process find exactly the position of the skeleton.

To open the web streaming    
  rosrun web_video_server web_video_server
    
and open a browser and go directly to    
  http://0.0.0.0:8080/stream_viewer?topic=/camera/rgb/image_color

or see all available images on   
  http://0.0.0.0:8080

  - To start the fall detection with sensfloor:
     * With the Sensfloor Receiver, please plug the sensfloor recever into the USB port of the computer.
then run in another terminal, choose one of the two methods:
<code>cd /home/user/P204/xaal/code/C/trunk/xaafloor
sudo chmod 777 /dev/ttyUSB0
./xaafloor -D /dev/ttyUSB0 -a 224.0.29.200 -p 1235 -s xaal
</code> 
Because using the USB device in ubuntu system needs a root permission, so a "chmod" is used to change the execution mode.
If you see the result:
"Device: 920de19d-63ac-451e-9c42-7eb7e48c0f90"
It means that it works normally.

     * Or With the Sensfloor Server:
Please use another computer to work as a gateway, because this one need to be connected with LABO_SID
<code>cd /home/user/P204/xaal/code/C/trunk/xaafloor
./xaafloor -S 192.168.5.5 -P 5000 -a 224.0.29.200 -p 1235 -s xaal
</code> 
If Sensfloor server is used, please make sure the computer is connected with the network: "sensfloor-03555", code:wlan1234. 
Only one of the above connection is needed.

  - To connect the Pepper, please first launch the pepper and wait for 2~5 minutes, until it says "on est neckmouque". Then please run in another terminal:
<code>roslaunch pepper_bringup pepper_full_py.launch nao_ip:=10.77.3.19 roscore_ip:=127.0.0.1</code>
Please make sure the IP address of pepper is correct. It can be verified by pressing the chest button of the Pepper one time.

  - To start the controller, firstly, goto the corresponding repository.
<code>cd /home/user/P204/xaalros/scripts/</code>
Then make sure that your are in the branch "pepper"
<code>git branch (see the available branch) 
git checkout pepper (goto branch pepper)
</code>
  - Then, run in another terminal:
<code>python controller.py</code>

  - If a falling is detected, the lights will be turned on and an email will be sent to the contact list. In the email there is an IP address of the video stream, please tap on the address to see the actual scene captured by the robot.

===== Install =====


  - Install [[:ros|ros kinetic]] with command ''sudo apt-get install ros-kinetic-desktop-full''. The details can be read here : http://wiki.ros.org/kinetic/Installation/Ubuntu.  You will have created a catkin workspace CATKIN_WS (for instance ~/catkin_ws)
  - For the kinect. Run:<code>
sudo apt install ros-kinetic-openni-camera
sudo apt install ros-kinetic-openni-launch
</code> Install NITE v1.5.2.23 by downloading from:  http://www.openni.ru/openni-sdk/openni-sdk-history-2/ then run ''./install.sh''. Clone the git repo of ros-openni-tracker from: https://github.com/ros-drivers/openni_tracker.
Place it inside a catkin workspace and use ''catkin_make'' to build it. Then ''source devel/setup.bash'' to load the built packages.

To test, initiate ''roscore''. Then ''roslaunch openni_launch openni.launch'' and ''rosrun openni_tracker openni_tracker'' as decribed in http://wiki.ros.org/openni_tracker.
Use rviz to visualize the skeleton (launch ''rosrun rviz rviz'' AFTER the openni_tracker has started its tracking). In the display window, under Global Options, set Fixed Frame to openni_depth_frame. Then add (button Add) a TF. Set the scale to 0,5 and you should see the frames for each joint. More details on https://github.com/jstnhuang/cse481c_tutorials/wiki/How-to-run-openni_tracker#visualizing-the-data


  - Install [[http://wiki.ros.org/web_video_server|web_video_server ROS package]] with the command ''sudo apt install ros-kinetic-web-video-server''. 
  - Install ROS packages for NAO with the instructions from http://wiki.ros.org/nao_robot, https://github.com/ros-naoqi/nao_robot, http://wiki.ros.org/nao/Tutorials/Installation
      - download from [[https://developer.softbankrobotics.com/us-en/downloads/nao-v3|aldebaran]] the Python SDK the compressed file pynaoqi-python2.7-2.5.5.5-linux64 and install according to the instructions http://doc.aldebaran.com/2-5/dev/python/install_guide.html. In details :
      - Set the environnement variable PYTHONPATH to /path/to/python-sdk/lib/python2.7/site-packages by doing for example: <code>
export PYTHONPATH=${PYTHONPATH}:/home/user/NaoPepper/pynaoqi-python2.7-2.5.5.5-linux64/lib/python2.7/site-packages </code>
      - check the installation with python <code>
import naoqi</code> If no error message is written, the library is imported. Else read http://doc.aldebaran.com/2-5/dev/python/tips-and-tricks.html#python-sdk-troubleshooting. 
      - ROS packages for the Nao robot <code>
sudo apt-get install ros-kinetic-move-base-msgs ros-kinetic-octomap ros-kinectic-octomap-msgs ros-kinetic-humanoid-msgs ros-kinetic-humanoid-nav-msgs ros-kinetic-camera-info-manager ros-kinetic-camera-info-manager-py
sudo apt-get install ros-kinetic-nao-robot </code>
      - For Pepper, refer to http://wiki.ros.org/pepper


NOTE
''sudo apt-get install ros-driver-base'' did not work. Package [[http://wiki.ros.org/driver_base|driver-base]] is deprecated and is not compatible with ros kinetic

A former install was done as described in http://wiki-robot.enstb.org/doku.php?id=ros_xaal. Since, we have changed the version of Ubuntu, of ROS and naoqi.

All ros packages are installed in folder ~/catkin_ws. Do not forget to execute ''source ~/catkin_ws/devel/setup.bash''  before using these packages.
I installed choregraphe for Pepper in folder /home/user/NaoPepper/choregraphe-suite-2.5.5.5-linux64.

to connect Pepper to ROS: 
<code>
roslaunch pepper_bringup pepper_full_py.launch nao_ip:=10.77.3.19 roscore_ip:=127.0.0.1
</code>

===== Troubleshooting =====


1.Today I did not manage to have the kinect run.
  * First,  when executing openni_launch, I had the error : <code>
kinect ros no devices connected
</code>
so I followed https://answers.ros.org/question/235440/test-kinectno-devices-connected-waiting-for-devices-to-be-connected/ ans installed freenect packages. It did not work at first but after a few attempts, ''roslaunch freenect_launch freenect.launch'' eventually worked. I don't know what heppened.

   * Then opennitracker had an error : ''InitFromXml failed: Can't create any node of the requested type!''  So I followed the instructions in 
https://groups.google.com/forum/#!topic/ros-by-example/cPVGgHHWtEU

eventually the command '' rosrun openni_tracker openni_tracker'' worked. I don't know what happened.

2.These kinds of error appears because the pepper is not connected successfully. Please verify the IP address of the Pepper.
<code>[ERROR] [1520344155.442555]: Could not create Proxy to "ALxxxxxx".
connect: No route to host
[FATAL] [1520344155.707677]: Could not connect to required "joint_trajectory" action server, is the nao_controller node running?
REQUIRED process [naoqi_moveto-3] has died!
</code>

3.This happens because the Kinect is not well plugged in or the machine can use this device. Please try to replug the Kinect USB cable again and plug it into the left port of the labo computer. By running this demo, please try to avoid using virtual machines.
<code>[ INFO] [1520344443.904870037]: No devices connected.... waiting for devices to be connected</code>

===== Useful Infomation =====


  * How to control the intelligent equipment of the connected habitat from the web page? 
Visit: http://xaal-lab.enstb.org:9090/test_grid
  * How to monitor the Sensfloor status? 
Connect to the network of the sensfloor and then visit: 192.168.5.5:8000
  * How to make xaafloor? 
Please download the code of xaal from http://recherche.imt-atlantique.fr/xaal/software/ and follow the instructions from this page. Make sure that the libxaal.so is generated in the code. Then go to the following repository:
<code>cd ~/P204/xaal/code/C/trunk/xaafloor(or your path)
make
</code>
Please make sure the library dependency is satisfied. As described in first lines of the Readme.txt of the repository libxaal.
  * How to change xaal hardware address/email address configuration?
Please refer to the file nao_xaal.conf in the repository of nao_xaal.
The correct hardware address can be found from the web http://xaal-lab.enstb.org:9090/devices
  * Useful xaal tools: Firstly, clean all:
<code>sudo pip uninstall xaal.lib
sudo pip uninstall xaal.tools</code>
Secondly, install xaal_test. The tool virtualenv is recommanded, it may need to be installed first.
<code>$ virtualenv xaal_test
Using base prefix '/usr'
New python executable in /home/jkx/xaal_test/bin/python
Installing setuptools, pip, wheel...done.
$ source xaal_test/bin/activate
(xaal_test) $ cd xaal_svn/libs/lib/
(xaal_test) $ python setup.py develop
(xaal_test) $ cd ../../apps/tools/
(xaal_test) $ python setup.py develop</code>
Here the xaal_svn is the repository of the python trunk, ex."/home/user/P204/xaal/code/Python/trunk/libs/lib/".
Then a list of function is available for you! 
<code>source xaal_test/bin/activate
xaal-isalive (show the list of the active device)
xaal-walker (show the list of the active device with )
xaal-dumper (show all the message exchanging on the multi-cast channel xaal)
xaal-tail 1|2|3 (show the message exchanging by the message level)
</code>
And one more time, please pay attention that before these command, the command "source xaal_test/bin/activate" is always necessary. Make sure that the terminal is then started with "(xaal_test) $".

  * How to check the connection with pepper?
<code>ping pepper.local
ping 10.77.3.19
</code>

  * Cannot read sensfloor message from xaal? 
Firstly, please make sure the computer is connected with the LABO_SID.
Secondly, make sure that the gateway xaafloor is working. Use the xaal-dumper or xaal-tail to check.
Thirdly, verify the encoding key:
<code>./xaafloor -D /dev/ttyUSB0 -a 224.0.29.200 -p 1235 -s xaal</code>
In this command the option "-s" is the encode key for the sensfloor message from the gateway.
If you want to change it, please make sure that it is the same key in the message receiving process.