====== Navigation strategy with pepper ======
===== Running the Demo =====
run in different terminals the following commands or use "command &":
roscore
to connect Pepper to ROS (the parameter network_interface needs to be changed according to the network interface with which you connect to the robot Pepper, ie wireless or wired, to check with ifconfig):
cd /opt/ros/kinetic/share/naoqi_driver/launch/
roslaunch naoqi_driver.launch nao_ip:=10.77.3.19 network_interface:=wlp2s0
To apply the calibration parameters of the 3D camera :
source /home/user/catkin_ws/devel/setup.bash
roslaunch extrinsic_calibration register_depth.launch
You can check with rosrun rviz rviz : add a PointCloud2 on topic /naoqi_driver/camera/depth_registered/points and in Global Options > Fixed Frame : odom.
To convert a 3D Point Cloud (from topic /naoqi_driver/camera/depth_registered/points) into a 2D laser scan :
cd /opt/ros/kinetic/share/pointcloud_to_laserscan/launch
roslaunch sample_node.launch
You can check with rosrun rviz rviz : add a LaserScan on topic /camera/scan and in Global Options > Fixed Frame : odom.
To start navigation (ie packages AMCL for localisation and move_base for planification) :
cd /home/user/catkin_ws/src/pepper_plymouth_ros/launch/
source /opt/ros/kinetic/setup.bash
roslaunch nav.launch
Then, run the user interface (to give goal points) in another terminal:
cd /home/user/Bureau/khalil\ serrakh/Khalil\ SERRAKH/Logiciels/peppermajordome/scripts/
python navigation.py
Pepper shows on its screen a map of the apartment and asks "ou veux-tu que j'aille?". The locations defined are : la cuisine, le salon, la salle à manger, l'entrée de la maison, reviens à ta place.
These locations can be changed in file navigation.py in function init
===== Install =====
- Install [[ros|ros kinetic]]. The details can be read here : http://wiki.ros.org/kinetic/Installation/Ubuntu. You will have created a catkin workspace CATKIN_WS (for instance ~/catkin_ws)
sudo sh -c 'echo "deb http://packages.ros.org/ros/ubuntu $(lsb_release -sc) main" > /etc/apt/sources.list.d/ros-latest.list'
sudo apt-key adv --keyserver hkp://ha.pool.sks-keyservers.net:80 --recv-key 421C365BD9FF1F717815A3895523BAEEB01FA116
sudo apt-get install ros-kinetic-desktop-full
- For the map. Run:
sudo apt-get install ros-kinetic-octomap
sudo apt-get install ros-kinetic-map-server
- For the localisation. Run:
sudo apt-get install ros-kinetic-amcl
sudo apt-get install ros-kinetic-humanoid-localization
In order to perform an extrinsic calibration of RGB and Depth cameras of Pepper robot, you can use either our https://github.com/ros-naoqi/extrinsic_calibration package or follow the ROS tutorial (http://wiki.ros.org/openni_launch/Tutorials/ExtrinsicCalibration).
roslaunch extrinsic_calibration register_depth.launch
- Install ROS packages for NAO with the instructions from http://wiki.ros.org/nao_robot, https://github.com/ros-naoqi/nao_robot, http://wiki.ros.org/nao/Tutorials/Installation
- download from [[https://developer.softbankrobotics.com/us-en/downloads/nao-v3|aldebaran]] the Python SDK the compressed file pynaoqi-python2.7-2.5.5.5-linux64 and install according to the instructions http://doc.aldebaran.com/2-5/dev/python/install_guide.html. In details :
- Set the environnement variable PYTHONPATH to /path/to/python-sdk/lib/python2.7/site-packages by doing for example:
export PYTHONPATH=${PYTHONPATH}:/home/user/NaoPepper/pynaoqi-python2.7-2.5.5.5-linux64/lib/python2.7/site-packages
- check the installation with python
import naoqi
If no error message is written, the library is imported. Else read http://doc.aldebaran.com/2-5/dev/python/tips-and-tricks.html#python-sdk-troubleshooting.
- ROS packages for the Nao robot
sudo apt-get install ros-kinetic-move-base-msgs ros-kinetic-octomap ros-kinectic-octomap-msgs ros-kinetic-humanoid-msgs ros-kinetic-humanoid-nav-msgs ros-kinetic-camera-info-manager ros-kinetic-camera-info-manager-py
sudo apt-get install ros-kinetic-nao-robot
- For Pepper, refer to http://wiki.ros.org/pepper
NOTE
''sudo apt-get install ros-driver-base'' did not work. Package [[http://wiki.ros.org/driver_base|driver-base]] is deprecated and is not compatible with ros kinetic
* How to check the connection with pepper?
ping pepper.local
ping 10.77.3.19
====== Humain Robot interaction ======
run x3d server :
cd /home/user/Bureau/khalil serrakh/Khalil SERRAKH/Test/Dialogue Homme Machine/Serveur IP clВ XXD
java -jar deltadore.xxd.ipgateway.jar 54321 /dev/ttyUSB0
to display local images on the touch screen, change in the program serveurhttp.py the HOST variable to input your IP address :
cd /home/user/Bureau/khalil\ serrakh/Khalil\ SERRAKH/Logiciels/peppermajordome/scripts/
python serveurhttp.py
and open a browser and go directly to
http://your_ip_address:9999
to open the web streaming on the tablet, run in different terminals the following commands or use "command &"
roscore
cd /opt/ros/kinetic/share/naoqi_driver/launch/
roslaunch naoqi_driver.launch nao_ip:=10.77.3.19 network_interface:=wlp2s0
rosrun web_video_server web_video_server
Make sure you use the right dialogue.txt and modele_interaction.py, then run in terminal:
cd /home/user/Bureau/khalil\ serrakh/Khalil\ SERRAKH/Logiciels/peppermajordome/scripts/
python modele_interaction.py
The robot Pepper waits for us to say "Bonjour" or tries to detect a person next to him at a distance < 1m. Then the robot guides the person on the possible interactions.
====== Control robot by using keyboard ======
Generic keyboard teleop for twist robots.
===== Installing =====
sudo apt-get install ros-kinetic-teleop-twist-keyboard
===== Running =====
rosrun teleop_twist_keyboard teleop_twist_keyboard.py
===== Controls =====
See the on-screen instructions:
Reading from the keyboard and Publishing to Twist!
---------------------------
Moving around:
u i o
j k l
m , .
q/z : increase/decrease max speeds by 10%
w/x : increase/decrease only linear speed by 10%
e/c : increase/decrease only angular speed by 10%
anything else : stop
CTRL-C to quit
====== Octomap ======
General information about OctoMap is available at http://octomap.github.io and in the publication "OctoMap: An Efficient Probabilistic 3D Mapping Framework Based on Octrees" by A. Hornung, K. M. Wurm, M. Bennewitz, C. Stachniss, and W. Burgard (Autonomous Robots Journal, 2013).
===== Installing =====
sudo apt-get install ros-kinetic-octomap
===== Running =====
To create the static map.
Run :
to connect Pepper to ROS (the parameter network_interface needs to be changed according to the network interface with which you connect to the robot Pepper, ie wireless or wired, to check with ifconfig):
cd /opt/ros/kinetic/share/naoqi_driver/launch/
roslaunch naoqi_driver.launch nao_ip:=10.77.3.19 network_interface:=wlp2s0
To apply the calibration parameters of the 3D camera :
source /home/user/catkin_ws/devel/setup.bash
roslaunch extrinsic_calibration register_depth.launch
start Octomap
roslaunch octomap_server octomap_mapping.launch
Moving the robot
rosrun teleop_twist_keyboard teleop_twist_keyboard.py
To save the map, run:
rosrun octomap_server octomap_saver -f /home/user/Bureau/my_map_octomap.bt
before **stopping Octomap**.
{{tag>pepper ros tutorial xaal}}