Skip to content

Latest commit

 

History

History
316 lines (187 loc) · 22.6 KB

README.md

File metadata and controls

316 lines (187 loc) · 22.6 KB

PepperPresentationIMERIRApp

Application developed for the Pepper robot, manufactured and marketed by the company Softbank Robotics, to present the IMERIR IT and robotics school during various events (trade fairs, open houses...)...

Contents

  1. Introduction,
  2. Presentation of this project,
  3. Application's definition,
  4. Git repos's structure,
  5. Project's components,
  6. How was this project developed ?
  7. How to install it ?
  8. Result
  9. Manual
  10. Issues and bugs,
  11. Useful links,
  12. Conclusion.

Introduction

IMERIR is an engineering school providing training in IT, connected objects, artificial intelligence, maker culture and robotics. By the way, here is its logo:

This school has a humanoid robot known as Pepper. Initially manufactured and marketed by the French company Aldebaran robotics, the production and marketing of Pepper was taken over by the Japanese company Softbank when the latter acquired Aldebaran robotics. Here is an image of this robot so emblematic of humanoid robotics:

IMERIR uses the Pepper robot as the school mascot during various trade shows, meetings and professional forums focused on computer technologies and robotics as well as geek culture. As shown in some photos below, the Pepper robot from IMERIR is emulated wherever it goes.

Watch the video

Presentation of this project

This project consists to develop an application for the Pepper robot, to allow it to present the robotics and software engineering school named IMERIR. The presentation made by the robot is very complete and addresses all aspects of the school (small presentation, training, vocational education, Erasmus, graduation, alumni association...). This presentation of the school adopts a rigorous and complete organization thanks to the development (at the base) of the grafcet exposed below and which you can find here.

That's pretty cool... 🐱...

Application's definition

This application is for the Pepper robot to permit it to present the IMERIR school to prospects, cosplayers, professionals and all other interested audiences. This application:

  • use the robot's voice command to allow the interlocutor to ask his question or state his answer,
  • display graphical interfaces to allow the interlocutor to make his choice to ask his question or state his answer if there is too much noise,
  • interact with the interlocutor using the voice interface while displaying well-designed graphical interfaces to illustrate the point,
  • is based on a detailed scenario to explain and question with the corresponding graphical interfaces according to a well-written text,
  • is based on a detailed grafcet to establish a rigorous order in the presentation of the explanations and the questions asked as well as the beginning and the end of the program.

warning: this application works exclusively on Pepper robots running on the version 2.5 of its OS NAOqi.

Git repos's structure

Coming soon...

How was this project developed ?

Developed on version 2.5 of NAOqi, Pepper's operating system, this application was developed using the Choregraphe software. Until version 2.9 of NAOqi, and therefore the development of the Pepper SDK on Android studio, the control, management and development of the Pepper robot was done by this software. Below, you can observe respectively the interface of the Choregraphe software and the software icon.

To download the Choregraphe software, please go right here. This application was developed exclusively for the version 2.5 of the Pepper's operating system NAOqi. For more information about requirements and application's definition, you can consult the application's manifest file just here.

Project's components

Coming soon...

How to install it ?

Here, we will show you how to install the PepperPresentationIMERIRApp app on the Pepper robot. The process is common to all the other applications to be installed on Pepper, running with version 2.5 of the NAOqi system. So let's go...

  1. Please turn on the Pepper robot first;

  1. then wait for the robot to pronounce “Ognak Gnuk” and check its environment, this means that the robot is now on;

  1. please connect the Pepper robot to the Choregraphe software now. You have to open the software in question to do this.

Then click on the button indicated on the screenshot below.

The window shown in the screenshot below then opens.

So please select the robot colored in green (or the one you want which is also colored in green) and then press the “Select” button as shown below.

Let's go back to the interface shown above. In the table on the left, you must choose the robot you want to connect to Choregraphe. In the “status” column, there are several robots, each represented by a head of Nao robots. The dotted robot (opposite ) corresponds to the virtual robot, a simulation of the Pepper robot installed by default with Chorégraphe and which is just as interfaceable, controllable and programmable as a physical robot. A real physical Pepper robot is full line and:

  • either it is colored green with the eyes open (opposite ): you can connect to this robot because its NAOqi OS is running,

  • or it is colored red with closed eyes (opposite ): you cannot connect to this robot because its NAOqi OS is stopped.

  1. Now is the time to install the application on the Pepper robot.

For more information, please refer to the Pepper robot user manual just here (in french) at the question "Comment installer/réinstaller des applications sur le robot Pepper ?" ("How to install / reinstall applications on the Pepper robot ?" in english). You can also have just as ample information just here: https://github.com/Vicken-Ghoubiguian/pepperApplications#how_to_install_an_application_on_the_robot.

Result

Final result

Manual

This section is the user guide for the application. All the questions you ask yourself about it are discussed there. So don't hesitate to take a look at it depending on the question you have, or the problem you are having.

How to start the application ?

Coming soon...

How to stop the application ?

To stop the application, you must be localized in the "Que veux-tu savoir sur notre établissement ?" question. To be located there, you can refer to the application's grafcet. You must then answer "stop" to this question, and the Pepper robot will state the message contained in the "Que veux-tu savoir sur notre établissement ?" box. And finally then, the application ends.

Each answer for each question

"Que veux-tu savoir sur notre établissement ?"

  • "stop" => "Message de remerciements, d'information et d'au revoir" box

  • "IMERIR" => "Qui sommes nous ?" box

  • "formations" => "Nos formations" box

  • "alternance" => "L’alternance" box

  • "professionnels" => "Professionnels" box

  • "fablab" => "Le Fablab" box

  • "association des anciens" => "Association des anciens" box

  • "contact" => "Nous contacter" box

  • "erasmus" => "Erasmus" box

  • "diplôme" => "Remise des diplômes" box

  • "admission" => "Admission" box

  • "inscription" => "S'inscrire" box

"Quel diplôme t'intéresse ?"

  • "stop" => "Que veux-tu savoir sur notre établissement ?" question

  • "cybersécurité" => "Cybersécurité" box

  • "intelligence artificielle" => "Intelligence artificielle" box

  • "internet des objets" => "Internet des objets" box

  • "robotique" => "Robotique d'innovation" box

  • "prépa" => "prepa" box

  • "license" => "License informatique option robotique de prototypage" box

"Comment souhaites-tu prendre contact avec nous ?"

  • "stop" => "Que veux-tu savoir sur notre établissement ?" question

  • "téléphone" => "Numéro de téléphone" box

  • "formulaire" => "Formulaire" box

  • "poste" => "Adresse postale" box

  • "réseaux sociaux" => "Réseaux sociaux" box

  • "i-mail" => "Adresse email" box

"Veux-tu en savoir plusse ?"

"Souhaites-tu remplir le formulaire d'inscription ?"

"Souhaites-tu voir des photos et vidéos de cérémonies ?"

"L'IMÉRIR organise des sessions A R E; Veux-tu en savoir plusse ?"

"Que veux-tu faire maintenant ? t'inscrire ? voir les partenaires ? ou rien ?"

Issues and bugs

Warning: By cloning this project from git on the Choregraphe software, a minimal bug is to be noted: by launching the application from the Choregraphe software (button ) or by installing it directly on the robot (button ) to launch it from the tablet, the robot crashes as soon as it executes a choice box (a block resembling that or that and allowing it to ask a question and answer orally). To remedy this problem (and so, to run correctly the app on the robot), you must then double-click on the choice box, copy the text of the question, delete it, save, then paste the text of this question again, then save again. This procedure is illustrated in the screenshots below...

  1. clone the project from GitHub on your computer,

  1. open the project on the Chorégraphe software (Please refer to the section named How to install it ?),

  2. click on the choice box in question (Here we will take the "Quel diplôme t'intéresse ?" one),

So the following interface is displayed.

  1. copy the text entered in the item titled "Localized text" (ctrl + c) as shown in the screenshot below.

  1. delete the text entered in the item titled "Localized text" and then save (ctrl + s or the button ), as shown in the screenshot below,

  1. paste the text of the question (which you copied in step 4) still in the item titled "Localized text" (ctrl + v) and then save as explained on the screenshot below,

And here is the job ... the bug is solved as well 🐱. This operation must be repeated for all the choice boxes making up the application (8 in total).

Useful links

Conclusion