AEEproject

Workspace Navigation

Spot, fetch a drink

1.1. Basic Information

Project ID: AEE-2021

Students: Anshul Sood, Darkhan Saidnassimov​, Hao Dong​, Ture Saarniniemi​, Weijiang Xiong 

Project manager: Darkhan Saidnassimov

Instructor: Joni Pajarinen

Other advisors:

Starting date: 22.01.2021

Completion date: 04.06.2021

1.2. Summary

The project essentially consists of developing a software package for Boston Dynamics Spot robot, more precisely, speech recognition and object detection service. Our software package will seamlessly integrate the built-in functions of Spot Robot with high level intelligence functionalities, which makes the robot capable of perceiving its physical environment, making decisions and executing designated tasks. The reasoning behind this project is a strong customer base that it can potentially target in industrial sectors, such as construction and mining sites, medical centers, as well as entertainment. The customer demand emerges from general applications of the Spot robot, where hands-free / remote control of the robot is preferred.  

Generally, our solution consists of a ROS software package, that communicates with the Gazebo Simulation Environment (Implementation for real Spot robot is planned via Spot SDK). The package fundamentally consists of the navigation (ROS navigation stack), speech recognition(Python speech recognition & Google speech), object detection(Darknet Yolo v3) nodes, grasping (MoveIt ROS package) and will come together with extensive documentation.  

Although the market for these kinds of products is quite dense, we believe that our solution will bring a strong competition to the existing companies due to these key benefits: 

  • Versatile applications
  • Easy maintenance  
  • Lower long-term costs!



1.3. Final demo

spot_demo (3).mp4


  • No labels
  File Modified
Multimedia File Spot demo video V2.mp4 May 20, 2021 by Weijiang Xiong
Multimedia File spot_demo (3).mp4 May 23, 2021 by Darkhan Saidnassimov
PNG File ROS.PNG May 23, 2021 by Darkhan Saidnassimov
PNG File Software Structure.PNG May 23, 2021 by Darkhan Saidnassimov
PNG File Structure.PNG May 23, 2021 by Darkhan Saidnassimov
Microsoft Powerpoint Presentation 1-18_presentation_slides.pptx Presentation slides May 23, 2021 by Darkhan Saidnassimov
Multimedia File fetch_demo.mp4 May 24, 2021 by Hao Dong
PDF File Final_Report_Spot_fetch_a_drink.pdf Jun 15, 2021 by Hao Dong