← go back to the list

Drone Team

Members

• 김한설, 임승찬, 김시은, 김하준, 황인성, Dennis Phalula

Part A. Tello & Leap Motion using Scratch

DJI Tello in Scratch

1. Install Scratch 2.0 Offline Editor
2. Install node.js
3. Install Adobe AIR if needed
4. Download Tello.js and Tello.s2e
5. Open the terminal and go to the file directory where you saved the Tello.js and Tello.s2e files and type node Tello.js
6. Open Scratch 2.0 Offline, hold Shift key, click File menu, click Import Experimental HTTP Extension, and select Tello.s2e file
7. The Tello interface will be shown in Scratch under More Blocks
   • Read https://www.heliguy.com/blog/2018/04/18/coding-with-the-ryze-tello/ to know details how to do this process.

Figure: Tello blocks in Scratch

Leap Motion in Scratch

1. Download Scratch 2.0 Plug-in for Leap Motion.exe from https://github.com/khanning/khanning.github.io/tree/master/leapscratch/downloads
2. Connect Leap Motion controller to PC via USB.
3. Open Scratch 2.0 Offline
4. The Leap Motion interface will be shown in Scratch under More Blocks
   • Read https://khanning.github.io/scratch-leapmotion-extension/ to know more about the Scratch extention for Leap Motion.

Controlling Tello by Leap Motion in Scratch

Figure: Tello by Leap Motion in Scratch (example)

Part B. Tello & Leap Motion using Gobot Library

Limitation of Scratch

• Tello does not immediately move as it is controlled in Scratch. Once Tello is commanded to move in Scratch, it starts moving 1 or 2 seconds later (no immediate movement; unkwon issue).
• E.g.: Excute the forward block in Scratch > (1~2s delay) > Tello moves forward > …

Gobot

• Gobot is a framework of Go language, that supports 30+ robotics, Drones, and IoT devices including Tello and Leap Motion.
• See Tello and Leap Motion Gobot examples to understand how to use Gobot framework.
• To use Gobot
  1. Install Go language
  2. Install Git if you use Windows (Mac does not require this step)
  3. Install Gobot. To install, in Git-Bash (MS Windows) or Terminal (MacOS), type $ go get -d -u gobot.io/x/gobot/... (including the three dots)
  4. In Git-Bash or Terminal, go to the directory where tello.go file exists. Then, type go run tello.go to run the Go file.

Source Code

• Tello using Keyboard
• Tello using Leap Motion
• download from here

Further Issues

• upgrade the code for better alogirhm to control Tello with more natural hand guesture
• controlling multiple tellos altogether at the same time
• look into Tello.js if Tello can more immediately respond in Scratch

Comments by the team

In conclusion, interaction with Leap Motion was not easy as it seemed. Reality and our expectation was usually different. And it was new to know that debugging part was so important. However, we could also learn that we don’t have to fully understand a certain language or skills to use it. What we need is problem solving skills rather than trying to know everything. We found out the interaction between the hand guesture and drone is promising. It should be very intuitive. Whoever use drone for first time will know how to use it. Imagine yourself playing pilot game virtually. You can have tons of hand interaction without things like joystick!

← go back to the list