Top Banner
An autonomous drone system for solving elephant-human conflict Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan Department of Electrical and Computer Engineering University of California, Santa Barbara
25

Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

Nov 28, 2021

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

An autonomous drone system for solving elephant-human conflict

Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun WanDepartment of Electrical and Computer Engineering

University of California, Santa Barbara

Page 2: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

Worldwide Problem

Nearly 20% of the world’s population lives in or near

elephant habitats and ranges.

Over the last 100 years, African elephant populations have

declined from 3-5 million to 0.47-0.69 million and Asian

elephant populations have declined from 100 thousand to 35-

50 thousand.

2

Page 3: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

Main form of conflict

Crops destroyed:

Wheat 65%

Sugarcane 21%

3

Crop-Raiding

Page 4: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

Small plantation

200-600 pounds of food per day

A few thousand dollars lost per

household per raid

Large plantation

Palm oil and timber

Riau, the largest palm oil

producing province in Indonesia

105 million dollars lost per year

4

Economic Loss

Page 5: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

5

Page 6: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

India

100-300 humans and 40-50

elephants are killed during crop-

raiding each year

World

500 people are killed by elephant

each year according to National

Geographic Channel documentary

Elephant Rage

6

Casualty

Page 7: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

7

Page 8: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

Elephants destroy the villager’s property about 5 times per

year in Xishuangbanna, China

Frequency of Crop-Raiding

8

Page 9: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

Drone High Level Design

9

Page 10: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

Drones Components

Tarot 680 Pro Hexa-copter

DJI N3 Flight Controller

NVIDIA Jetson Nano

IMX219-160 IR Camera

XBee-PRO900HP

10

Page 11: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

GPS Tags High Level Design

11

Page 12: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

GPS Tags Components

XBee-PRO900HP

FGPMMOPA6H GPS

Atmega328P-AU

12

Page 13: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

PCB (GPS Tags) Schematic

13

Page 14: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

PCB (GPS Tags) Board

14

Page 15: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

XBee-PRO900HP

• Frequency: 900MHz

• Ideal range:

10 kb/s: 9 miles (15.5 km)

200 kb/s: 4 miles (6.5 km)

(with 2.1 dB dipole antennas)

• Supply voltage: 3.3V

• Transmit current: 290 mA max

• Receive current: 29 mA typical

• Sleep current: 2.5 μA

• Interface: UART

15

Page 16: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

FGPMMOPA6H GPS

• Update rate: 1 to 10 Hz

• Position Accuracy: < 3 meters

• Velocity Accuracy: 0.1 meters/s

• Warm/cold start: 34 seconds

• Supply voltage: 3.3V

• Tracking current: 20mA

• Interface: UART

16

Page 17: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

Atmega328P-AU

• Speed: 20 MHz

• Operating Voltage: 1.8 - 5.5V

• Power Consumption at 1MHz:

1.8V, 25C

• Active Mode: 0.2mA

• Power-down Mode: 0.1μA

• Power-save Mode: 0.75μA

(Including 32kHz RTC)

17

Page 18: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

Parts - Drone

• Tarot 680 Pro Frame

• Tarot 4108 High-Power Brushless

Motor

• HobbyWing XRotor 40A-OPTO-

ESC

• Processor: NVIDIA Jetson Nano

• Flight Controller: DJI N3

• Sensors:

• IMX219-160IR Camera

• XBee-PRO900HP

• Gartpot 4S 75C LiPo Battery

18

Page 19: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

NVIDIA Jetson Nano

• ARM Cortex-A57 (4 cores)

• 128 cores NVIDIA Maxwell GPU

• Clock speed:

• CPU: 1.5 GHz

• GPU: 900 MHz

• Power:

• Requirement: 5V (4A)

• Consumption: 10 W

• Peripheral Interfaces: CSI, UART, USB, GPIO

• Serves as an onboard processor on drone

19

Page 20: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

IMX219-160IR

• Resolution: 3280 x 2464

• Angle of View (diagonal): 160 degree

• Night vision:

• No IR filter installed

• Two infrared LEDs

• Power requirement: 3.3 V

• Interface: CSI

• Interfaced with Nano through OpenCV API

20

Page 21: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

DJI N3 Flight Controller

• Dual IMU Redundancy

• 8GB Black Box

• GNSS-Compass

• PMU

• 3S-12S LiPo Battery Supply

• M Pin

• ESC PWM Port for Motor

• API Port

• UART

• S-Bus Port

• RC Receiver

21

Page 22: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

DJI Onboard SDK

• Installed in Jetson Nano

• Interface for DJI N3

• Flight actions

• Roll/Yow/Pitch/Throttle

• Aircraft state data

• Direction

• GPS Coordinate

• Altitude

• Automate herding process

22

Page 23: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

Computer Vision Software Flow

23

Video DataObject

AcquisitionObject

Tracking

Drone

Control

• Object acquisition is performed using a neural network detection model

• Optical flow is used for real-time elephant tracking

• Localization data is then fed into a control algorithm to effectively herd

the elephant away

Page 24: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

Timeline

Fall quarter achievements

◼ Successful prototyping of the GPS tag

◼ Successful sending and receiving coordinates and other data between

tag, base station and drone

◼ Successful implementation of AI object detection on Nvidia Nano

Winter quarter objectives

◼ Print out the PCB for GPS tags

◼ Finish calibration and test flight the drone

◼ Develop autopilot program for the drone with DJI SDK

◼ Computer vision software development

24

Page 25: Weiyun Jiang, Alexis Yang, Ning Du, and Jiajun Wan

Acknowledgement

We would like to thank Professor Yoga (UCSB),

Professor Schulte (WKU), Aditya Wadaskar

(UCSB), and Kyle Douglas (UCSB) for their

insightful techniqual discussions.

25