An unmanned aerial vehicle- (UAV-) based monitoring system is developed as an intermediate system between aerial survey and ground survey. All the measurement tools are mounted on the UAV to acquire detailed information from low altitudes which is different from a satellite or a plane. The monitoring is carried out from the sky, but the spatial and temporal resolutions are freely selected near the ground. In this study, the data is easily acquired with safety and mobility by the utilization of a sensor web. A sensor web is a type of sensor network which is well suited for environmental monitoring. Sensor nodes are spatially distributed and wirelessly communicate with each other. In this study, the UAV-based system is considered as a mobile sensor node. This study proposes a combination of UAV-based monitoring with a ubiquitous sensor network.
To obtain both the wide-area coverage of remote sensors and the high levels of detail and accuracy of ground surveying, at a low cost, an unmanned aerial vehicle- (UAV-) based monitoring system is developed. The UAV resembles a helicopter and all the measurement tools are mounted under it to acquire detailed information from low altitudes, unlike high-altitude systems in satellites or airplanes. The survey is conducted from the sky, but the resolution and accuracy are equal to those of ground surveying. Moreover, the UAV can acquire data easily as well as safely, for example, data from pollution monitoring, forest fire detection, and disaster monitoring [
Recently, much UAV research has been conducted with the existing UAV system which is designed to work as a standalone system [
In this study, a sensor web is applied for UAV-based monitoring. A UAV-based sensor web monitoring system is considered a mobile sensor node in a ubiquitous sensor network. This study proposes a combination of UAV-based monitoring with a ubiquitous sensor network for environment or disaster monitoring. In previous studies, wireless communication is used to transfer data to the base station for use by the pilot and the control center [
The main goal of this study is to design and develop a UAV system as a node of a field sensor network based on sensor observation service station (SOS Station) and sensor service grid (SSG). The aim is to achieve the following tasks: (1) design and implement a UAV system for real-time monitoring including framework, architecture and components; (2) connect sensors and geosensors such as GPS, gyroscope compass, and digital camera and laser range meter to a main controller for acquiring, processing and sending data to a ground station unit; (3) extend the UAV system to communicate with SOS and SSG so that it can act as one sensor node; (4) modify the sensor observation service station (SOS Station) and sensor service grid (SSG) to support mobile stations; (5) Test and evaluate the system in a flight experiment.
In this study, Voyager GSR 260 which is produced by JR PROPO, Japan, is used as a UAV platform. This is a 26cc gasoline engine helicopter, as shown in Figure
Voyager GSR 260 and Air Skipper 30, JR PROPO.
A sensor web is a group or system of sensors, which connect by using a communication infrastructure to exchange information as a sensor network. In this study, the proposed system considers using a sensor network application. It is a new approach to implement a real-time sensor network with high-density sensor nodes in order to acquire environmental information [
In this study, a digital camera, a gyroscope compass, a laser range meter, and a GPS (global positioning system) are used for the system development. These sensors are mounted on a UAV and controlled by a mini-PC. The acquired information is sent to the ground control station and it is processed and open to the public in real time. Figure
System architecture.
The operator uses RF (radio frequency) remote control to control the UAV. Operation range is up to 300 m with a height of 60 m. In addition, up to 2 persons can operate the UAV in case of long-range operation, which maybe out of sight range of one operator. Furthermore, the UAV system with SOS extension software can capture images from field areas as well as collect data from sensors and A/D (Analog to Digital) board for connecting sensors. A web server needs to be installed in the system to allow remote control from the ground control station. The communication link is a wireless LAN IEEE 802.11 g. The ground control station is an SOS station with a mobile feature which handles feeding measurement data from the UAV and synchronizing data between SOS and SSG [
A UAV system is developed using Java technology for the core system and C++ language for the device connecting parts. PostgreSQL is chosen as the database because it is a light-weight database, scalable; and moreover, it supports many platforms. Hibernate and Spring frameworks, which are prominent in database management and transaction control, are used as data access layers in this system. The system works as a multithread where all feeders have their own thread as each device has different data rates, such as 1 record per second for GPS, while a gyrocompass is 180 records per second. This technique allows the system to feed data at the maximum speed of each device but it does not need to wait for other devices. Conversely, it generates synchronized data, thus it needs an additional process to synchronize all data on a time basis.
The key elements of the system design are low cost, light weight, ease of use, and mobility. This is because small, commercially available, and relatively inexpensive sensors are used. The digital camera is a Canon PowerShot SX100 IS which features a 10 times optical zoom lens with optical Image Stabilizer, 8.0 Megapixel image sensor (1/2.5′′), and DIGIC III processor and runs on two AA alkaline batteries. This model is supported by the Canon PowerShot RemoteCapture Software Development Kit and the camera can be controlled by a computer. The weight is 351 g and images are captured via the USB interface. The gyroscope compass is MEMS-type IMU (Inertial Measurement Unit) which is produced by InterSense InertiaCube3. It is a precision orientation reference system which uses inertial tracking from the integration of nine sensing elements with advanced Kalman filtering algorithms. It is one of the smallest inertial measurement units and it weighs 155 g. It connects to the RS232 serial interface and runs from a 6 V power source. The laser range meter used is the TruPulse 200 Rangefinder model and it measures distances and heights. It weighs 378 g and comes standard with a serial port, offers in-scope data display with 7x power optics, and runs on two AA batteries or a single CRV-3 battery. The GPS receiver to be used is a u-blox AEK-4H GPS device which is a small and lightweight unit with active GPS antenna and uses a built-in USB interface for both power supply and high-speed data transfer, thus eliminating the need for an external power supply. It weighs 255 g. The temperature sensor chosen is National Instruments LM60, which has a linear response in Celsius. The sensor has been mounted on a 10-bit analog-to-digital converter card, which has a serial output interface and weighs 103 g. The microclient box is a mini PC with a small form factor and a fan-less design, an x86 CPU of 500 MHz with 1 GB RAM and it can be booted from a CF card. It is equipped with two RS232 serial interfaces, three USB interfaces, and a single ethernet interface. A mini-PC wireless LAN card is placed internally with external antenna. The weight is 300 g.
The devices need to connect to the microclient box computing system using different interfaces. As shown in Figure
Summary of power connections and data lines.
The ideal power supply for remote-controlled air vehicles is Lithium-Polymer (Li-Po) batteries, which come in cells of 3.7 V and can be packaged together to get higher voltages. The power supply requirements of each of the components described above have been considered. The total power consumption of all components is calculated to be 6.3 Watts. A Li-Po battery pack of 11.1 V, 1300 mAh is recommended, which can provide continuous power for more than 2 hours. A power supply module was designed and takes 11.1 V as input and provides output power supplies of 5 V and 6 V. Two regulators KIC-053 (5 V, 3 A) and 7806 (6 V, 1 A) are the main components. A 1 A fuse has been connected at the input from Li-Po battery for added protection. Since battery will be used in the platform and it cannot carry heavy size of battery, power consumption of each equipment must be minimized [
As shown in Figure
Sensor settings.
An experiment was conducted to test the system. The attachment was tested by being hand held and moved around to check the result and reliability in the first stage. Following this, the hardware platform was attached with the UAV and a flying experiment was conducted with full operation. Voyager GSR 260 was selected for the experiment. The test revealed that the UAV could fly without any problems and the system could also run with all sensors working while flying. Moreover, the ground station could view data and send control commands via a web interface through Wi-Fi. The mobile SOS station at the ground station was able to feed data from the UAV system and could synchronize data to the SSG server in a remote location using a mobile 3G Internet connection within almost real-time conditions. Figure
S Experiment setup on the ground.
UAV with an attachment flying over field area.
All sensor connectivity and data acquisition was observed through the Internet. Each feeder for receiving data from the sensors was made. The digital camera and gyroscope compass required a special method called “Java Native Interface (JNI)” to connect devices from Java. For the other sensors, data could be obtained directly from the com port with specific settings. Finally, a core system was developed using Java technology. Hibernate and Spring frameworks are used to control the data access layer. JSP, Servlet, and JSTL are used for the presentation layer. To integrate with a world map location, Google Map is used to show the map and associated pin-point location with latitude and longitude from GPS data. AJAX technology is also used to enhance the system to achieve a more real-time system. Figure
Acquired data.
Each sensor data must also keep its own location. Furthermore, a data feeder for feeding data from the UAV system is developed. The UAV system provides live interpolated data via an XML data format as shown in Algorithm
- <Sensor> - <General> <MissionName/> <Location/> <MonitorTime format=“yyyy-MM-dd HH:mm:ss.SSS”>2009-09-15 08:57:20.017</MonitorTime> - <GPS> <Latitude hemisphere=“N”>13.81672</Latitude> <Longitude hemisphere=“E”>100.52172</Longitude> <Altitude unit=“m”>8.00</Altitude> <Speed unit=“m/s”>55.00</Speed> <UTCTime format=“yyy-MM-dd HH:mm:ss.SSS”>2009-09-15 08:57:20.017</UTCTime> - <LaserRange> <Height unit=“m”>99</Height> <Inclination unit=“degree”>88</Inclination> - <Gyrocompass> <Roll unit=“degree”>1.00</Roll> <Pitch unit=“degree”>20.00</Pitch> <Yaw unit=“degree”>30.00</Yaw> - <Camera> <ImageValue>25521101110946</ImageValue> <ISO>100</ISO> <SpeedShutter>1/1000</SpeedShutter> <Aperture>3.2</Aperture> <ImageId>36</ImageId> <ImageUri>GetInterpolateImage.jsp?imageId=36</ImageUri> - <A2DSensor> <Temperature unit=“celsius”>33</Temperature> <Battery unit=“V”>11.1</Battery> - <Servo> <Pan unit=“degree” min=“−35” max=“+35”>6</Pan> <Tilt unit=“degree” min=“−35” max=“+35”>6</Tilt> </Sensor>
A UAV-based sensor web monitoring system is developed and all the measurement tools are mounted on the UAV to acquire detailed information from a low altitude. The main objective of this study is to design and develop a UAV system as a node of field sensor network which is based on SOS Station and SSG. The development starts from selecting suitable hardware and sensors by using size, weight, and power consumption as the main criteria because the test-bed UAV can have only 3-4 kg payloads, thus battery pack supplies electricity to all devices. The monitoring is carried out from the sky, but the spatial and temporal resolutions are freely selected near the ground. The data can be easily acquired collectively with safety and mobility by the utilization of a Sensor Web.
A Sensor Web is a type of sensor network which is especially well suited for disaster and environmental monitoring. Sensor nodes are spatially distributed and wirelessly communicate with each other. In this study, a UAV-based system is considered as a mobile sensor node and a combination of UAV-based monitoring with a ubiquitous sensor network is proposed. The system is a web-based application developed by Java Programming and uses PostgreSQL as the database server. Data feeders for each sensor are implemented to connect sensor and feed data. It works as a thread that allows the data feeder to run at the same time. Data is fed from the sensor into the database as well as to the web interface of UAV system.
The UAV system acts as a node of the sensor network and can send its data to the central server and publish for other people to view on the Internet in real time. Finally, system could feed data at one record per second for all sensors except digital camera images that feeds every ten seconds. Mobile SOS station that runs on the ground station unit can obtain interpolated data from the UAV system as well as synchronize both data and image and sensor to central server which is located in another location by using mobile 3G service within a few minutes, depending on the 3G Internet speed. The system feeds data from all sensors on the UAV and sends data to the central server in almost real time, which is suitable for applications and specialists such as surveillance, rescue, and conducting surveys.
The existing UAV system which is designed to work as a standalone system; thus the advantage of this UAV system can be interoperable with other ground monitoring stations and provide data in real time. As future potential applications, additional sensors can be added to monitor environment such as humidity and CO2 sensor. Also, this system can be improved by increasing performance of hardware such as digital camera for more advanced mapping purpose.