Identification and Stochastic Optimizing the UAV Motion Control in Turbulent Atmosphere
2 Kazan National Research Technical University - KAI, Kazan, Russia
3 Samara State Technical University, Samara, Russia
Received 6 August 2021
Revised until 28 October 2021
Accepted 2 November 2021
Online date 24 December 2021
Abstract
In a class of diffusion Markov processes, we formulate a problem of identification of nonlinear stochastic dynamic systems with random parameters, multiplicative and additive noises, control functions, and the state vector at a final time moment. For such systems, the identifiability conditions are being studied, and necessary conditions are formulated in terms of the general theory of extreme problems. The developed engineering methods for identification and optimizing nonlinear stochastic systems are presented as well as their application for unmanned aerial vehicles under wind disturbances caused by atmospheric turbulence, namely, for optimizing the autopilot parameters during a rotary maneuver of an unmanned aerial vehicle in translational motion, taking into account the identification of its angular velocities.
Keywords
- Unmanned Aerial Vehicle
- Motion Control
- Identification
- Stochastic Optimization
1. Introduction
Stochastic differential and discrete models are applied in the study of complex controlled systems under conditions of random parametric, structural, and external disturbances.
The mathematical foundations for such researches are presented in well-known monographs by Bulinsky and Shiryaev, 2005; Evlanov and Konstantinov, 1976; Fleming and Rishel, 1975; Gikhman and Skorokhod, 1977; Kazakov, 1977; Oksendal, 2000; Solodov and Solodov, 1988 et al. . Here and further, we apply for the alphabetical citation order.
Strict mathematical methods for optimizing nonlinear systems are also known; for example, Dubovitskii and Milyutin, 1965; Girsanov, 1970; Ioffe and Tikhomirov, 1974; Kazakov and Artemyev, 1980; Kolosov, 1984 et al..
In the applied theory of optimizing nonlinear stochastic systems, approximate methods based on parametric or functional approximation of the a posteriori probability distribution density are used. Parametric approximation methods are applied to determine the characteristics of stochastic processes, namely, a posteriori moments or cumulants, which are usually called semi-invariants, see the monographs by Bodner et al., 1987; Chernetsky, 1968; Denisov and Rodnishchev, 2017; Dostupov, 1970; Kozhevnikov, 1978; Malakhov, 1978; Potseluyev, 1984; Pugachev and Sinitsyn, 1985 et al..
Our theoretical results on this topic were presented in research papers (Rodnishchev, 2001a,b; Rodnishchev and Khairullin, 2010). These results were implemented in the Russian aerospace industry, namely in control systems of spacecraft (Rodnishchev et al., 2019), including mini-satellites for communication (Fig. 1) and the Earth-observing (Fig. 2), space robot-manipulators (SRMs), Fig. 3 (Somov et al. l., 2019), as well as Russian passenger airliners, Fig. 4 (Rodnishchev and Somova, 2019), in control systems of turboprop engines for various aviation equipment (Bodner et al., 1987; Kozhevnikov et al., 1989).
In this paper, methods for identification in stochastic control systems and study the problem of optimizing parameters of unmanned aerial vehicle (UAV) autopilot during its turning maneuver in translational movement under stochastic atmospheric turbulence are briefly presented.
Fig. 1. The communication mini-satellite
Fig. 2. The Earth-surveying mini-satellite
2. Models and the Problem Statement
In this section, the problem of identifying vectors of parameters and control is studied for nonlinear stochastic system
(1)
with a state vector at initial condition where and observations
(2)
Identification efficiency is evaluated by functional minimum
(3)
and control objectives, technical and operational requirements to the system are determined by constraints on the final system status of the equality type
(4)
Here is the expectation operator, and are the initial and final points of a time interval and .
As a control vector , we study a program control or feedback control . Control is determined on the set , where is the space of measurable functions with quadratic metrics and is a convex set.
Fig. 3. The SRM is preparing to capture a failed satellite
Fig. 4. Russian passenger airliner IL 96-300 on landing
The feedback control is considered as Borelian function as either a random element in or a non-anticipating process relative to Wiener processes with values in
Next, column determinate the controlling parameters; is a random vector; and are Stratonovich stochastic differentials of Wiener processes and , moreover, the process describes multiplicative noises affecting the system, the process describes additive noises, are white Gaussian noises that describes random internal perturbations common for the system, are the white Gaussian noises; , and are given nonrandom functions satisfying given requirements of solution existence (1), and is observed vector of tester coordinates The matrix component determines the selection of observed system coordinates (1), is derivative of Wiener process, is component of tester additive white noise.
At last, are continuous and continuously differentiable functionals on a set of variables, and is bounded functionally differentiable on the set of variables and are the weight numbers.
At accepted conditions concerning the right parts, solution (1) exists, and it is unambiguous. However, this solution does not need to be a Markov process. That is why, to make (1) describe the Markov process, we introduce an extended state vector . Relative to the state vector equations (1) reduce themselves to an equivalent system of diffusion stochastic differential equations
(5)
These equations have a single solution and describe the diffusion Markov process ; the posterior density of state probability satisfies the Stratonovich-Kushner equation (a generalization of the well-known Fokker-Planck- Kolmogorov equation)
(6)
with and initial condition . Here and is an elliptic operator determined by the formula
(7)
with coefficients of the drift and diffusion In the density function, the vector means that the whole output signal realization of the tester observed on the time interval is applied.
Assume that are the mutual forces of tester noises and scalar function characterize the tester properties. According to a theory of Markov processes, original identification problem (1) – (3) concerning the extended vector of system state reduces itself to an equivalent terminal problem with distributed parameters relative to a posterior density function in the form
(8)
(9)
with and the condition ;
(10)
Here the component is determined by equation
(11)
with initial condition and the operator
This model is identifiable if the system (5), (11) is controllable (Rodnishchev, 2001a; Denisov and Rodnishchev, 2017).
The main objectives of this paper are a brief presentation of our general approach to the considered problem and its practical application to optimizing the UAV autopilot parameters at its route turning under the turbulent wind perturbations.
3. Method and the Approach
For obtaining the necessary identification conditions in terms of conjugate cones in the general theory of extreme problems (Dubovitskii and Milyutin, 1965; Ioffe and Tikhomirov, 1974), the method by Girsanov (1970) is applied.
In this case, the solution to the equation (6) is needed as well as the coupled Bellman parabolic equation. However, as it is known, analytic solutions to linear and special cases of nonlinear stochastic systems only can be obtained. Here our approach (Rodnishchev, 2001) is applied, which is based on employing mathematical statistics.
The identification problem with respect to a posteriori semi invariant is reduced to the equivalent extreme problem of the estimation parameters, control, and components of the state vector in the form
(12)
(13)
for N>3 with initial conditions
and indexes , also taking into account (10).
The equations (13) present variations of semi-invariants of the 1-st order by -th components for the system state vector, coinciding with the mathematical expectations; semi-invariants and of 2-nd order by -th components and the relationship between -th and -th components, coinciding with the dispersion and correlation functions of the state vector; at last, semi-invariants of the -th order.
For the closure of a shortened system of differential equations (13) and an approximate representation of the higher moments through the lower moments, the method of moment semi-invariants is applied (Dashevskii, 1976).
Assume , that is sufficient to solve practical problems. Semi-invariants are not independent, and they are bound by the conditions for the functions (Malakhov, 1978):
These functional inequalities should be performed in the solution of the optimization problem (12), (13) on the time interval , so that is the functions must belong to an integral variety for the set of differential equations
(14)
4. Optimizing the UAV Autopilot Parameters
This section solves the problem of stochastic optimization of autopilot parameters for the UAV turn mode, taking into account the identification of UAV angular velocities in atmospheric turbulence.
At an angular velocity the UAV lateral angular motion is described in standard notations by the equations
(15)
where with a nominal true airspeed of the UAV flight and a scale of turbulence; with the root mean square (RMS) value of the turbulence intensity, is standard white noise, and is the UAV balancing angle of attack. Here we use the following notations
where are the UAV aerodynamic coefficients, and are the autopilot gear ratios.
To determine variations of the additional sliding angle , we use a model for the horizontal wind turbulence components, which describes a Gaussian random process with a spectral density , and when using the formative filter (Pugachev and Sinitsyn, 1985), it is represented by a stochastic differential equation in (15) with the input noise .
The autopilot gear ratios are linearly related to the coefficients of the stochastic system (15), so the definition of the ratios is reduced to the optimization of these coefficients with the angular velocity measurements where the vector and are standard white noises.
The effectiveness of the linear control law optimization is estimated the functional minimum
(16)
Since wind disturbances caused by horizontal gusts can lead to large deviations when turning the UAV, the parameters of control law are determined so that coefficients of the characteristic polynomial for the closed-loop system (15) provide a consistent choice of parameters from the asymptotic stability region.
With the notation, this region has the boundary defined by the following constraints:
To solve the optimization problem, the additional variable is introduced, which is determined by the solution of the differential equation
with the initial condition , and the functional (16) is reduced to the following terminal form
(17)
Thus, the problem of optimizing the autopilot gear ratios is reduced to determining the vector column
with a providing of the minimum terminal functional (17) and taking into account the need for identification of the angular velocities and to the above restrictions on asymptotic stability region.
The system (15) describes a diffusion on Markovian process with the state vector , the coefficients of drift
and diffusion Here, for identification of the above angular velocities, the scalar function
is applied. So, the stochastic problem is reduced to the deterministic one for the semi-invariants as follows
(18)
taking into account the above restrictions on the asymptotic stability region. Equations (18), (19) are ordinary differential equations of order 36 with respect to semi-invariants and , , with indexes
5. The Simulation Results and Discussion
The dynamics of the UAV turn with a mass of 320 kg was studied, taking into account wind disturbances caused by atmospheric turbulence. At the flight altitude m with airspeed m/s and the balancing angle of attack deg, the UAV aerodynamic coefficients have the following values (Romanenko et al., 2012):
Moreover, coefficients of the characteristic polynomial providing stability have the values
In this case, the UAV autopilot ratios are equal to the values
(20)
which correspond to the following coefficients
The problem of optimization (18), (19) with restrictions at the turbulence scale m is solved with the specified height and the RMS value m/s for turbulence of the wind, which corresponds to the ”strong” turbulence according to the European airworthiness standards. As a result of solving the optimization problem with identifying the UAV angular velocities by the proposed approach, the coefficients were obtained with the values
which correspond to the autopilot gear ratios with the following values:
(21)
Fig. 5. The changing average values of angle Fig. 6. The changing average values of angular rate |
The transients corresponding to the initial values of the autopilot gear ratios (20) are shown in Figs. 5 – 8 in continuous graphs (1, red). The transients corresponding to optimized values of the autopilot gear ratios (21), taking into account the wind turbulent disturbances and identification of the angular velocities, are presented in the same figures by dashed graphs (2, blue).
The presented data clearly demonstrate that the UAV autopilot parameters synthesized, taking into account wind effects, on average, provide a parry of disturbances caused by atmospheric turbulence, and reduce the amplitude of damped oscillations in the transient processes.
6. Conclusions
Elaborated methods for identification of the parameters and control functions of nonlinear stochastic systems with perturbations, noises, and functional equality type constraints are presented. Important applications relating to optimizing the parameters of the UAV autopilot during its rotational maneuver in translational motion when the turbulent wind disturbances, taking into account the identification of the UAV angular velocities, are briefly represented. The article’s main breakthroughs are as follows:
(i) For random controlled processes, a fast calculation of semi-invariants is performed with the necessary accuracy. The results are applied for recurrent parametric optimization on the specified criteria;
(ii) The developed algorithms were implemented in contemporary computer-aided technology of designing UAVs.
Abbreviations
RMS | : | Root Mean Square |
SRM | Space Robot-manipulator | |
UAV | : | Unmanned Aerial Vehicle |
Funding
The work was supported by Russian Foundation for Basic Research (RFBR), Grant no. 20-08-00779.
CRediT Author Statement
Yevgeny Somov: Writing-Original draft preparation, Editing. Nikolay Rodnishchev: Conceptualization, Validation. Tatyana Somova: Software, Simulation, Data Processing, Graphical Representation of Results.
References
Bodner, V., Rodnishchev, N. and Yurikov, E., 1987, Optimization of Terminal Stochastic Systems. Moscow: Mashinostroyeniye.
Bulinsky, A. V. and Shiryaev, A. N., 2005, Theory of Random Processes. Moscow: PhysMathLit.
Chernetsky, V. I., 1968, Analysis of Accuracy of Nonlinear Control Systems. Moscow: Mashinostroyeniye.
Dashevskii, M.L., 1976, Implementing a moment semi-invariant method for random process analysis. Avtomatika i Telemekhanika, (10), pp.23-26.
Denisov, K. and Rodnishchev, N., 2017, Identification of Parameters and Control for Stochastic Dynamical Systems with Functional Limitations. Kazan: Shkola.
Dostupov, B. G., Ed., 1970, Statistical Methods in Design of Nonlinear Automatic Control Systems, Moscow: Mashinostroyeniye.
Dubovitskii, A. and Milyutin, A., 1965, Extreme problems with restrictions, USSR Comp. Math. and Math. Phys., 5(3), pp. 1-80.
Evlanov, E. and Konstantinov, V., 1976, Systems with Random Parameters, Moscow: Nauka.
Fleming, W.H. and Rishel, R.W., 2012, Deterministic and stochastic optimal control (Vol. 1), Springer Science & Business Media.
Gikhman, I.I. and Skorokhod, A.V., 2004, The theory of stochastic processes II, Springer Science & Business Media.
Girsanov, I.V., 2012, Lectures on mathematical theory of extremum problems (Vol. 67), Springer Science & Business Media.
Ioffe, A. and Tikhomirov, V., 1974, Theory of Extreme Problems, Moscow: Nauka.
Kazakov, I., 1977, Statistical Dynamics of Systems with Variable Structure, Moscow: Nauka.
Kazakov, I. and Artemyev, V., 1980, Optimization of Dynamic Systems with Random Structure, Moscow: Nauka.
Kolosov, G., 1984, Synthesis of Optimal Automatic Systems at Random Disturbances, Moscow: Nauka.
Kozhevnikov, Yu., 1978, Statistical Optimization of Flying Vehicles, Moscow: Mashinostroyeniye.
Kozhevnikov, Yu., Agdamov, R. et al., 1989, Computer Aided Tests in Aviation Industry, Moscow: Mashinostroyeniye.
Malakhov, A., 1978, Cumulative Analysis of Random non-Gaussian Processes and their Transformations, Moscow: Sov. Radio.
Oksendal, B., 2000, Stochastic Differential Equations, New York: Springer Verlag.
Potseluyev, A. V., 1984, Statistical Analysis and Synthesis of Complex Dynamic Systems, Moscow: Mashinostroyeniye.
Pugachev, V. and Sinitsyn, I., 1985, Stochastic Differential Systems, Moscow: Nauka.
Romanenko, L., Samarova, G. and Zaitsev, S., 2012, Control of lateral motion of a flying vehicle with one symmetry plane, Vestnik of Tupolev Kazan State Technical University, (2), pp. 260-267.
Rodnishchev, N., 2001a, Approximate method for optimal control of nonlinear stochastic systems with limita-tions, Automat. Rem. Contr., 62(2), pp. 248-259.
Rodnishchev, N., 2001b, Necessary conditions for the optimal control of constrained discontinuous nonlinear stochastic systems, J. Comput. Sys. Sc. Int., 40(6), pp. 878-889.
Rodnishchev, N.E. and Khairullin, A.K., 2010, Necessary conditions for optimality of stochastic systems with uncontrollable flow of failures and constraints of the equality and inequality type, Automation and Remote Control, 71(11), pp.2367-2382.
Rodnishchev, N., Somov, Y., Butyrin, S. and Somova, T., 2019, Reliable Control Optimization in Aerospace Engineering at Stochastic Stream of Faults, IFAC-PapersOnLine, 52(12), pp.188-193.
Rodnishchev, N. and Somova, T., 2019, June. Identification and Stochastic Checking a Control Safety at a Landing of Aerospace Vehicles. In 2019 IEEE 5th International Workshop on Metrology for AeroSpace (MetroAeroSpace) (pp. 506-510), IEEE.
Solodov, A. and Solodov, A., 1988, Statistical Dynamics of Systems with Dotted Processes, Moscow: Nauka.
Somov, Y., Butyrin, S., Somov, S. and Somova, T., 2019, Control of robot-manipulator during its preparation and capture of a passive satellite, Mathematics in Engineering, Science & Aerospace (MESA), 10(3).





