Rocket Control
This tutorial was originally contributed by Iain Dunning.
This tutorial shows how to solve a nonlinear rocketry control problem. The problem was drawn from the COPS3 benchmark.
Our goal is to maximize the final altitude of a vertically launched rocket.
We can control the thrust of the rocket, and must take account of the rocket mass, fuel consumption rate, gravity, and aerodynamic drag.
Let us consider the basic description of the model (for the full description, including parameters for the rocket, see the COPS3 PDF)
Overview
We will use a discretized model of time, with a fixed number of time steps, $n$.
We will make the time step size $\Delta t$, and thus the final time $t_f = n \cdot \Delta t$, a variable in the problem. To approximate the derivatives in the problem we will use the trapezoidal rule.
State and Control
We will have three state variables:
- Velocity, $v$
- Altitude, $h$
- Mass of rocket and remaining fuel, $m$
and a single control variable, thrust $T$.
Our goal is thus to maximize $h(t_f)$.
Each of these corresponds to a JuMP variable indexed by the time step.
Dynamics
We have three equations that control the dynamics of the rocket:
Rate of ascent: $h^\prime = v$ Acceleration: $v^\prime = \frac{T - D(h,v)}{m} - g(h)$ Rate of mass loss: $m^\prime = -\frac{T}{c}$
where drag $D(h,v)$ is a function of altitude and velocity, and gravity $g(h)$ is a function of altitude.
These forces are defined as
\[D(h,v) = D_c v^2 exp\left( -h_c \left( \frac{h-h(0)}{h(0)} \right) \right)\]
and $g(h) = g_0 \left( \frac{h(0)}{h} \right)^2$
The three rate equations correspond to JuMP constraints, and for convenience we will represent the forces with nonlinear expressions.
using JuMP
import Ipopt
import Plots
Create JuMP model, using Ipopt as the solver
rocket = Model(Ipopt.Optimizer)
set_silent(rocket)
Constants
Note that all parameters in the model have been normalized to be dimensionless. See the COPS3 paper for more info.
h_0 = 1 # Initial height
v_0 = 0 # Initial velocity
m_0 = 1 # Initial mass
g_0 = 1 # Gravity at the surface
T_c = 3.5 # Used for thrust
h_c = 500 # Used for drag
v_c = 620 # Used for drag
m_c = 0.6 # Fraction of initial mass left at end
c = 0.5 * sqrt(g_0 * h_0) # Thrust-to-fuel mass
m_f = m_c * m_0 # Final mass
D_c = 0.5 * v_c * m_0 / g_0 # Drag scaling
T_max = T_c * g_0 * m_0 # Maximum thrust
n = 800 # Time steps
800
Decision variables
@variables(rocket, begin
Δt ≥ 0, (start = 1 / n) # Time step
# State variables
v[1:n] ≥ 0 # Velocity
h[1:n] ≥ h_0 # Height
m_f ≤ m[1:n] ≤ m_0 # Mass
# Control variables
0 ≤ T[1:n] ≤ T_max # Thrust
end);
Objective
The objective is to maximize altitude at end of time of flight.
@objective(rocket, Max, h[n])
\[ h_{800} \]
Initial conditions
fix(v[1], v_0; force = true)
fix(h[1], h_0; force = true)
fix(m[1], m_0; force = true)
fix(m[n], m_f; force = true)
Forces
@NLexpressions(
rocket,
begin
# Drag(h,v) = Dc v^2 exp( -hc * (h - h0) / h0 )
drag[j = 1:n], D_c * (v[j]^2) * exp(-h_c * (h[j] - h_0) / h_0)
# Grav(h) = go * (h0 / h)^2
grav[j = 1:n], g_0 * (h_0 / h[j])^2
# Time of flight
t_f, Δt * n
end
);
Dynamics
for j in 2:n
# h' = v
# Rectangular integration
# @NLconstraint(rocket, h[j] == h[j - 1] + Δt * v[j - 1])
# Trapezoidal integration
@NLconstraint(rocket, h[j] == h[j-1] + 0.5 * Δt * (v[j] + v[j-1]))
# v' = (T-D(h,v))/m - g(h)
# Rectangular integration
# @NLconstraint(
# rocket,
# v[j] == v[j - 1] + Δt *((T[j - 1] - drag[j - 1]) / m[j - 1] - grav[j - 1])
# )
# Trapezoidal integration
@NLconstraint(
rocket,
v[j] ==
v[j-1] +
0.5 *
Δt *
(
(T[j] - drag[j] - m[j] * grav[j]) / m[j] +
(T[j-1] - drag[j-1] - m[j-1] * grav[j-1]) / m[j-1]
)
)
# m' = -T/c
# Rectangular integration
# @NLconstraint(rocket, m[j] == m[j - 1] - Δt * T[j - 1] / c)
# Trapezoidal integration
@NLconstraint(rocket, m[j] == m[j-1] - 0.5 * Δt * (T[j] + T[j-1]) / c)
end
Solve for the control and state
println("Solving...")
optimize!(rocket)
solution_summary(rocket)
* Solver : Ipopt
* Status
Result count : 1
Termination status : LOCALLY_SOLVED
Message from the solver:
"Solve_Succeeded"
* Candidate solution (result #1)
Primal status : FEASIBLE_POINT
Dual status : FEASIBLE_POINT
Objective value : 1.01283e+00
Dual objective value : 4.57625e+00
* Work counters
Solve time (sec) : 1.14790e+00
Display results
println("Max height: ", objective_value(rocket))
Max height: 1.0128340648308019
function my_plot(y, ylabel)
return Plots.plot(
(1:n) * value.(Δt),
value.(y)[:];
xlabel = "Time (s)",
ylabel = ylabel,
)
end
Plots.plot(
my_plot(h, "Altitude"),
my_plot(m, "Mass"),
my_plot(v, "Velocity"),
my_plot(T, "Thrust");
layout = (2, 2),
legend = false,
margin = 1Plots.cm,
)
This tutorial was generated using Literate.jl. View the source .jl
file on GitHub.