System identification
Black box systems  

Concepts  
Black box · Oracle machine  
Methods and techniques  
Blackbox testing · Blackboxing


Related techniques  
Feed forward · Obfuscation Pattern recognition · White box System identification 

Fundamentals  
A priori information · Control systems Open systems · Operations research Thermodynamic systems 

The field of system identification^{Note a} uses statistical methods to build mathematical models of dynamical systems from measured data ^{[1]}. System identification also includes the optimal design of experiments for efficiently generating informative data for fitting such models as well as model reduction.
Contents
Overview
A dynamical mathematical model in this context is a mathematical description of the dynamic behavior of a system or process in either the time or frequency domain. Examples include:
 physical processes such as the movement of a falling body under the influence of gravity;
 economic processes such as stock markets that react to external influences.
One of the many possible applications of system identification is in control systems. For example, it is the basis for modern datadriven control systems, in which concepts of system identification are integrated into the controller design, and lay the foundations for formal controller optimality proofs.
Inputoutput vs outputonly
System identification techniques can utilize both input and output data (e.g. eigensystem realization algorithm) or can include only the output data (e.g. frequency domain decomposition). Typically an inputoutput technique would be more accurate, but the input data is not always available.
Optimal design of experiments
The quality of system identification depends on the quality of the inputs, which are under the control of the systems engineer. Therefore, systems engineers have long used the principles of the design of experiments. In recent decades, engineers have increasingly used the theory of optimal experimental design to specify inputs that yield maximally precise estimators.^{[2]}^{[3]}
White and blackbox
One could build a socalled whitebox model based on first principles, e.g. a model for a physical process from the Newton equations, but in many cases such models will be overly complex and possibly even impossible to obtain in reasonable time due to the complex nature of many systems and processes.
A much more common approach is therefore to start from measurements of the behavior of the system and the external influences (inputs to the system) and try to determine a mathematical relation between them without going into the details of what is actually happening inside the system. This approach is called system identification. Two types of models are common in the field of system identification:
 grey box model: although the peculiarities of what is going on inside the system are not entirely known, a certain model based on both insight into the system and experimental data is constructed. This model does however still have a number of unknown free parameters which can be estimated using system identification.^{[4]}^{[5]} One example^{[6]} uses the Monod saturation model for microbial growth. The model contains a simple hyperbolic relationship between substrate concentration and growth rate, but this can be justified by molecules binding to a substrate without going into detail on the types of molecules or types of binding. Grey box modeling is also known as semiphysical modeling.^{[7]}
 black box model: No prior model is available. Most system identification algorithms are of this type.
In the context of nonlinear system identification Jin et al.^{[8]} describe greybox modeling by assuming a model structure a priori and then estimating the model parameters. Parameter estimation is relatively easy if the model form is known but this is rarely the case. Alternatively the structure or model terms for both linear and highly complex nonlinear models can be identified using NARMAX methods.^{[9]} This approach is completely flexible and can be used with grey box models where the algorithms are primed with the known terms, or with completely black box models where the model terms are selected as part of the identification procedure. Another advantage of this approach is that the algorithms will just select linear terms if the system under study is linear, and nonlinear terms if the system is nonlinear, which allows a great deal of flexibility in the identification.
Identification for control
In control systems applications, the objective of engineers is to obtain a good performance of the closedloop system, which is the one comprising the physical system, the feedback loop and the controller. This performance is typically achieved by designing the control law relying on a model of the system, which needs to be identified starting from experimental data. If the model identification procedure is aimed at control purposes, what really matters is not to obtain the best possible model that fits the data, as in the classical system identification approach, but to obtain a model satisfying enough for the closedloop performance. This more recent approach is called identification for control, or I4C in short.
The idea behind I4C can be better understood by considering the following simple example^{[10]}. Consider a system with true transfer function :
and an identified model :
From a classical system identification perspective, is not, in general, a good model for . In fact, modulus and phase of are different from those of at low frequency. What is more, while is an asymptotically stable system, is a simply stable system. However, may still be a model good enough for control purposes. In fact, if one wants to apply a purely proportional negative feedback controller with high gain , the closedloop transfer function from the reference to the output is, for
and for
Since is very large, one has that . Thus, the two closedloop transfer functions are indistinguishable. In conclusion, is a perfectly acceptable identified model for the true system if such feedback control law has to be applied.
In conclusion, whether or not a model is appropriate for control design depends not only on the plant/model mismatch, but also on the controller that will be implemented. As such, in the I4C framework, given a control performance objective, the control engineer has to design the identification phase in such a way that the performance achieved by the modelbased controller on the true system is as high as possible.
Sometimes, it is even convenient to design a controller without explicitly identifying a model of the system, but directly working on experimental data. This is the case of direct datadriven control systems.
See also
 Black box
 Generalized filtering
 Hysteresis
 Identifiability
 System realization
 Parameter estimation
 Linear timeinvariant system theory
 Model selection
 Nonlinear autoregressive exogenous model
 Open system (systems theory)
 Pattern recognition
 System dynamics
 Systems theory
 Model order reduction
 Grey box completion and validation
 Datadriven control system
Notes
^a In some situations the term model identification is applied. Model identification apparently is used in a more general and modern sense, what makes system identification a special case.^{[citation needed]}
References
 ^ T. Söderström, P. Stoica, System Identification, Prentice Hall, Upper Saddle River, N.J., 1989. ISBN 0138812365
 ^ Goodwin, Graham C. & Payne, Robert L. (1977). Dynamic System Identification: Experiment Design and Data Analysis. Academic Press. ISBN 0122897501.
 ^ Walter, Éric & Pronzato, Luc (1997). Identification of Parametric Models from Experimental Data. Springer.
 ^ Nielsen, Henrik Aalborg; Madsen, Henrik (2000) "Predicting the Heat Consumption in District Heating Systems using Meteorological Forecasts", Department of Mathematical Modelling, Technical University of Denmark
 ^ Henrik Aalborg Nielsen, Henrik Madsen (2006) "Modelling the heat consumption in district heating systems using a greybox approach", Energy and Buildings,38 (1), 63–71, doi:10.1016/j.enbuild.2005.05.002
 ^ Wimpenny, J.W.T. (1997) "The Validity of Models", Adv Dent Res, 11(1 ):150–159
 ^ Forssell, Lindskog, Combining SemiPhysical and Neural Network Modeling: An Example of Its Usefulness
 ^ Jin, Sain, Pham, Spencer, Ramallo, (2001) "Modeling MRDampers: A Nonlinear Blackbox Approach", Proceedings of the American Control Conference Arlington, VA June 25–27
 ^ Billings S.A. "Nonlinear System Identification: NARMAX Methods in the Time, Frequency, and SpatioTemporal Domains". Wiley, 2013
 ^ Gevers, M. (2005). Identification for control: From the early achievements to the revival of experiment design. European journal of control, 11(4–5), 335–352.
Further reading
 Goodwin, Graham C. & Payne, Robert L. (1977). Dynamic System Identification: Experiment Design and Data Analysis. Academic Press.
 Daniel Graupe: Identification of Systems, Van Nostrand Reinhold, New York, 1972 (2nd ed., Krieger Publ. Co., Malabar, FL, 1976)
 Eykhoff, Pieter: System Identification – Parameter and System Estimation, John Wiley & Sons, New York, 1974. ISBN 0471249807
 Lennart Ljung: System Identification — Theory For the User, 2nd ed, PTR Prentice Hall, Upper Saddle River, N.J., 1999.
 JerNan Juang: Applied System Identification, Prentice Hall, Upper Saddle River, N.J., 1994.
 Kushner, Harold J. and Yin, G. George (2003). Stochastic Approximation and Recursive Algorithms and Applications (Second ed.). Springer.
 Oliver Nelles: Nonlinear System Identification, Springer, 2001. ISBN 3540673695
 T. Söderström, P. Stoica, System Identification, Prentice Hall, Upper Saddle River, N.J., 1989. ISBN 0138812365
 R. Pintelon, J. Schoukens, System Identification: A Frequency Domain Approach, 2nd Edition, IEEE Press, Wiley, New York, 2012. ISBN 9780470640371
 Walter, Éric & Pronzato, Luc (1997). Identification of Parametric Models from Experimental Data. Springer.
External links
 L. Ljung: Perspectives on System Identification, July 2008
 System Identification and Model Reduction via Empirical Gramians