Estimation of the mean of a stochastic variable observed in noise with positive support is considered. It is well known from the literature that order statistics gives one order of magnitude lower estimation variance compared to the best linear unbiased estimator (BLUE). We provide a systematic survey of some common distributions with positive support, and provide derivations of minimum variance unbiased estimators (MVUE) based on order statistics, including BLUE for comparison. The estimators are derived with or without knowledge of the hyperparameters of the underlying noise distribution. Though the uniform, exponential and Rayleigh distributions, respectively, we consider are standard in literature, the problem of estimating the location parameter with additive noise from these distribution seems less studied, and we have not found any explicit expressions for BLUE and MVUE for these cases. In addition to additive noise with positive support, we also consider the mixture of uniform and normal noise distribution for which an order statistics-based unbiased estimator is derived. Finally, an iterative global navigation satellite system (GNSS) localization algorithm with uncertain pseudorange measurements is proposed which relies on the derived estimators for receiver clock bias estimation. Simulation data for GNSS time estimation and experimental GNSS data for joint clock bias and position estimation are used to evaluate the performance of the proposed methods.

Background Optical coherence tomography (OCT) could be complementary to magnetic resonance imaging (MRI) of the brain in monitoring course of multiple sclerosis (MS) and clinically isolated syndrome (CIS). Thinning of neurons in ganglion cell-inner plexiform layer (GCIPL) measured by OCT is assumed to be associated with brain atrophy. Objectives To evaluate association of GCIPL with brain parameters detected by quantitative MRI (qMRI) and MR-spectroscopy (MRS) in early MS and CIS. Methods Seventeen newly diagnosed MS and 18 CIS patients were prospectively included. The patients were assessed at baseline as well as at 1 year follow-up by OCT, qMRI and MRS. Brain parenchymal and myelin volumes (BPV, MYV respectively) and the corresponding fractions (BPF, MYF) were measured with qMRI. Metabolites including myo-inositol (myo-Ins) were measured in the normal-appearing white matter (NAWM) using MRS. T-tests and ANOVA were used to analyze group differences, and linear regression models to evaluate association of GCIPL with BPV, MYV and myo-Ins after correlation analysis. Results Disease activity reflected by lesions on MRI and presence of CSF oligoclonal IgG bands were more prominent in MS compared to CIS. GCIPL, BPV, MYV, BPF and MYF were reduced, while concentration of myo-Ins was increased in MS compared to CIS. Follow-up showed consistency of thinner GCIPL in MS compared to CIS. GCIPL thinning correlated with reduced BPV and MYV (P < .05 for both), but with increased myo-Ins (P < .01). Conclusions Significant GCIPL thinning occurs in early MS and is associated with enhanced brain inflammation and atrophy.

The constrained consensus problem considered in this paper, denoted interval consensus, is characterized by the fact that each agent can impose a lower and upper bound on the achievable consensus value. Such constraints can be encoded in the consensus dynamics by saturating the values that an agent transmits to its neighboring nodes. We show in the paper that when the intersection of the intervals imposed by the agents is nonempty, the resulting constrained consensus problem must converge to a common value inside that intersection. In our algorithm, convergence happens in a fully distributed manner, and without need of sharing any information on the individual constraining intervals. When the intersection of the intervals is an empty set, the intrinsic nonlinearity of the network dynamics raises new challenges in understanding the node state evolution. Using Brouwer fixed-point theorem we prove that in that case there exists at least one equilibrium, and in fact the possible equilibria are locally stable if the constraints are satisfied or dissatisfied at the same time among all nodes. For graphs with sufficient sparsity it is further proven that there is a unique equilibrium that is globally attractive if the constraint intervals are pairwise disjoint.

We propose a Bayesian framework for the received-signal-strength-based cooperative localization problem with unknown path loss exponent. Our purpose is to infer the marginal posterior of each unknown parameter: the position or the path loss exponent. This probabilistic inference problem is solved using message passing algorithms that update messages and beliefs iteratively. For numerical tractability, we combine the variable discretization and Monte-Carlo-based numerical approximation schemes. To further improve computational efficiency, we develop an auxiliary importance sampler that updates the beliefs with the help of an auxiliary variable. An important ingredient of the proposed auxiliary importance sampler is the ability to sample from a normalized likelihood function. To this end, we develop a stochastic sampling strategy that mathematically interprets and corrects an existing heuristic strategy. The proposed message passing algorithms are analyzed systematically in terms of computational complexity, demonstrating the computational efficiency of the proposed auxiliary importance sampler. Various simulations are conducted to validate the overall good performance of the proposed algorithms.

An Informed Path Planning algorithm for multiple agents is presented. It can be used to efficiently utilize available agents when surveying large areas, when total coverage is unattainable. Internally the algorithm has a Probability Hypothesis Density (PHD) representation, inspired by modern multi-target tracking methods, to represent unseen objects. Using the PHD, the expected number of observed objects is optimized. In a sequential manner, each agent maximizes the number of observed new targets, taking into account the probability of undetected objects due to previous agents actions and the probability of detection, which yields a scalable algorithm. Algorithm properties are evaluated in simulations, and shown to outperform a greedy base line method. The algorithm is also evaluated by applying it to a sea ice tracking problem, using two datasets collected in the Arctic, with reasonable results. An implementation is provided under an Open Source license.

System identification is a mature research area with well established paradigms, mostly based on classical statistical methods. Recently, there has been considerable interest in so called kernel-based regularisation methods applied to system identification problem. The recent literature on this is extensive and at times difficult to digest. The purpose of this contribution is to provide an accessible account of the main ideas and results of kernel-based regularisation methods for system identification. The focus is to assess the impact of these new techniques on the field and traditional paradigms.

People with hearing impairment typically have difficulties following conversations in multi-talker situations. Previous studies have shown that utilizing eye gaze to steer audio through beamformers could be a solution for those situations. Recent studies have shown that in-ear electrodes that capture electrooculography in the ear (EarEOG) can estimate the eye-gaze relative to the head, when the head was fixed. The head movement can be estimated using motion sensors around the ear to create an estimate of the absolute eye-gaze in the room. In this study, an experiment was designed to mimic a multi-talker situation in order to study and model the EarEOG signal when participants attempted to follow a conversation. Eleven hearing impaired participants were presented speech from the DAT speech corpus (Bo Nielsen et al., 2014), with three targets positioned at -30 degrees, 0 degrees and +30 degrees azimuth. The experiment was run in two setups: one where the participants had their head fixed in a chinrest, and the other where they were free to move their head. The participants task was to focus their visual attention on an LED-indicated target that changed regularly. A model was developed for the relative eye-gaze estimation, taking saccades, fixations, head movement and drift from the electrode-skin half-cell into account. This model explained 90.5% of the variance of the EarEOG when the head was fixed, and 82.6% when the head was free. The absolute eye-gaze was also estimated utilizing that model. When the head was fixed, the estimation of the absolute eye-gaze was reliable. However, due to hardware issues, the estimation of the absolute eye-gaze when the head was free had a variance that was too large to reliably estimate the attended target. Overall, this study demonstrated the potential of estimating absolute eye-gaze using EarEOG and motion sensors around the ear.

In this paper, we introduce an optimal average cost learning framework to solve output regulation problem for linear systems with unknown dynamics. Our optimal framework aims to design the controller to achieve output tracking and disturbance rejection while minimizing the average cost. We derive the Hamilton-Jacobi-Bellman (HJB) equation for the optimal average cost problem and develop a reinforcement algorithm to solve it. Our proposed algorithm is an off-policy routine which learns the optimal average cost solution completely model-free. We rigorously analyze the convergence of the proposed algorithm. Compared to previous approaches for optimal tracking controller design, we elevate the need for judicious selection of the discounting factor and the proposed algorithm can be implemented completely model-free. We support our theoretical results with a simulation example. (C) 2019 Elsevier Ltd. All rights reserved.

This letter deals with the issue of obtaining consistent parameter estimators in nonlinear regression models where the regressors are second-order modulus functions, which is a structure that is often used in models of marine vessels. It is shown that the accuracy of an instrumental variable estimator can be improved by conducting experiments where the input signal has a static offset of sufficient amplitude and the instruments are forced to have zero mean. The proposed method is then evaluated in a simulation example.

System Identification is about estimating models of dynamical systems from measured input-output data. Its traditional foundation is basic statistical techniques, such as maximum likelihood estimation and asymptotic analysis of bias and variance and the like. Maximum likelihood estimation relies on minimization of criterion functions that typically are non-convex, and may cause numerical search problems and estimates trapped in local minima. Recent interest in identification algorithms has focused on techniques that are centered around convex formulations. This is partly the result of developments in semidefinite programming, machine learning and statistical learning theory. The development concerns issues of regular-ization for sparsity and for better tuned bias/variance trade-offs. It also involves the use of subspace methods as well as nuclear norms as proxies to rank constraints. A special approach is to look for difference-of-convex programming (DCP) formulations, in case a pure convex criterion is not found. Other techniques are based on Lagrangian relaxation and contraction theory. A quite different route to convexity is to use algebraic techniques to manipulate the model parameterizations. This article will illustrate all this recent development.

The problem of estimating continuous-time model parameters of linear dynamical systems using sampled time-domain input and output data has received considerable attention over the past decades and has been approached by various methods. The research topic also bears practical importance due to both its close relation to first principles modelling and equally to linear model-based control design techniques, most of them carried in continuous time. Nonetheless, as the performance of the existing algorithms for continuous-time model identification has seldom been assessed and, as thus far, it has not been considered in a comprehensive study, this practical potential of existing methods remains highly questionable. The goal of this brief paper is to bring forward a first study on this issue and to factually highlight the main aspects of interest. As such, an analysis is performed on a benchmark designed to be consistent both from a system identification viewpoint and from a control-theoretic one. It is concluded that robust initialization aspects require further research focus towards reliable algorithm development. (C) 2019 Elsevier Ltd. All rights reserved.

Model predictive control (MPC) is one of the most widely spread advanced control schemes in industry today. In MPC, a constrained finite-time optimal control (CFTOC) problem is solved at each iteration in the control loop. The CFTOC problem can be solved using, for example, second-order methods, such as interior-point or active-set methods, where the computationally most demanding part often consists of computing the sequence of second-order search directions. Each search direction can be computed by solving a set of linear equations that corresponds to solving an unconstrained finite-time optimal control (UFTOC) problem. In this paper, different direct (noniterative) parallel algorithms for solving UFTOC problems are presented. The parallel algorithms are all based on a recursive variable elimination and solution propagation technique. Numerical evaluations of one of the parallel algorithms indicate that a significant boost in performance can be obtained, which can facilitate high-performance second-order MPC solvers.

Some controllability aspects for iterative learning control (ILC) are discussed. Via a batch (lifted) description of the problem a state space model of the system to be controlled is formulated in the iteration domain. This model provides insight and enables analysis of the conditions for and relationships between controllability, output controllability and target path controllability. In addition, the property miminum lead target path controllability is introduced. This property, which is connected to the number of time delays, plays an important role in the design of ILC algorithms. The properties are illustrated by a numerical example.

To optimally compensate for time-varying phase aberrations with adaptive optics, a model of the dynamics of the aberrations is required to predict the phase aberration at the next time step. We model the time-varying behavior of a phase aberration, expressed in Zernike modes, by assuming that the temporal dynamics of the Zernike coefficients can be described by a vector-valued autoregressive (VAR) model. We propose an iterative method based on a convex heuristic for a rank-constrained optimization problem, to jointly estimate the parameters of the VAR model and the Zernike coefficients from a time series of measurements of the point-spread function (PSF) of the optical system. By assuming the phase aberration is small, the relation between aberration and PSF measurements can be approximated by a quadratic function. As such, our method is a blind identification method for linear dynamics in a stochastic Wiener system with a quadratic nonlinearity at the output and a phase retrieval method that uses a time-evolution-model constraint and a single image at every time step. (c) 2019 Optical Society of America.

In this paper, a robotic arm moving along a user-defined trajectory is used to calibrate a short-range magnetic positioning system (MPS). Such system estimates the position and attitude of an active transmitting coil by measuring the induced voltage on a set of fixed receiving coils, with known position and orientation. This estimate is obtained by solving an optimization problem that can be decomposed into a linear and a reduced nonlinear problem. Then, a Kalman Filter is used to process the estimated positions and obtain smooth trajectories. Data acquisition and processing are performed in real time by the MPS. In this context, the robotic arm is used to provide ground truth, i.e., to move the active coil along a known trajectory, while simultaneously the MPS estimates the position of the active coil. Such ground-truth information is then used to calibrate the MPS and improve its accuracy. To align the robotic arm with the MPS, a preliminary calibration procedure of the robot is performed. Then, a wide ground-truth trajectory is used to estimate the calibration parameters of the MPS itself, namely, the positions and orientation of the fixed coils. To validate the efficiency of the calibration procedure, the accuracy of the MPS is evaluated across several trajectories. The results show that the mean positioning error is less than 3 mm. Finally, an on-the-fly calibration method simultaneously estimating positions and attitudes of both the active coil and all the receivers is investigated.

Auditory attention identification methods attempt to identify the sound source of a listeners interest by analyzing measurements of electrophysiological data. We present a tutorial on the numerous techniques that have been developed in recent decades, and we present an overview of current trends in multivariate correlation-based and model-based learning frameworks. The focus is on the use of linear relations between electrophysiological and audio data. The way in which these relations are computed differs. For example, canonical correlation analysis (CCA) finds a linear subset of electrophysiological data that best correlates to audio data and a similar subset of audio data that best correlates to electrophysiological data. Model-based (encoding and decoding) approaches focus on either of these two sets. We investigate the similarities and differences between these linear model philosophies. We focus on (1) correlation-based approaches (CCA), (2) encoding/decoding models based on dense estimation, and (3) (adaptive) encoding/decoding models based on sparse estimation. The specific focus is on sparsity-driven adaptive encoding models and comparing the methodology in state-of-the-art models found in the auditory literature. Furthermore, we outline the main signal processing pipeline for how to identify the attended sound source in a cocktail party environment from the raw electrophysiological data with all the necessary steps, complemented with the necessary MATLAB code and the relevant references for each step. Our main aim is to compare the methodology of the available methods, and provide numerical illustrations to some of them to get a feeling for their potential. A thorough performance comparison is outside the scope of this tutorial.

Complex eukaryotic promoters normally contain multiple cis-regulatory sequences for different transcription factors (TFs). The binding patterns of the TFs to these sites, as well as the way the TFs interact with each other and with the RNA polymerase (RNAp), lead to combinatorial problems rarely understood in detail, especially under varying epigenetic conditions. The aim of this paper is to build a model describing how the main regulatory cluster of the olfactory receptor Or59b drives transcription of this gene in Drosophila. The cluster-driven expression of this gene is represented as the equilibrium probability of RNAp being bound to the promoter region, using a statistical thermodynamic approach. The RNAp equilibrium probability is computed in terms of the occupancy probabilities of the single TFs of the cluster to the corresponding binding sites, and of the interaction rules among TFs and RNAp, using experimental data of Or59b expression to tune the model parameters. The model reproduces correctly the changes in RNAp binding probability induced by various mutation of specific sites and epigenetic modifications. Some of its predictions have also been validated in novel experiments.

Recently, the measurement of the pupil dilation response has been applied in many studies to assess listening effort. Meanwhile, the mechanisms underlying this response are still largely unknown. We present the results of a method that separates the influence of the parasympathetic and sympathetic branches of the autonomic nervous system on the pupil response during speech perception. This is achieved by changing the background illumination level. In darkness, the influence of the parasympathetic nervous system on the pupil response is minimal, whereas in light, there is an additional component from the parasympathetic nervous system. Nineteen hearing-impaired and 27 age-matched normal-hearing listeners performed speech reception threshold tests targeting a 50% correct performance level while pupil responses were recorded. The target speech was masked with a competing talker. The test was conducted twice, once in dark and once in a light condition. Need for Recovery and Checklist Individual Strength questionnaires were acquired as indices of daily-life fatigue. In dark, the peak pupil dilation (PPD) did not differ between the two groups, but in light, the normal-hearing group showed a larger PPD than the hearing-impaired group. Listeners with better hearing acuity showed larger differences in dilation between dark and light. These results indicate a larger effect of parasympathetic inhibition on the pupil dilation response of listeners with better hearing acuity, and a relatively high parasympathetic activity in those with worse hearing. Previously observed differences in PPD between normal and impaired listeners are probably not solely because of differences in listening effort.

Electrophysiological feedback on activity in the auditory pathway may potentially advance the next generation of hearing aids. Conventional electroencephalographic (EEG) systems are, however, impractical during daily life and incompatible with hearing aids. Ear-EEG is a method in which the EEG is recorded from electrodes embedded in a hearing aid like earpiece. The method therefore provides an unobtrusive way of measuring neural activity suitable for use in everyday life. This study aimed to determine whether ear-EEG could be used to estimate hearing thresholds in subjects with sensorineural hearing loss. Specifically, ear-EEG was used to determine physiological thresholds at 0.5, 1, 2, and 4 kHz using auditory steady-state response measurements. To evaluate ear-EEG in relation to current methods, thresholds were estimated from a concurrently recorded conventional scalp EEG. The threshold detection rate for ear-EEG was 20% lower than the detection rate for scalp EEG. Thresholds estimated using in-ear referenced ear-EEG were found to be elevated at an average of 5.9, 2.3, 5.6, and 1.5 dB relative to scalp thresholds at 0.5, 1, 2, and 4 kHz, respectively. No differences were found in the variance of means between in-ear ear-EEG and scalp EEG. In-ear ear-EEG, auditory steady-state response thresholds were found at 12.1 to 14.4 dB sensation level with an intersubject variation comparable to that of behavioral thresholds. Collectively, it is concluded that although further refinement of the method is needed to optimize the threshold detection rate, ear-EEG is a feasible method for hearing threshold level estimation in subjects with sensorineural hearing impairment.

Input design is an important issue for classical system identification methods but has not been investigated for the kernel-based regularization method (KRM) until very recently. In this paper, we consider the input design problem of KRMs for LTI system identification. Different from the recent result, we adopt a Bayesian perspective and in particular make use of scalar measures (e.g., the A-optimality, D-optimality, and E-optimality) of the Bayesian mean square error matrix as the design criteria subject to power-constraint on the input. Instead of solving the optimization problem directly, we propose a two-step procedure. In the first step, by making suitable assumptions on the unknown input, we construct a quadratic map (transformation) of the input such that the transformed input design problems are convex, and the global minima of the transformed input design problem can thus be found efficiently by applying well-developed convex optimization software packages. In the second step, we derive the characterization of the optimal input based on the global minima found in the first step by solving the inverse image of the quadratic map. In addition, we derive analytic results for some special types of kernels, which provide insights on the input design and also its dependence on the kernel structure. (C) 2018 Elsevier Ltd. All rights reserved.

In this paper. we develop new methods to automatically detect the onset and duration of freezing of gait (FOG) in people with Parkinson disease (PD) in real time, using inertial sensors. We first build a physical model that describes the trembling motion during the FOG events. Then, we design a generalized likelihood ratio test framework to develop a two-stage detector for determining the zero-velocity and trembling events during gait. Thereafter, to filter out falsely detected FOG events, we develop a point-process filter that combines the output of the detectors with information about the speed of the foot, provided by a foot-mounted inertial navigation system. We computed the probability of FOG by using the point-process filter to determine the onset and duration of the FOG event. Finally, we validate the performance of the proposed system design using real data obtained from people with PD who performed a set of gait tasks. We compare our FOG detection results with an existing method that only uses accelerometer data. The results indicate that our method yields 81.03% accuracy in detecting FOG events and a threefold decrease in the false-alarm rate relative to the existing method.

This work investigates the energy consumption of industrial robots in the context of automotive industry. The purpose is to identify the most influencing parameters and variables and to propose best practices with focus on energy efficiency. The analysis approach is composed of three experiments performed in a simulation environment that test different values of programming parameters and variables, such as joint speed, acceleration, robot payload. The first experiment focuses on energy consumption of robots at standstill. The second one considers the robot moving along different paths. Finally, the third one analyses how the joint friction is affected by load, speed and temperature and how it influences the energy consumption. Results show that at standstill, it is important to reduce dwell time, select an energy efficient position and reduce the programmed value of the timer responsible for turning off the servomotors. While moving, it is important to select maximum continuous termination for intermediate points and avoid low speeds. Regarding friction variation, results show that at high motor speed, low temperatures increase energy consumption. In order to evaluate the contribution of the best practices in a real environment, they are applied to a welding robotic cell of an automotive industry.

Model predictive control (MPC) represents nowadays one of the main methods employed for process control in industry. Its strong suits comprise a simple algorithm based on a straightforward formulation and the flexibility to deal with constraints. On the other hand, it can be questioned its robustness regarding model uncertainties and external noises. Thus, a lot of efforts have been spent in the past years into the search of methods to address these shortcomings. In this study, the authors propose a robust MPC controller which stems from the idea of adding robustness in the prediction phase of the algorithm while leaving the core of MPC untouched. More precisely, they consider a robust Kalman filter that has been recently introduced and they further extend its usability to feedback control systems. Overall the proposed control algorithm allows to maintain all of the advantages of MPC with an additional improvement in performance and without any drawbacks in terms of computational complexity. To test the actual reliability of the algorithm, they apply it to control a servomechanism system characterised by non-linear dynamics.

The aim of this paper is to modify continuous-time bounded confidence opinion dynamics models so that "changes of opinion" (intended as changes of the sign of the initial states) are never induced during the evolution. Such sign invariance can be achieved by letting opinions of different sign localized near the origin interact negatively, or neglect each other, or even repel each other. In all cases, it is possible to obtain sign-preserving bounded confidence models with state-dependent connectivity and with a clustering behavior similar to that of a standard bounded confidence model. (C) 2018 Elsevier Ltd. All rights reserved.

Sleep scoring is used as a diagnostic technique in the diagnosis and treatment of sleep disorders. Automated sleep scoring is crucial, since the large volume of data should be analyzed visually by the sleep specialists which is burdensome, time-consuming tedious, subjective, and error prone. Therefore, automated sleep stage classification is a crucial step in sleep research and sleep disorder diagnosis. In this paper, a robust system, consisting of three modules, is proposed for automated classification of sleep stages from the single-channel electroencephalogram (EEG). In the first module, signals taken from Pz-Oz electrode were denoised using multiscale principal component analysis. In the second module, the most informative features are extracted using discrete wavelet transform (DWT), and then, statistical values of DWT subbands are calculated. In the third module, extracted features were fed into an ensemble classifier, which can be called as rotational support vector machine (RotSVM). The proposed classifier combines advantages of the principal component analysis and SVM to improve classification performances of the traditional SVM. The sensitivity and accuracy values across all subjects were 84.46% and 91.1%, respectively, for the five-stage sleep classification with Cohens kappa coefficient of 0.88. Obtained classification performance results indicate that, it is possible to have an efficient sleep monitoring system with a single-channel EEG, and can be used effectively in medical and home-care applications.

Distributed algorithms for solving coupled semidefinite programs commonly require many iterations to converge. They also put high computational demand on the computational agents. In this paper, we show that in case the coupled problem has an inherent tree structure, it is possible to devise an efficient distributed algorithm for solving such problems. The proposed algorithm relies on predictor- corrector primal-dual interior-point methods, where we use a message-passing algorithm to compute the search directions distributedly. Message passing here is closely related to dynamic programming over trees. This allows us to compute the exact search directions in a finite number of steps. This is because computing the search directions requires a recursion over the tree structure and, hence, terminates after an upward and downward pass through the tree. Furthermore, this number can be computed a priori and only depends on the coupling structure of the problem. We use the proposed algorithm for analyzing robustness of large-scale uncertain systems distributedly. We test the performance of this algorithm using numerical examples.

The commercial interest in proximity services is increasing. Application examples include location-based information and advertisements, logistics, social networking, file sharing, etc. In this paper, we consider positioning of devices based on a time series of proximity reports from a mobile device to a network node. This corresponds to nonlinear measurements with respect to the device position in relation to the network nodes. Motion model will be needed together with the measurements to determine the position of the device. Therefore, sequential Monte Carlo methods, namely particle filtering and smoothing, are applicable for positioning. Positioning performance is evaluated in a typical office area with Bluetooth-low-energy beacons deployed for proximity detection and report, and is further compared to parametric Cramér-Rao lower bounds. Finally, the position accuracy is also evaluated with real experimental data.

Identification of structured state-space (gray-box) model is popular for modeling physical and network systems. Due to the non-convex nature of the gray-box identification problem, good initial parameter estimates are crucial for successful applications. In this paper, the non-convex gray-box identification problem is reformulated as a structured low-rank matrix factorization problem by exploiting the rank and structured properties of a block Hankel matrix constructed by the system impulse response. To address the low-rank optimization problem, it is first transformed into a difference-of-convex (DC) formulation and then solved using the sequentially convex relaxation method. Compared with the classical gray-box identification methods like the prediction-error method (PEM), the new approach turns out to be more robust against converging to non-global minima, as supported by a simulation study. The developed identification can either be directly used for gray-box identification or provide an initial parameter estimate for the PEM. (C) 2018 Elsevier Ltd. All rights reserved.

The aim of this paper is to shed light on the problem of controlling a complex network with minimal control energy. We show first that the control energy depends on the time constant of the modes of the network, and that the closer the eigenvalues are to the imaginary axis of the complex plane, the less energy is required for complete controllability. In the limit case of networks having all purely imaginary eigenvalues (e.g. networks of coupled harmonic oscillators), several constructive algorithms for minimum control energy driver node selection are developed. A general heuristic principle valid for any directed network is also proposed: the overall cost of controlling a network is reduced when the controls are concentrated on the nodes with highest ratio of weighted outdegree vs indegree.

In Model Predictive Control (MPC), the control input is computed by solving a constrained finite-time optimal control (CFTOC) problem at each sample in the control loop. The main computational effort when solving the CFTOC problem using an active-set (AS) method is often spent on computing the search directions, which in MPC corresponds to solving unconstrained finite-time optimal control (UFTOC) problems. This is commonly performed using Riccati recursions or generic sparsity exploiting algorithms. In this work the focus is efficient search direction computations for AS type methods. The system of equations to be solved at each AS iteration is changed only by a low-rank modification of the previous one, and exploiting this structured change is important for the performance of AS type solvers. In this paper, theory for how to exploit these low-rank changes by modifying the Riccati factorization between AS iterations in a structured way is presented. A numerical evaluation of the proposed algorithm shows that the computation time can be significantly reduced by modifying, instead of re-computing, the Riccati factorization. This speed-up can be important for AS type solvers used for linear, nonlinear and hybrid MPC.

Merge scenarios confront drivers with some of the most complicated driving maneuvers in every day driving, requiring anticipatory reasoning of positions of other vehicles, and the own vehicles future trajectory. In congested traffic it might be impossible to merge without cooperation of up-stream vehicles, therefore, it is essential to gauge the effect of our own trajectory when planning a merge maneuver. For an autonomous vehicle to perform a merge maneuver in congested traffic similar capabilities are required. This includes a model describing the future evolution of the scene that allows for optimizing the autonomous vehicle's planned trajectory with respect to risk, comfort, and dynamical limitations. We present a probabilistic model that explicitly models interaction between vehicles and allows for evaluating the utility of a large number of candidate trajectories of an autonomous vehicle using a receding horizon approach in order to select an appropriate merge maneuver. The model is an extension of the intelligent driver model and the modeled behavior of other vehicles are adjusted using on-line model parameter estimation in order to give better predictions. The prediction model is evaluated using naturalistic traffic data and the merge maneuver planner is evaluated in simulation.

State-space smoothing has found many applications in science and engineering. Under linear and Gaussian assumptions, smoothed estimates can be obtained using efficient recursions, for example Rauch Tung Striebel and Mayne Fraser algorithms. Such schemes are equivalent to linear algebraic techniques that minimize a convex quadratic objective function with structure induced by the dynamic model. These classical formulations fall short in many important circumstances. For instance, smoothers obtained using quadratic penalties can fail when outliers are present in the data, and cannot track impulsive inputs and abrupt state changes. Motivated by these shortcomings, generalized Kalman smoothing formulations have been proposed in the last few years, replacing quadratic models with more suitable, often nonsmooth, convex functions. In contrast to classical models, these general estimators require use of iterated algorithms, and these have received increased attention from control, signal processing, machine learning, and optimization communities. In this survey we show that the optimization viewpoint provides the control and signal processing community great freedom in the development of novel modeling and inference frameworks for dynamical systems. We discuss general statistical models for dynamic systems, making full use of nonsmooth convex penalties and constraints, and providing links to important models in signal processing and machine learning. We also survey optimization techniques for these formulations, paying close attention to dynamic problem structure. Modeling concepts and algorithms are illustrated with numerical examples. (C) 2017 Elsevier Ltd. All rights reserved.

Predicting the sign of press perturbation responses in ecological networks is challenging, due to the poor knowledge of the strength of the direct interactions among the species, and to the entangled coexistence of direct and indirect effects. We show in this paper that, for a class of networks that includes mutualistic and monotone networks, the sign of press perturbation responses can be qualitatively determined based only on the sign pattern of the community matrix, without any knowledge of parameter values. For other classes of networks, we show that a semi-qualitative approach yields sufficient conditions for community matrices with a given sign pattern to exhibit mutualistic responses to press perturbations; quantitative conditions can be provided as well for community matrices that are eventually nonnegative. We also present a computational test that can be applied to any class of networks so as to check whether the sign of the responses to press perturbations is constant in spite of parameter variations.

n/a

In this paper, we study the problem of controlling complex networks with unilateral controls, i.e., controls which can assume only positive or negative values, not both. Given a complex network represented by the adjacency matrix A, an algorithm is developed that constructs an input matrix B such that the resulting system (A, B) is controllable with a near minimal number of unilateral control inputs. This is made possible by a reformulation of classical conditions for controllability that casts the minimal unilateral input selection problem into well known optimization problems. We identify network properties that make unilateral controllability relatively easy to achieve as compared to unrestricted controllability. The analysis of the network topology for instance allows us to establish theoretical bounds on the minimal number of controls required. For various categories of random networks as well as for a number of real-world networks these lower bounds are often achieved by our heuristics.

We propose a novel class of Sequential Monte Carlo (SMC) algorithms, appropriate for inference in probabilistic graphical models. This class of algorithms adopts a divide-and-conquer approach based upon an auxiliary tree-structured decomposition of the model of interest, turning the overall inferential task into a collection of recursively solved subproblems. The proposed method is applicable to a broad class of probabilistic graphical models, including models with loops. Unlike a standard SMC sampler, the proposed divide-and-conquer SMC employs multiple independent populations of weighted particles, which are resampled, merged, and propagated as the method progresses. We illustrate empirically that this approach can outperform standard methods in terms of the accuracy of the posterior expectation and marginal likelihood approximations. Divide-and-conquer SMC also opens up novel parallel implementation options and the possibility of concentrating the computational effort on the most challenging subproblems. We demonstrate its performance on a Markov random field and on a hierarchical logistic regression problem. Supplementary materials including proofs and additional numerical results are available online.

A platform for sensor fusion consisting of a standard smartphone equipped with the specially developed Sensor Fusion appis presented. The platform enables real-time streaming of data over WiFi to a computer where signal processingalgorithms, e.g., the Kalman filter, can be developed and executed in a Matlab framework. The platform is an excellenttool for educational purposes and enables learning activities where methods based on advanced theory can be implementedand evaluated at low cost. The article describes the app and a laboratory exercise developed around these new technologicalpossibilities. The laboratory session is part of a course in sensor fusion, a signal processing continuation course focused onmultiple sensor signal applications, where the goal is to give the students hands on experience of the subject. This is done byestimating the orientation of the smartphone, which can be easily visualized and also compared to the built-in filters in thesmartphone. The filter can accept any combination of sensor data from accelerometers, gyroscopes, and magnetometers toexemplify their importance. This way different tunings and tricks of important methods are easily demonstrated andevaluated on-line. The presented framework facilitates this in a way previously impossible.

Bayesian nonparametric approaches have been recently introduced in system identification scenario where the impulse response is modeled as the realization of a zero-mean Gaussian process whose covariance (kernel) has to be estimated from data. In this scheme, quality of the estimates crucially depends on the parametrization of the covariance of the Gaussian process. A family of kernels that have been shown to be particularly effective in the system identification framework is the family of Diagonal/Correlated (DC) kernels. Maximum entropy properties of a related family of kernels, the Tuned/Correlated (TC) kernels, have been recently pointed out in the literature. In this technical note, we show that maximum entropy properties indeed extend to the whole family of DC kernels. The maximum entropy interpretation can be exploited in conjunction with results on matrix completion problems in the graphical models literature to shed light on the structure of the DC kernel. In particular, we prove that the DC kernel admits a closed-form factorization, inverse, and determinant. These results can be exploited both to improve the numerical stability and to reduce the computational complexity associated with the computation of the DC estimator.

In this paper the main goal is to compare the instrumental variables and the least squares methods applied to parameter estimation in continuous-time systems, avoiding any preliminary discretization of the process, and to analyse which method is more suitable for estimation in continuous-time under stochastic perturbations. A numerical example illustrates the effectiveness of the algorithms.

n/a

The general Simultaneous Localisation and Mapping (SLAM) problem aims at estimating the state of a moving platform simultaneously with building a map of the local environment. There are essentially three classes of algorithms. EKF- SLAM and FastSLAM solve the problem on-line, while Nonlinear Least Squares (NLS) is a batch method. All of them scales badly with either the state dimension, the map dimension or the batch length. We investigate the EM algorithm for solving a generalized version of the NLS problem. This EM-SLAM algorithm solves two simpler problems iteratively, hence it scales much better with dimensions. The iterations switch between state estimation, where we propose an Extended Rauch-Tung-Striebel smoother, and map estimation, where a quasi-Newton method is suggested. The proposed method is evaluated in real experiments and also in simulations on a platform with a monocular camera attached to an inertial measurement unit. It is demonstrated to produce lower RMSE than with a standard Levenberg-Marquardt solver of NLS problem, at a computational cost that increases considerably slower. 

This paper reviews the vast literature on static output feedback design for linear time-invariant systems including classical results and recent developments. In particular, we focus on static output feedback synthesis with performance specifications, structured static output feedback, and robustness. The paper provides a comprehensive review on existing design approaches including iterative linear matrix inequalities heuristics, linear matrix inequalities with rank constraints, methods with decoupled Lyapunov matrices, and non-Lyapunov-based approaches. We describe the main difficulties of dealing with static output feedback design and summarize the main features, advantages, and limitations of existing design methods. (C) 2016 International Federation of Automatic Control. Published by Elsevier Ltd. All rights reserved.

Todays 4G LTE systems bring unprecedented mobile broadband performance to over a billion of users across the globe. Recently, work on a 5G mobile communication system has begun, and next to a new 5G air interface, LTE will be an essential component. The evolution of LTE will therefore strive to meet 5G requirements and to address 5G use cases. In this article, we provide an overview of foreseen key technology areas and components for LTE Release 14, including latency reductions, enhancements for machine-type communication, operation in unlicensed spectrum, massive multi-antenna systems, broadcasting, positioning, and support for intelligent transportation systems.

The identification of multivariable state space models in innovation form is solved in a subspace identification framework using convex nuclear norm optimization. The convex optimization approach allows to include constraints on the unknown matrices in the data-equation characterizing subspace identification methods, such as the lower triangular block-Toeplitz of weighting matrices constructed from the Markov parameters of the unknown observer. The classical use of instrumental variables to remove the influence of the innovation term on the data equation in subspace identification is avoided. The avoidance of the instrumental variable projection step has the potential to improve the accuracy of the estimated model predictions, especially for short data length sequences. (C) 2016 Elsevier Ltd. All rights reserved.

This paper presents a data-driven receding horizon fault estimation method for additive actuator and sensor faults in unknown linear time-invariant systems, with enhanced robustness to stochastic identification errors. State-of-the-art methods construct fault estimators with identified state-space models or Markov parameters, without compensating for identification errors. Motivated by this limitation, we first propose a receding horizon fault estimator parameterized by predictor Markov parameters. This estimator provides (asymptotically) unbiased fault estimates as long as the subsystem from faults to outputs has no unstable transmission zeros. When the identified Markov parameters are used to construct the above fault estimator, stochastic identification errors appear as model uncertainty multiplied with unknown fault signals and online system inputs/outputs (I/O). Based on this fault estimation error analysis, we formulate a mixed-norm problem for the offline robust design that regards online I/O data as unknown. An alternative online mixed-norm problem is also proposed that can further reduce estimation errors at the cost of increased computational burden. Based on a geometrical interpretation of the two proposed mixed-norm problems, systematic methods to tune the user-defined parameters therein are given to achieve desired performance trade-offs. Simulation examples illustrate the benefits of our proposed methods compared to recent literature. (C) 2016 Elsevier Ltd. All rights reserved.

Nonlinear Kalman filters are algorithms that approximately solve the Bayesian filtering problem by employing the measurement update of the linear Kalman filter (KF). Numerous variants have been developed over the past decades, perhaps most importantly the popular sampling based sigma point Kalman filters.In order to make the vast literature accessible, we present nonlinear KF variants in a common framework that highlights the computation of mean values and covariance matrices as the main challenge. The way in which these moment integrals are approximated distinguishes, for example, the unscented KF from the divided difference KF.With the KF framework in mind, a moment computation problem is defined and analyzed. It is shown how structural properties can be exploited to simplify its solution. Established moment computation methods, and their basics and extensions, are discussed in an extensive survey. The focus is on the sampling based rules that are used in sigma point KF. More specifically, we present three categories of methods that use sigma-points 1) to represent a distribution (as in the UKF); 2) for numerical integration (as in Gauss-Hermite quadrature); 3) to approximate nonlinear functions (as in interpolation). Prospective benefits and downsides are listed for each of the categories and methods, including accuracy statements. Furthermore, the related KF publications are listed.The theoretical discussion is complemented with a comparative simulation study on instructive examples.

In this study, Random Forests (RF) classifier is proposed for ECG heartbeat signal classification in diagnosis of heart arrhythmia. Discrete wavelet transform (DWT) is used to decompose ECG signals into different successive frequency bands. A set of different statistical features were extracted from the obtained frequency bands to denote the distribution of wavelet coefficients. This study shows that RF classifier achieves superior performances compared to other decision tree methods using 10-fold cross-validation for the ECG datasets and the obtained results suggest that further significant improvements in terms of classification accuracy can be accomplished by the proposed classification system. Accurate ECG signal classification is the major requirement for detection of all arrhythmia types. Performances of the proposed system have been evaluated on two different databases, namely MIT-BIH database and St. -Petersburg Institute of Cardiological Technics 12-lead Arrhythmia Database. For MIT-BIH database, RF classifier yielded an overall accuracy 99.33 % against 98.44 and 98.67 % for the C4.5 and CART classifiers, respectively. For St. -Petersburg Institute of Cardiological Technics 12-lead Arrhythmia Database, RF classifier yielded an overall accuracy 99.95 % against 99.80 % for both C4.5 and CART classifiers, respectively. The combined model with multiscale principal component analysis (MSPCA) de-noising, discrete wavelet transform (DWT) and RF classifier also achieves better performance with the area under the receiver operating characteristic (ROC) curve (AUC) and F- measure equal to 0.999 and 0.993 for MIT-BIH database and 1 and 0.999 for and St. Petersburg Institute of Cardiological Technics 12-lead Arrhythmia Database, respectively. Obtained results demonstrate that the proposed system has capacity for reliable classification of ECG signals, and to assist the clinicians for making an accurate diagnosis of cardiovascular disorders (CVDs).

The first order stable spline (SS-1) kernel (also known as the tunedcorrelated kernel) is used extensively in regularized system identification, where the impulse response is modeled as a zero-mean Gaussian process whose covariance function is given by well designed and tuned kernels. In this paper, we discuss the maximum entropy properties of this kernel. In particular, we formulate the exact maximum entropy problem solved by the SS-1 kernel without Gaussian and uniform sampling assumptions. Under general sampling assumption, we also derive the special structure of the SS-1 kernel (e.g. its tridiagonal inverse and factorization have closed form expression), also giving to it a maximum entropy covariance completion interpretation.

This note presents an efficient approach for the evaluation of multi-parametric mixed integer quadratic programming (mp-MIQP) solutions, occurring for instance in control problems involving discrete time hybrid systems with quadratic cost. Traditionally, the online evaluation requires a sequential comparison of piecewise quadratic value functions. We introduce a lifted parameter space in which the piecewise quadratic value functions become piecewise affine and can be merged to a single value function defined over a single polyhedral partition without any overlaps. This enables efficient point location approaches using a single binary search tree. Numerical experiments with a power electronics application demonstrate an online speedup up to an order of magnitude. We also show how the achievable online evaluation time can be traded off against the offline computational time.

Safety and security applications benefit from better situational awareness. Radar micro-Doppler signatures from an observed target carry information about the target's activity, and have potential to improve situational awareness. This article describes, compares, and discusses two methods to classify human activity based on radar micro-Doppler data. The first method extracts physically interpretable features from the time-velocity domain such as the main cycle time and properties of the envelope of the micro-Doppler spectra and use these in the classification. The second method derives its features based on the components with the most energy in the cadence-velocity domain (obtained as the Fourier transform of the time-velocity domain). Measurements from a field trial show that the two methods have similar activity classification performance. It is suggested that target base velocity and main limb cadence frequency are indirect features of both methods, and that they do often alone suffice to discriminate between the studied activities. This is corroborated by experiments with a reduced feature set. This opens up for designing new more compact feature sets. Moreover, weaknesses of the methods and the impact of non-radial motion are discussed.

Tracking human body motions using inertial sensors has become a well-accepted method in ambulatory applications since the subject is not confined to a lab-bounded volume. However, a major drawback is the inability to estimate relative body positions over time because inertial sensor information only allows position tracking through strapdown integration, but does not provide any information about relative positions. In addition, strapdown integration inherently results in drift of the estimated position over time. We propose a novel method in which a permanent magnet combined with 3-D magnetometers and 3-D inertial sensors are used to estimate the global trunk orientation and relative pose of the hand with respect to the trunk. An Extended Kalman Filter is presented to fuse estimates obtained from inertial sensors with magnetic updates such that the position and orientation between the human hand and trunk as well as the global trunk orientation can be estimated robustly. This has been demonstrated in multiple experiments in which various hand tasks were performed. The most complex task in which simultaneous movements of both trunk and hand were performed resulted in an average rms position difference with an optical reference system of 19.7 +/- 2.2 mm whereas the relative trunk-hand and global trunk orientation error was 2.3 +/- 0.9 and 8.6 +/- 8.7 deg respectively.

The particle Gibbs sampler is a systematic way of using a particle filter within Markov chain Monte Carlo. This results in an off-the-shelf Markov kernel on the space of state trajectories, which can be used to simulate from the full joint smoothing distribution for a state space model in a Markov chain Monte Carlo scheme. We show that the particle Gibbs Markov kernel is uniformly ergodic under rather general assumptions, which we will carefully review and discuss. In particular, we provide an explicit rate of convergence, which reveals that (i) for fixed number of data points, the convergence rate can be made arbitrarily good by increasing the number of particles and (ii) under general mixing assumptions, the convergence rate can be kept constant by increasing the number of particles superlinearly with the number of observations. We illustrate the applicability of our result by studying in detail a common stochastic volatility model with a non-compact state space.

In this paper, we propose using Gaussian processes to track an extended object or group of objects, that generates multiple measurements at each scan. The shape and the kinematics of the object are simultaneously estimated, and the shape is learned online via a Gaussian process. The proposed algorithm is capable of tracking different objects with different shapes within the same surveillance region. The shape of the object is expressed analytically, with well-defined confidence intervals, which can be used for gating and association. Furthermore, we use an efficient recursive implementation of the algorithm by deriving a state space model in which the Gaussian process regression problem is cast into a state estimation problem.

Filtering and smoothing algorithms for linear discrete-time state-space models with skewed and heavy-tailed measurement noise are presented. The algorithms use a variational Bayes approximation of the posterior distribution of models that have normal prior and skew-t-distributed measurement noise. The proposed filter and smoother are compared with conventional low-complexity alternatives in a simulated pseudorange positioning scenario. In the simulations the proposed methods achieve better accuracy than the alternative methods, the computational complexity of the filter being roughly 5 to 10 times that of the Kalman filter.

Today, the workflows that are involved in industrial assembly and production activities are becoming increasingly complex. To efficiently and safely perform these workflows is demanding on the workers, in particular when it comes to infrequent or repetitive tasks. This burden on the workers can be eased by introducing smart assistance systems. This article presents a scalable concept and an integrated system demonstrator designed for this purpose. The basic idea is to learn workflows from observing multiple expert operators and then transfer the learnt workflow models to novice users. Being entirely learning-based, the proposed system can be applied to various tasks and domains. The above idea has been realized in a prototype, which combines components pushing the state of the art of hardware and software designed with interoperability in mind. The emphasis of this article is on the algorithms developed for the prototype: 1) fusion of inertial and visual sensor information from an on-body sensor network (BSN) to robustly track the user’s pose in magnetically polluted environments; 2) learning-based computer vision algorithms to map the workspace, localize the sensor with respect to the workspace and capture objects, even as they are carried; 3) domain-independent and robust workflow recovery and monitoring algorithms based on spatiotemporal pairwise relations deduced from object and user movement with respect to the scene; and 4) context-sensitive augmented reality (AR) user feedback using a head-mounted display (HMD). A distinguishing key feature of the developed algorithms is that they all operate solely on data from the on-body sensor network and that no external instrumentation is needed. The feasibility of the chosen approach for the complete action-perception-feedback loop is demonstrated on three increasingly complex datasets representing manual industrial tasks. These limited size datasets indicate and highlight the potential of the chosen technology as a combined entity as well as point out limitations of the system.

We study cooperative sensor network localization in a realistic scenario where 1) the underlying measurement errors more probably follow a non-Gaussian distribution; 2) the measurement error distribution is unknown without conducting massive offline calibrations; and 3) non-line-of-sight identification is not performed due to the complexity constraint and/or storage limitation. The underlying measurement error distribution is approximated parametrically by a Gaussian mixture with finite number of components, and the expectation-conditional maximization (ECM) criterion is adopted to approximate the maximum-likelihood estimator of the unknown sensor positions and an extra set of Gaussian mixture model parameters. The resulting centralized ECM algorithms lead to easier inference tasks and meanwhile retain several convergence properties with a proof of the "space filling" condition. To meet the scalability requirement, we further develop two distributed ECM algorithms where an average consensus algorithm plays an important role for updating the Gaussian mixture model parameters locally. The proposed algorithms are analyzed systematically in terms of computational complexity and communication overhead. Various computer based tests are also conducted with both simulation and experimental data. The results pin down that the proposed distributed algorithms can provide overall good performance for the assumed scenario even under model mismatch, while the existing competing algorithms either cannot work without the prior knowledge of the measurement error statistics or merely provide degraded localization performance when the measurement error is clearly non-Gaussian.

For communities of agents which are not necessarily cooperating, distributed processes of opinion forming are naturally represented by signed graphs, with positive edges representing friendly and cooperative interactions and negative edges the corresponding antagonistic counterpart. Unlike for nonnegative graphs, the outcome of a dynamical system evolving on a signed graph is not obvious and it is in general difficult to characterize, even when the dynamics are linear. In this paper, we identify a significant class of signed graphs for which the linear dynamics are however predictable and show many analogies with positive dynamical systems. These cases correspond to adjacency matrices that are eventually positive, for which the Perron-Frobenius property still holds and implies the existence of an invariant cone contained inside the positive orthant. As examples of applications, we determine cases in which it is possible to anticipate or impose unanimity of opinion in decision/voting processes even in presence of stubborn agents, and show how it is possible to extend the PageRank algorithm to include negative links.

In optimization algorithms used for on-line Model Predictive Control (MPC), linear systems of equations are often solved in each iteration. This is true both for Active Set methods as well as for Interior Point methods, and for linear MPC as well as for nonlinear MPC and hybrid MPC. The main computational effort is spent while solving these linear systems of equations, and hence, it is of greatest interest to solve them efficiently. Classically, the optimization problem has been formulated in either of two ways. One leading to a sparse linear system of equations involving relatively many variables to compute in each iteration and another one leading to a dense linear system of equations involving relatively few variables. In this work, it is shown that it is possible not only to consider these two distinct choices of formulations. Instead it is shown that it is possible to create an entire family of formulations with different levels of sparsity and number of variables, and that this extra degree of freedom can be exploited to obtain even better performance with the software and hardware at hand. This result also provides a better answer to a recurring question in MPC; should the sparse or dense formulation be used.

This paper addresses one of the main challenges in physical activity monitoring, as indicated by recent benchmark results: The difficulty of the complex classification problems exceeds the potential of existing classifiers. Therefore, this paper proposes the ConfAdaBoost.M1 algorithm. This algorithm is a variant of the AdaBoost.M1 that incorporates well-established ideas for confidence-based boosting. ConfAdaBoost.M1 is compared to the most commonly used boosting methods using benchmark datasets from the UCI machine learning repository.  Moreover, it is evaluated on an activity recognition and an intensity estimation problem, including a large number of physical activities from the recently released PAMAP2 dataset. The presented results indicate that the proposed ConfAdaBoost.M1 algorithm significantly improves the classification performance on most of the evaluated datasets, especially for larger and more complex classification tasks. Finally, two empirical studies are designed and carried out to investigate the feasibility of ConfAdaBoost.M1 for physical activity monitoring applications in mobile systems.

Particle Metropolis-Hastings (PMH) allows for Bayesian parameter inference in nonlinear state space models by combining MCMC and particle filtering. The latter is used to estimate the intractable likelihood. In its original formulation, PMH makes use of a marginal MCMC proposal for the parameters, typically a Gaussian random walk. However, this can lead to a poor exploration of the parameter space and an inefficient use of the generated particles.

We propose two alternative versions of PMH that incorporate gradient and Hessian information about the posterior into the proposal. This information is more or less obtained as a byproduct of the likelihood estimation. Indeed, we show how to estimate the required information using a fixed-lag particle smoother, with a computational cost growing linearly in the number of particles. We conclude that the proposed methods can: (i) decrease the length of the burn-in phase, (ii) increase the mixing of the Markov chain at the stationary phase, and (iii) make the proposal distribution scale invariant which simplifies tuning.

A method for fusing Synthetic Aperture Radar (SAR) images with opticalaerial images is presented. This is done in a navigation framework, where the absolute position and orientation of the flying platform, as computed from the inertial navigation system, is corrected based on the aerial image coordinates taken as ground truth. The method is suitable for new low-price SAR systems for small unmanned vehicles. The primary application is remote sensing, where the SAR image provides one further "colour" channel revealing reflectivity to radio waves. The method is based on first applying an edge detection algorithm to the images and then optimising the most important navigation states by matching the two binary images. To get a measure of the estimation uncertainty, we embed the optimisation in a least squares framework, where an explicit method to estimate the (relative) size of the errors is presented. The performance is demonstrated on real SAR and aerial images, leading to an error of only a few pixels.

In this chapter we show that chordal structure can be used to devise efficient optimization methods for many common model predictive control problems. The chordal structure is used both for computing search directions efficiently as well as for distributing all the other computations in an interior-point method for solving the problem. The chordal structure can stem both from the sequential nature of the problem as well as from distributed formulations of the problem related to scenario trees or other formulations. The framework enables efficient parallel computations.

The discrete time general state-space model is a flexible framework to deal with the nonlinear and/or non-Gaussian time series problems. However, the associated (Bayesian) inference problems are often intractable. Additionally, for many applications of interest, the inference solutions are required to be recursive over time. The particle filter (PF) is a popular class of Monte Carlo based numerical methods to deal with such problems in real time. However, PF is known to be computationally expensive and does not scale well with the problem dimensions. If a part of the state space is analytically tractable conditioned on the remaining part, the Monte Carlo based estimation is then confined to a space of lower dimension, resulting in an estimation method known as the Rao-Blackwellized particle filter (RBPF).

In this chapter, we present a brief review of Rao-Blackwellized particle filtering. Especially, we outline a set of popular conditional tractable structures admitting such Rao-Blackwellization in practice. For some special and/or relatively new cases, we also provide reasonably detailed descriptions.We confine our presentation mostly to the practitioners’ point of view.

Scene reconstruction, i.e. the process of creating a 3D representation (mesh) of some real world scene, has recently become easier with the advent of cheap RGB-D sensors (e.g. the Microsoft Kinect).

Many such sensors use rolling shutter cameras, which produce geometrically distorted images when they are moving. To mitigate these rolling shutter distortions we propose a method that uses an attached gyroscope to rectify the depth scans.We also present a simple scheme to calibrate the relative pose and time synchronization between the gyro and a rolling shutter RGB-D sensor.

For scene reconstruction we use the Kinect Fusion algorithm to produce meshes. We create meshes from both raw and rectified depth scans, and these are then compared to a ground truth mesh. The types of motion we investigate are: pan, tilt and wobble (shaking) motions.

As our method relies on gyroscope readings, the amount of computations required is negligible compared to the cost of running Kinect Fusion.

This chapter is an extension of a paper at the IEEE Workshop on Robot Vision [10]. Compared to that paper, we have improved the rectification to also correct for lens distortion, and use a coarse-to-fine search to find the time shift more quicky.We have extended our experiments to also investigate the effects of lens distortion, and to use more accurate ground truth. The experiments demonstrate that correction of rolling shutter effects yields a larger improvement of the 3D model than correction for lens distortion.

An inference method for Gaussian process augmented state-space models are presented. This class of grey-box models enables domain knowledge to be incorporated in the inference process to guarantee a minimum of performance, still they are flexible enough to permit learning of partially unknown model dynamics and inputs. To facilitate online (recursive) inference of the model a sparse approximation of the Gaussian process based upon inducing points is presented. To illustrate the application of the model and the inference method, an example where it is used to track the position and learn the behavior of a set of cars passing through an intersection, is presented. Compared to the case when only the state-space model is used, the use of the augmented state-space model gives both a reduced estimation error and bias.

A wearable microphone array platform is used tolocalize stationary sound sources and amplify the sound inthe desired directions using several beamforming methods. Theplatform is equipped with inertial sensors and a magnetometerallowing predictions of source locations during orientationchanges and compensation for the displacement in the arrayconfiguration. The platform is modular, open and 3D printedto allow for easy reconfiguration of the array and for reuse inother applications, e.g., mobile robotics. The software componentsare based on open source. A new method for source localizationand signal reconstruction using Taylor expansion of the signals isproposed. This and various standard and non-standard Directionof Arrival (DOA) methods are evaluated in simulation andexperiments with the platform to track and reconstruct multipleand single sources. Results show that sound sources can belocalized and tracked robustly and accurately while rotating theplatform and that the proposed method outperforms standardmethods at reconstructing the signals.

Search-And-Rescue (SAR) is one of manyfields with applications benefiting from the increasingavailability of Unmanned Aerial Systems (UASs).  Most UAS applications rely on the UAS’s capabilityto carry a camera and stream video data for manualor automated processing. However, this relies onunobstructed views of the target, which limits the applicability of these systems.  In this paper, we instead describe the development and initial application testing of a system with a UAS-carried harmonic radar. This sensor is designed to detect the presence of Recco radar reflectors, commonly found integrated into alpine clothes and gear. The reflectors can be detected through vegetation and snow and is independent of many external factors such as lighting conditions. The paper describesthe system design and provides initial real-world results. The initial tests show fruitful results and opens up several avenues of continued research and development.

GNSS receivers are vulnerable to spoofing attacks, where false satellite signals are transmitted to trick the receiver to provide false position and/or time estimates. Novel algorithms are proposed for spoofing mitigation by exchanging double differences of pseudorange, or carrier phase, measurements between multiple GNSS receivers. In scenarios where the spoofing system utilizes a single transmit antenna, the pseudorange, and carrier phase, measurements that are associated with the spoofing signal can be detected and removed. Simulated meaconing attacks generated with a Spirent hardware simulator and measurements obtained with a modified version of GNSS-SDR are used to evaluate the proposed algorithms. Spoofing mitigation using pseudorange measurements is possible, for receivers that are separated at least five meters apart. With a receiver separation of 20 meters, the pseudorange double difference algorithm is able to correctly authenticate at least six of seven pseudoranges within 30 seconds. The carrier phase approach enables mitigation of spoofing signals at shorter receiver distances. However, this approach requires a more accurate time synchronization between the receivers.

In almost all parts of the world, breast cancer is one of the major causes of death among women. But at the same time, it is one of the most curable cancers if it is diagnosed at early stage. This paper tries to find a model that diagnose and classify breast cancer with high accuracy and help to both patients and doctors in the future. Here we develop a model using Normalized Multi Layer Perceptron Neural Network to classify breast cancer with high accuracy. The results achieved is very good (accuracy is 99.27%). It is very promising result compared to previous researches where Artificial Neural Networks were used. As benchmark test, Breast Cancer Wisconsin (Original) was used.

We propose a generalization of the popular nonlinear ARX model structure by treating its parameters as varying over time. The parameters are considered generated by linear filters operating on the models regressors. The filters are expressed as a sum of atoms that are either sum of damped exponentials and sinusoids, or sinusoids with time varying frequencies. This form allows us to enforce stability of the parameter evolution as well as leverage the atomic norm minimization framework for inducing sparsity. It also facilitates easy incorporation of smoothness related priors that that making it possible to treat these models as nonlinear extensions of the familiar LPV models. (C) 2019, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.

In urban environments, cellular network-based positioning of user equipment (UE) is a challenging task, especially in frequently occurring non-line-of-sight (NLOS) conditions. This paper investigates the use of two machine learning methods – neural networks and random forests – to estimate the position of UE in NLOS using best received reference signal beam power measurements. We evaluated the suggested positioning methods using data collected from a fifth-generation cellular network (5G) testbed provided by Ericsson. A statistical test to detect NLOS conditions with a probability of detection that is close to 90% is suggested. We show that knowledge of the antenna are crucial for accurate position estimation. In addition, our results show that even with a limited set of training data and one 5G transmission point, it is possible to position UE within 10 meters with 80% accuracy.

The CDIO Syllabus survey has successfully been applied to the Bachelor’s and Master’s programs in Experimental and Medical Biosciences, within the Faculty of Medicine and Health Sciences at Linköping University, Sweden. The programs are and have been, subject to considerable redesign with strong influence from the CDIO framework. One of the main drivers for the redesign is a shift concerning the main job market after graduation, from an academic career to industry and healthcare. One of the steps in the development process has been to carry out a Syllabus survey based on an adapted version of the CDIO Syllabus. The survey was sent out to students and to various categories of professionals, and in total 87 responses were received. The adapted version of the Syllabus and the design, execution, and outcome of the survey is presented.

The CDIO framework is an integrated and important part of the new quality assurance system within the Faculty of Science and Engineering at Linköping University. Both the CDIO Syllabus and the CDIO Standards are used extensively in the system. First, the paper presents the development and use of the second generation of course matrices (previously denoted ITU-matrices) and program matrices, which build upon an adapted and extended version of the CDIO Syllabus. The extension is made to also include bachelor’s and master’s program in subjects outside the engineering field. Second, the paper presents how the CDIO Standards are used in the quality reports, which are vital parts of the quality assurance systems. As a result, the CDIO framework is used for the design, management, and quality assurance of all education programs ( approximately 60 programs) within the Faculty of Science and Engineering at Linköping University.

In this paper, tightness relations (or inequalities) between Bayesian lower bounds (BLBs) on the mean-squared-error are derived which result from the marginalization of a joint probability density function (pdf) depending on both parameters of interest and extraneous or nuisance parameters. In particular,it is shown that for a large class of BLBs, the BLB derived from the marginal pdf is at least as tight as the corresponding BLB derived from the joint pdf. A Bayesian linear regression example is used to illustrate the tightness relations

This paper considers the problem of gathering information about features of interest in adversarial environments using mobile robots equipped with sensors. The problem is formulated as an informative path planning problem where the objective is to maximize the gathered information while minimizing the tracking performance of the adversarial observer. The optimization problem, that at first glance seems intractable to solve to global optimality, is shown to be equivalent to a mixed-integer semidefinite program that can be solved to global optimality using off-the-shelf optimization tools.

This paper addresses the problem of retrieving consistentestimates in a distributed network where the communication between the nodes is constrained such that only the diagonal elements of the covariance matrix are allowed to be exchanged. Several methods are developed for preserving and/or recovering consistency under the constraints imposed by the communication protocol. The proposed methods are used in conjunction with the covariance intersection method and the estimation performance is evaluated based on information usage and consistency. The results show that among the proposed methods, consistency can be preserved equally well at the transmitting node as at the receiving node.

This paper investigates the problem of controlling a complex network with reduced control energy. Two centrality measures are defined, one related to the energy that a control, placed on a node, can exert on the entire network, and the other related to the energy that the network exerts on a node. We show that by combining these two centrality measures conflicting control energy requirements, like minimizing the average energy needed to steer the state in any direction and the energy needed for the worst direction, can be simultaneously taken into account. From an algebraic point of view, the node ranking that we obtain from the combination of our centrality measures is related to the non-normality of the adjacency matrix of the graph.

This paper proposes a method to generate informative trajectories for a mobile sensor that tracks agile targets.The goal is to generate a sensor trajectory that maximizes the tracking performance, captured by a measure of the covariance matrix of the target state estimate. The considered problem is acombination of estimation and control, and is often referred to as informative path planning (IPP). When using nonlinear sensors, the tracking performance depends on the actual measurements, which are naturally unavailable in the planning stage.The planning problem hence becomes a stochastic optimization problem, where the expected tracking performance is used inthe objective function. The main contribution of this work is anapproximation of the problem based on deterministic sampling of the predicted target distribution. This is in contrast to prior work, where only the most likely target trajectory is considered.It is shown that the proposed method greatly improves the ability to track agile targets, compared to a baseline approach.   

The expectation-maximization algorithm is a commonly employed tool for system identification. However, for a large set of state-space models, the maximization step cannot be solved analytically. In these situations, a natural remedy is to make use of the expectation-maximization gradient algorithm, i.e., to replace the maximization step by a single iteration of Newtons method. We propose alternative expectation-maximization algorithms that replace the maximization step with a single iteration of some other well-known optimization method. These algorithms parallel the expectation-maximization gradient algorithm while relaxing the assumption of a concave objective function. The benefit of the proposed expectation-maximization algorithms is demonstrated with examples based on standard observation models in tracking and localization.

Today, thanks to the development of micro-scale low-cost accelerometers, gyroscopes, and magnetometers, it is possible to construct compact motion-sensor arrays with hundreds of sensing elements. These arrays, as well as providing a high performance-to-price ratio, can also provide new measurement capabilities and enable the development of smart sensors that adapt to the usage conditions. This paper gives an overview of the capabilities enabled by the stochastic, component, temporal, and spatial information diversity that an array of inertial or magnetic field sensors provide. The main challenges in the practical realization of these types of arrays are described.

Wireless power transfer technology provides a possible sustainable and cost-effective way to prolong indefinitely the lifetime of networks of smart devices needed in future Internet-of-Things, while equipping them with batteries of limited capacity. In this paper we show that the theory of compartmental systems, positive interconnected systems exchanging mass (here power) and ruled by mass conservation laws, provides a suitable framework to describe wireless power transfer networks. In particular we show that sustainability of the network of smart devices corresponds to each of them being alimented, directly or indirectly, by nodes having an external source of power, condition known as inflow connectivity in the compartmental systems literature. The framework allows to compute the topology which is optimal in terms of maximizing the overall efficiency of the power transfer.

Remotely piloted scaled models not only serve as convenient low-risk flying test-beds but also can provide useful data and increase confidence in an eventual full-scale design. Nevertheless, performing advanced flight tests in a safe and cost-effective manner is often a challenge for organizations with limited resources. A typical scenario is testing within visual line-of-sight at very low altitude, a type of operation that offers major cost advantages at the expense of a reduced available airspace. This paper describes some of the authors' work towards efficient performance evaluation and system identification of fixed-wing, remotely piloted aircraft under these challenging conditions. Results show that certain techniques, manoeuvre automation, and platform-optimised multisine input signals can improve the flight test efficiency and the modelling process. It is also probable that some of the benefits observed here could be extrapolated to flight testing beyond visual line-of-sight or even to full-scale flight testing.

This paper studies the asymptotic properties of the hyperparameter estimators including the leave-k-out cross validation (LKOCV) and r-fold cross validation (RFCV), and discloses their relation with the Steins unbiased risk estimators (SURE) as well as the mean squared error (MSE). It is shown that as the number of data goes to infinity, the LKOCV shares the same asymptotic best hyperparameter minimizing the MSE estimator as the SURE does if the input is bounded and the ratio between the training data and the whole data tends to zero. We illustrate the efficacy of the theoretical result by Monte Carlo simulations.

Many recent advances in large scale probabilistic inference rely on variational methods. The success of variational approaches depends on (i) formulating a flexible parametric family of distributions, and (ii) optimizing the parameters to find the member of this family that most closely approximates the exact posterior. In this paper we present a new approximating family of distributions, the variational sequential Monte Carlo (VSMC) family, and show how to optimize it in variational inference. VSMC melds variational inference (VI) and sequential Monte Carlo (SMC), providing practitioners with flexible, accurate, and powerful Bayesian inference. The VSMC family is a variational family that can approximate the posterior arbitrarily well, while still allowing for efficient optimization of its parameters. We demonstrate its utility on state space models, stochastic volatility models for financial data, and deep Markov models of brain neural circuits.

In order to guarantee that a self-driving vehicle is behaving as expected, stability of the closed-loop system needs to be rigorously analyzed. The key components for the lowest levels of control in self-driving vehicles are the controlled vehicle, the low-level controller and the local planner.The local planner that is considered in this work constructs a feasible trajectory by combining a finite number of precomputed motions. When this local planner is considered, we show that the closed-loop system can be modeled as a nonlinear hybrid system. Based on this, we propose a novel method for analyzing the behavior of the tracking error, how to design the low-level controller and how to potentially impose constraints on the local planner, in order to guarantee that the tracking error is bounded and decays towards zero. The proposed method is applied on a truck and trailer system and the results are illustrated in two simulation examples.

Regularization methods with regularization matrix in quadratic form have received increasing attention. For those methods, the design and tuning of the regularization matrix are two key issues that are closely related. For systems with complicated dynamics, it would be preferable that the designed regularization matrix can bring the hyper-parameter estimation problem certain structure such that a locally optimal solution can be found efficiently. An example of this idea is to use the so-called multiple kernel Chen et al. (2014) for kernel-based regularization methods. In this paper, we propose to use the multiple regularization matrix for the filter-based regularization. Interestingly, the marginal likelihood maximization with the multiple regularization matrix is also a difference of convex programming problem, and a locally optimal solution could be found with sequential convex optimization techniques. (C) 2018, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.

An estimated state-space model can possibly be improved by further iterations with estimation data. This contribution specifically studies if models obtained by subspace estimation can be improved by subsequent re-estimation of the B, C, and D matrices (which involves linear estimation problems). Several tests are performed, which show that it is generally advisable to do such further re-estimation steps using the maximum likelihood criterion. Stated more succinctly in terms of MATLABC (R) functions, ssest generally outperforms n4sid. (C) 2018, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.

In system identification, input selection is a challenging problem. Since less complex models are desireable, non-relevant inputs should be methodically and correctly discarded before or under the estimation process. In this paper we investigate an input selection extension in least-squares ARX estimation and show that better model estimates are achieved compared to the least-square ssolution, in particular, for short batches of estimation data. (C) 2018, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.

This paper describes an Arduino Due based platform for digital signal processing (DSP) education. The platform consists of an in-house developed shield for robust interfacing with analog audio signals and user inputs, and an off-the-shelf Arduino Due that executes the students DSP code. This combination enables direct use of the Arduino integrated development environment (IDE), with its low barrier to entry for students, its low maintenance need and cross platform interoperability, and its large user base. Relevant hardware and software features of the platform are discussed throughout, as are design choices made in relation to learning objectives, and the planned use of the platform in our own DSP course.

A key requirement of autonomous vehicles is the capability to safely navigate in their environment. However, outside of controlled environments, safe navigation is a very difficult problem. In particular, the real-world often contains both complex 3D structure, and dynamic obstacles such as people or other vehicles. Dynamic obstacles are particularly challenging, as a principled solution requires planning trajectories with regard to both vehicle dynamics, and the motion of the obstacles. Additionally, the real-time requirements imposed by obstacle motion, coupled with real-world computational limitations, make classical optimality and completeness guarantees difficult to satisfy. We present a unified optimization-based motion planning and control solution, that can navigate in the presence of both static and dynamic obstacles. By combining optimal and receding-horizon control, with temporal multi-resolution lattices, we can precompute optimal motion primitives, and allow real-time planning of physically-feasible trajectories in complex environments with dynamic obstacles. We demonstrate the framework by solving difficult indoor 3D quadcopter navigation scenarios, where it is necessary to plan in time. Including waiting on, and taking detours around, the motions of other people and quadcopters.

In this paper, recursive Bobrovsky-Zakai bounds for filtering, prediction and smoothing of nonlinear dynamic systems are presented. The similarities and differences to an existing Bobrovsky-Zakai bound in the literature for the filtering case are highlighted. The tightness of the derived bounds are illustrated on a simple example where a linear system with non-Gaussian measurement likelihood is considered. The proposed bounds are also compared with the performance of some well known filters/predictors/smoothers and other Bayesian bounds.

Feedback linearization is compared to Jacobian linearization for LQ control of atwo-link industrial manipulator. A method for obtaining equivalent nominal performance forboth control designs is introduced. An experimentally verified benchmark model with industrialrelevance is used for comparing the designs. Results do not show any conclusive advantages ofFeedback linearization.

A conceive-design project is presented. The project runs over the first two years of the engineering education programs at the Methodist University of São Paulo, and the paper focuses on the first semester of the Computer Engineering Program. The projects are carried out in teams of students from different programs and the results are presented to a board of faculty members and sometimes participants from our partner companies, at the end of each semester. There are around 200 students involved in total. For the first semester, students are required to conceive, design and document an environmentally-friendly product or service. The conceive-design project is integrated with surrounding modules is the curriculum, such as Entrepreneurship and Innovation and Economics, Society and Environmental Issues.

A general trajectory planner for optimal control problems is presented and applied to a robot system. The approach is based on timed elastic bands and nonlinear model predictive control. By exploiting the sparsity in the underlying optimization problems the computational effort can be significantly reduced, resulting in a real-time capable planner. In addition, a localization based switching strategy is employed to enforce convergence and stability. The planning procedure is illustrated in a robotics application using a realistic SCARA type robot.

A model-based method to perform odometry using an array of magnetometers that sense variations in a local magnetic field is presented. The method requires no prior knowledge of the magnetic field, nor does it compile any map of it. Assuming that the local variations in the  magnetic field can be described by a curl and divergence free polynomial model, a maximum likelihood estimator is derived. To gain insight into the array design criteria and the achievable estimation performance, the identifiability conditions of the estimation problem are analyzed and the Cramér-Rao bound for the one-dimensional case is derived. The analysis shows that with a second-order model it is sufficient to have six magnetometer triads in a plane to obtain local identifiability. Further, the Cramér-Rao bound shows that the estimation error is inversely proportional to the ratio between the rate of change of the magnetic field and the noise variance, as well as the length scale of the array. The performance of the proposed estimator is evaluated using real-world data. The results show that, when there are sufficient variations in the magnetic field, the estimation error is of the order of a few percent of the displacement. The method also outperforms current state-of-theart method for magnetic odometry

Variational inference using the reparameterization trick has enabled large-scale approximate Bayesian inference in complex probabilistic models, leveraging stochastic optimization to sidestep intractable expectations. The reparameterization trick is applicable when we can simulate a random variable by applying a differentiable deterministic function on an auxiliary random variable whose distribution is fixed. For many distributions of interest (such as the gamma or Dirichlet), simulation of random variables relies on acceptance-rejection sampling. The discontinuity introduced by the accept-reject step means that standard reparameterization tricks are not applicable. We propose a new method that lets us leverage reparameterization gradients even when variables are outputs of a acceptance-rejection sampling algorithm. Our approach enables reparameterization on a larger class of variational distributions. In several studies of real and synthetic data, we show that the variance of the estimator of the gradient is significantly lower than other state-of-the-art methods. This leads to faster convergence of stochastic gradient variational inference.

We present two approaches for using imaging sensors on-board small unmanned aerial systems (UAS) for positioning and navigation. Two types of sensors are used; laser scanners and a camera operating in the visual wavelengths. The laser scanners produce sparse 3D data that are registered to produce a local map. For the images from the video camera the optical flow and height estimates are fused and then matched with a geo-referenced aerial image. Both approaches include data from the inertial navigation system. The approaches can be used for accurate ego-positioning, and thus for navigation. The approaches are GPS independent and can work in GPS denied conditions, for example urban canyons, indoor environments, forest areas or while jammed. Applications are primarily within societal security and military defense.

Regularization of simple linear regression models for system identification is a recent much-studied problem. Several parameterizations ("kernels") of the regularization matrix have been suggested together with different ways of estimating ("tuning") its parameters. This contribution defines an asymptotic view on the problem of tuning and selection of kernels. It is shown that the SURE approach to parameter tuning provides an asymptotically consistent estimate of the optimal (in a MSE sense) hyperparameters. At the same time it is shown that the common marginal likelihood (empirical Bayes) approach does not enjoy that property. (C) 2017, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.

\This paper deals with the problem of controlling linear complex networks in an efficient way, i.e., with limited control energy. A general principle is provided, based on the eigenvalues of the network. It is shown numerically that the cost of controlling a network grows with the (absolute value of the) real part of the eigenvalues of the adjacency matrix. Constructive rules for driver node selection are also provided, based on the (weighted) topology of the network. In particular, we show that the key to have an energetically efficient driver node placement strategy is to use the skewness of the outdegree versus indegree distributions of the network, a topological property not associated before to controllability. (C) 2017, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.

The aim of this paper is to investigate the problem of selecting driver nodes enabling the control of a network with minimal control energy. The networks we are interested in are coupled harmonic oscillators, i.e., networks in which the eigenvalues are all purely imaginary. For them, several criteria for driver node selection are presented, based on the different measures of control energy considered in this context. The constructive algorithms we develop for these criteria are normally solving the problem in a heuristic way, although in one case the exact solution can be computed efficiently regardless of size. (C) 2017, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.

Input selection is an important and oftentimes difficult challenge in system identification. In order to achieve less complex models, irrelevant inputs should be methodically and correctly discarded before or under the estimation process. In this paper we introduce a novel method of input selection that is carried out as a natural extension in a subspace method. We show that the method robustly and accurately performs input selection at various noise levels and that it provides good model estimates. (C) 2017, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.

This paper addresses reconstruction of linear dynamic networks from heterogeneous datasets. Those datasets consist of measurements from linear dynamical systems in multiple experiments subjected to different experimental conditions, e.g., changes/perturbations in parameters, disturbance or noise. A main assumption is that the Boolean structures of the underlying networks are the same in all experiments. The ARMAX model is adopted to parameterize the general linear dynamic network representation "Dynamical Structure Function" (DSF), which provides the Granger Causality graph as a special case. The network identification is performed by integrating all available datasets and promote group sparsity to assure both network sparsity and the consistency of Boolean structures over datasets. In terms of solving the problem, a treatment by the iterative reweighted l(1) method is used, together with its implementations via proximal methods and ADMM for large-dimensional networks. (C) 2017, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.

In the consensus problem considered in this paper, each agent can impose a lower and an upper bound on the achievable consensus values. We show that if such state constraints are implemented by saturating the value transmitted to the neighboring nodes, the resulting constrained consensus problem must converge to the intersection of the intervals imposed by the individual agents.

In stable biological and ecological networks, the steady-state influence matrix gathers the signs of steady-state responses to step-like perturbations affecting the variables. Such signs are difficult to predict a priori, because they result from a combination of direct effects (deducible from the Jacobian of the network dynamics) and indirect effects. For stable monotone or cooperative networks, the sign pattern of the influence matrix can be qualitatively determined based exclusively on the sign pattern of the system Jacobian. For other classes of networks, we show that a semi-qualitative approach yields sufficient conditions for Jacobians with a given sign pattern to admit a fully positive influence matrix, and we also provide quantitative conditions for Jacobians that are translated eventually nonnegative matrices. We present a computational test to check whether the influence matrix has a constant sign pattern in spite of parameter variations, and we apply this algorithm to quasi-Metzler Jacobian matrices, to assess whether positivity of the influence matrix is preserved in spite of deviations from cooperativity. When the influence matrix is fully positive, we give a simple vertex algorithm to test robust stability. The devised criteria are applied to analyse the steady-state behaviour of ecological and biomolecular networks.

A signed network is a network with each link associated with a positive or negative sign. Models for nodes interacting over such signed networks, where two types of interactions are defined along the positive and negative links, respectively, arise from various biological, social, political, and economical systems. Starting from standard consensus dynamics, there are two basic types of negative interactions along negative links, namely state flipping or relative-state flipping. In this paper, we provide an algebraic-graphical method serving as a systematic tool of studying these dynamics over signed networks. Utilizing generalized Perron-Frobenius theory, graph theory, and elementary algebraic recursions, we show this method is useful to establish a series of basic convergence results for dynamics over signed networks.

The CDIO framework for development of engineering education is presented, including the overall ideas, the fundamental documents, and some development tools. The automatic control subject and its role in engineering education is studied using the CDIO Standards as reference. Some examples from the engineering education at Linkoping University are presented with special focus on the control education. (C) 2017, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.

This work evaluates a previously introduced algorithm called Particle-Based Rapid Incremental Smoother within the framework of state inference and parameter identification in Jump Markov Non-Linear System. It is applied to the recursive form of two well-known Maximum Likelihood based algorithms who face the common challenge of online computation of smoothed additive functionals in order to accomplish the task of model parameter estimation. This work extends our previous contributions on identification of Markovian switching systems with the goal to reduce the computational complexity. A benchmark problem is used to illustrate the results.

In this paper, an indoor vehicle multi-level positioning algorithm is proposed that makes use of an indoor map, as well as dead-reckoning sensor information that is available in every car. A particle filter framework is used for online optimal Bayesian vehicle positioning with indoor-outdoor transitions. The method is validated experimentally in two indoor multi-level car parks. The achieved results indicate that accurate indoor positioning is possible already today without relying on expensive technology such as e.g. laser scanners or additional hardware.

Narrowband Internet of Things (NB-IoT) is an emerging cellular technology designed to target low-cost devices, high coverage, long device battery life (more than ten years), and massive capacity. We investigate opportunities for device tracking in NB-IoT systems using Observed Time Difference of Arrival (OTDOA) measurements. Reference Signal Time Difference (RSTD) reports are simulated to be sent to the mobile location center periodically or on an ondemand basis. We investigate the possibility of optimizing the number of reports per minute budget on horizontal positioning accuracy using an on-demand reporting method based on the Signal to Noise Ratio (SNR) of the measured cells received by the User Equipment (UE). Wireless channels are modeled considering multipath fading propagation conditions. Extended Pedestrian A (EPA) and Extended Typical Urban (ETU) delay profiles corresponding to low and high delay spread environments, respectively, are simulated for this purpose. To increase the robustness of the filtering method, measurement noise outliers are detected using confidence bounds estimated from filter innovations.

This paper deals with state inference and parameter identification in Jump Markov Non-Linear System. The state inference problem is solved efficiently using a recently proposed Rao-Blackwellized Particle Filter, where the discrete state is integrated out analytically. Within the RBPF framework, Recursive Maximum Likelihood parameter identification is performed using gradient ascent algorithms. The proposed learning method has the advantage over (online) Expectation Maximization methods, that it can be easily applied to cases where the probability density functions defining the Jump Markov Non-Linear System are not members of the exponential family. Two benchmark problems illustrate the parameter identification performance.

In polar region operations, drift sea ice positioning and tracking is useful for both scientific and safety reasons. Modeling ice movements has proven difficult, not least due to the lack of information of currents and winds of high enough resolution. Thus, observations of drift ice is essential to an up-to-date ice-tracking estimate.

As an inverse problem, it is possible to extract current and wind estimates from the tracked objects of a Multi-Target Tracking (MTT) filter. By inserting the track estimates into a Gaussian field, we obtain a two-dimensional current estimate over a region of interest.

The algorithm is applied to a Terrestrial Radar Interferometer (TRI) dataset from Kongsfjorden, Svalbard, to show the practical application of the current estimation.

In this work, we estimate a model of the vertical dynamics of a quadcopter and explain how this model can be used for mass estimation and diagnosis of system changes. First, a standard thrust model describing the relation between the calculated control signals of the rotors and the thrust that is commonly used in literature is estimated. The estimation results are compared to those using a refined thrust model and it turns out that the refined model gives a significant improvement. The combination of a nonlinear model and closed-loop data poses some challenges and it is shown that an instrumental variables approach can be used to obtain accurate estimates. Furthermore, we show that the refined model opens up for fault detection of the quadcopter. More specifically, this model can be used for mass estimation and also for diagnosis of other parameters that might vary between and during missions.

The Military Institute of Engineering (IME) is a Brazilian Army higher education institution, located in Rio de Janeiro – Brazil. Every three years, the Brazilian government evaluates the engineering bachelor´s degree programs and IME is always among the best Brazilian engineering schools. Despite the excellent results, the CDIO framework was chosen, at the end of 2014, as a reference framework to improve the education process, reorganize the programs and promote the development of intra and interpersonal skills. The objective of this work is to show the initial steps of the CDIO  implementation. In the beginning of the process, the idea was to start only with the Mechanical Engineering program. However, after the initial promotion seminars presented for faculty, staff and students, a sense of commitment was created, and four of ten undergraduate programs also decided to participate. One of the first step was the formation of the team responsible to coordinate the implementation of this set of best practices. The Kotter framework has been used to drive this transformation process. The CDIO syllabus was translated into Portuguese, and it was compared with some of the Brazilian regulatory requirements for engineering education and has been used as a reference for future curriculum changes. This paper also highlights the process for change management, the remodeling of the first year and the introduction of an entrepreneurship course in partnership with an outstanding Brazilian business school.

In this paper, an approach to estimate the mass of a quadcopter using only inertial measurements and pilot commands is presented. For this purpose, a lateral dynamic model describing the relation between the roll rate and the lateral acceleration is formulated. Due to the quadcopter’s inherent instability, a controller is used to stabilize the system and the data is collected in closed loop. Under the effect of feedback and disturbances, the inertial measurements used as input and output are correlated with the disturbances, which complicates the parameter estimation. The parameters of the model are estimated using several methods. The simulation and experimental results show that the instrumental-variable method has the best potential to estimate the mass of the quadcopter in this setup.

This paper presents three iterative methods for orientation estimation. The first two are based on iterated Extended Kalman filter (IEKF) formulations with different state representations. The first is using the well-known unit quaternion as state (q-IEKF) while the other is using orientation deviation which we call IMEKF. The third method is based on nonlinear least squares (NLS) estimation of the angular velocity which is used to parametrise the orientation. The results are obtained using Monte Carlo simulations and the comparison is done with the non-iterative EKF and multiplicative EKF (MEKF) as baseline. The result clearly shows that the IMEKF and the NLS-based method are superior to q-IEKF and all three outperform the non-iterative methods.

Chronic kidney disease (CKD) is a global public health problem, affecting approximately 10% of the population worldwide. Yet, there is little direct evidence on how CKD can be diagnosed in a systematic and automatic manner. This paper investigates how CKD can be diagnosed by using machine learning (ML) techniques. ML algorithms have been a driving force in detection of abnormalities in different physiological data, and are, with a great success, employed in different classification tasks. In the present study, a number of different ML classifiers are experimentally validated to a real data set, taken from the UCI Machine Learning Repository, and our findings are compared with the findings reported in the recent literature. The results are quantitatively and qualitatively discussed and our findings reveal that the random forest (RF) classifier achieves the near-optimal performances on the identification of CKD subjects. Hence, we show that ML algorithms serve important function in diagnosis of CKD, with satisfactory robustness, and our findings suggest that RF can also be utilized for the diagnosis of similar diseases.

We introduce interacting particle Markov chain Monte Carlo (iPMCMC), a PMCMC method based on an interacting pool of standard and conditional sequential Monte Carlo samplers. Like related methods, iPMCMC is a Markov chain Monte Carlo sampler on an extended space. We present empirical results that show significant improvements in mixing rates relative to both noninteracting PMCMC samplers and a single PMCMC sampler with an equivalent memory and computational budget. An additional advantage of the iPMCMC method is that it is suitable for distributed and multi-core architectures.

In order to meet the requirements for autonomous systems in real world applications, reliable path following controllers have to be designed to execute planned paths despite the existence of disturbances and model errors. In this paper we propose a Linear Quadratic controller for stabilizing a 2-trailer system with possible off-axle hitching around preplanned paths in backward motion. The controller design is based on a kinematic model of a general 2-trailer system including the possibility for off-axle hitching. Closed-loop stability is proved around a set of paths, typically chosen to represent the possible output from the path planner, using theory from linear differential inclusions. Using convex optimization tools a single quadratic Lyapunov function is computed for the entire set of paths.

The identification of continuous-time models of dynamical systems based on sampled measurements of input and output signals is a research topic that has received much attention during the past decades. However, a framework for the correct assessment of the performance of various estimation methods, as well as their numerical reliability, is still missing due to a number of benchmarking difficulties, equally applicable to both discrete-and continuous-time identification problems. This paper revisits this topic, reports new numerical results, highlights several fundamental aspects regarding the definition of an appropriate benchmark for the evaluation of continuous-time linear model identification algorithms and discusses several means of addressing the related existing problems.

In a continuous-time nonlinear driftless control system, a geometric phase is a consequence of nonintegrability of the vector fields, and it describes how cyclic trajectories in shape space induce non-periodic motion in phase space, according to an area rule. The aim of this paper is to shown that geometric phases exist also for discrete-time driftless nonlinear control systems, but that unlike their continuous-time counterpart, they need not obey any area rule, i.e., even zero-area cycles in shape space can lead to nontrivial geometric phases. When the discrete-time system is obtained through Euler discretization of a continuous-time system, it is shown that the zero-area geometric phase corresponds to the gap between the Euler discretization and an exact discretization of the continuous-time system.

When an aircraft is flying and burning fuel the center of gravity (c.g.) of the aircraft shifts slowly. The c.g. can also be shifted abruptly when e.g. a ghter aircraft releases a weapon. The shift in c.g. is difficult to measure or estimate so the flight control systems need to be robustly designed to cope with this variation. However for fighter aircrafts with high manoeuvrability there is room for improvements. In this paper we investigate if the use of adaptive control law augmentation can be used to better cope with the change in c.g. We augment a baseline controller with a robust Model Reference Adaptive Control (MRAC) design and analyse its benets and possible issues.

In many traffic situations there are times where interaction with other drivers is necessary and unavoidable in order to safely progress towards an intended destination. This is especially true for merge manoeuvres into dense traffic, where drivers sometimes must be somewhat aggressive and show the intention of merging in order to interact with the other driver and make the driver open the gap needed to execute the manoeuvre safely. Many motion planning frameworks for autonomous vehicles adopt a reactive approach where simple models of other traffic participants are used and therefore need to adhere to large margins in order to behave safely. However, the large margins needed can sometimes get the system stuck in congested traffic where time gaps between vehicles are too small. In other situations, such as a highway merge, it can be significantly more dangerous to stop on the entrance ramp if the gaps are found to be too small than to make a slightly more aggressive manoeuvre and let the driver behind open the gap needed. To remedy this problem, this work uses the Intelligent Driver Model (IDM) to explicitly model the interaction of other drivers and evaluates the risk by their required deceleration in a similar manner as the Minimum Overall Breaking Induced by Lane change (MOBIL) model that has been used in large scale traffic simulations before. This allows the algorithm to evaluate the effect on other drivers depending on our own trajectory plans by simulating the nearby traffic situation. Finding a globally optimal solution is often intractable in these situations so instead a large set of candidate trajectories are generated that are evaluated against the traffic scene by forward simulations of other traffic participants. By discretization and using an efficient trajectory generator together with efficient modelling of the traffic scene real-time demands can be met.

In multiparametric programming an optimization problem which is dependent on a parameter vector is solved parametrically. In control, multiparametric quadratic programming (mp-QP) problems have become increasingly important since the optimization problem arising in Model Predictive Control (MPC) can be cast as an mp-QP problem, which is referred to as explicit MPC. One of the main limitations with mp-QP and explicit MPC is the amount of memory required to store the parametric solution and the critical regions. In this paper, a method for exploiting low rank structure in the parametric solution of an mp-QP problem in order to reduce the required memory is introduced. The method is based on ideas similar to what is done to exploit low rank modifications in generic QP solvers, but is here applied to mp-QP problems to save memory. The proposed method has been evaluated experimentally, and for some examples of relevant problems the relative memory reduction is an order of magnitude compared to storing the full parametric solution and critical regions.

In this paper a cascaded approach for stabilizationand path tracking of a general 2-trailer vehicle configurationwith an off-axle hitching is presented. A low level LinearQuadratic controller is used for stabilization of the internalangles while a pure pursuit path tracking controller is used ona higher level to handle the path tracking. Piecewise linearityis the only requirement on the control reference which makesthe design of reference paths very general. A Graphical UserInterface is designed to make it easy for a user to design controlreferences for complex manoeuvres given some representationof the surroundings. The approach is demonstrated with challengingpath following scenarios both in simulation and on asmall scale test platform.

In this paper, recent results on the evaluation of the Bayesian Cramer-Rao bound for jump Markov systems are presented. In particular, previous work is extended to jump Markov systems where the discrete mode variable enters into both the process and measurement equation, as well as where it enters exclusively into the measurement equation. Recursive approximations are derived with finite memory requirements as well as algorithms for checking the validity of these approximations are established. The tightness of the bound and the validity of its approximation is investigated on a couple of examples.

We still have very little knowledge about how ourbrains decouple different sound sources, which is known assolving the cocktail party problem. Several approaches; includingERP, time-frequency analysis and, more recently, regression andstimulus reconstruction approaches; have been suggested forsolving this problem. In this work, we study the problem ofcorrelating of EEG signals to different sets of sound sources withthe goal of identifying the single source to which the listener isattending. Here, we propose a method for finding the number ofparameters needed in a regression model to avoid overlearning,which is necessary for determining the attended sound sourcewith high confidence in order to solve the cocktail party problem.

In inertial motion capture, a multitude of body segments are equipped with inertial sensors, consisting of 3D accelerometers and 3D gyroscopes. Using an optimization-based approach to solve the motion capture problem allows for natural inclusion of biomechanical constraints and for modeling the connection of the body segments at the joint locations. The computational complexity of solving this problem grows both with the length of the data set and with the number of sensors and body segments considered. In this work, we present a scalable and distributed solution to this problem using tailored message passing, capable of exploiting the structure that is inherent in the problem. As a proof-of-concept we apply our algorithm to data from a lower body configuration. 

Radar and sonar provide information of both range and radial velocity to unknown objects. This is accomplished by emitting a signal waveform and computing the round trip time and Doppler shift. Estimation of the round trip time and Doppler shift is usually done separately without considering the couplings between these two object related quantities. The purpose of this contribution is to first model the amplitude, time shift and time scale of the returned signal in terms of the object related states range and velocity, and analyse the Cramér-Rao lower bound (CRLB) for the joint range and velocity estimation problem. One of the conclusions is that there is negative correlation between range and velocity. The maximum likelihood (ML) cost function also confirms this strong negative correlation. For target tracking applications, the use of the correct covariance matrix for the measurement vector gives a significant gain in information, compared to using the variance of range and velocity assuming independence. In other words, the knowledge of the correlation tells the tracking filter that a too large range measurement comes most likely with a too small velocity measurement, and vice versa. Experiments with sound pulses reflected in a wall indoors confirm the main conclusion of negative correlation.

GPS is widely used for localization and tracking, however traditional GPS receivers consume too much energy for many applications. This paper implements and evaluates the performance of a low-energy GPS prototype. The main difference is that a traditional GPS needs to sample signals transmitted by satellites for 30 seconds to estimate its position. Our prototype reduces this time by three orders of magnitude and it can compute positions from only 2 milliseconds of data. We present a new algorithm that increases robustness by filtering on estimated residuals instead of using an altitude database. In addition, we show that our new algorithm works with both fixed and moving targets. The solution consists of (1) a portable device that samples the GPS signal and (2) a server that utilizes Doppler navigation and Coarse Time Navigation to estimate positions. We performed tests in a wide variety of environments and situations. These tests show that our prototype provides a median positioning error of roughly 40 meters even when the GPS receiver is moving at 80 kilometres per hour.

Positioning in cellular networks is often based on mobile-assisted measurements of serving and neighboring base stations. Traditionally, positioning is considered to be enabled when the mobile provides measurements of three different base stations. In this paper, we additionally investigate positioning based on time series of Time Of Flight (TOF) and Time Difference of Arrival (TDOA) measurements gathered from two base stations with known positions, where the specific base stations involved depend on the trajectory of the mobile station.. The set of two base stations is different along the trajectory. Each report contains TOF for the serving base station, and one TDOA measurement for the most favorable neighboring base station relative the serving base station. We derive explicit analytical solution related to the intersection of the absolute distance circle (from TOF) and relative distance hyperbola (from TDOA). We consider both geometric noise-free problem and the more realistic problem with additive noise as delivered in the 3rd Generation Partnership Project (3GPP) Long-Term Evolution (LTE). Positioning performance is evaluated using the Cramer-Rao lower bound.

This paper proposes a diagonal covariance matrix approximation for Wide-Sense Stationary (WSS) signals with correlated Gaussian noise. Existing signal models that incorporate correlations often require regularization of the covariance matrix, so that the covariance matrix can be inverted. The disadvantage of this approach is that matrix inversion is computational intensive and regularization decreases precision. We use Bienayme's theorem to approximate the covariance matrix by a diagonal one, so that matrix inversion becomes trivial, even with nonuniform rather than only uniform sampling that was considered in earlier work. This approximation reduces the computational complexity of the estimator and estimation bound significantly. We numerically validate this approximation and compare our approach with the Maximum Likelihood Estimator (MLE) and Cramer-Rao Lower Bound (CRLB) for multivariate Gaussian distributions. Simulations show that our approach differs less than 0.1% from this MLE and CRLB when the observation time is large compared to the correlation time. Additionally, simulations show that in case of non-uniform sampling, we increase the performance in comparison to earlier work by an order of magnitude. We limit this study to correlated signals in the time domain, but the results are also applicable in the space domain.

In Moving Horizon Estimation (MHE) the computed estimate is found by solving a constrained finite-time optimal estimation problem in real-time at each sample in a receding horizon fashion. The constrained estimation problem can be solved by, e.g., interior-point (IP) or active-set (AS) methods, where the main computational effort in both methods is known to be the computation of the search direction, i.e., the Newton step. This is often done using generic sparsity exploiting algorithms or serial Riccati recursions, but as parallel hardware is becoming more commonly available the need for parallel algorithms for computing the Newton step is increasing. In this paper a newly developed tailored, non-iterative parallel algorithm for computing the Newton step using the Riccati recursion for Model Predictive Control (MPC) is extended to MHE problems. The algorithm exploits the special structure of the Karush-Kuhn-Tucker system for the optimal estimation problem. As a result it is possible to obtain logarithmic complexity growth in the estimation horizon length, which can be used to reduce the computation time for IP and AS methods when applied to what is today considered as challenging estimation problems. Furthermore, promising numerical results have been obtained using an ANSI-C implementation of the proposed algorithm, which uses Message Passing Interface (MPI) together with InfiniBand and is executed on true parallel hardware. Beyond MHE, due to similarities in the problem structure, the algorithm can be applied to various forms of on-line and off-line smoothing problems.

This paper describes the motivation, the current state and the further actions of an improvement process of the engineering education at the Military Institute of Engineering (IME) in Brazil. Based on the reasons for why and how to change, the CDIO framework has been chosen as the kernel of this improvement process. The activities realized the plan of the further actions and the open questions are presented in this paper. The paper is a condensed presentation of the report (Cerqueira et. al., 2016), where a thorough background and more details can be found.

We study severely quantized received signal strength (RSS)-based cooperative localization in wireless sensor networks. We adopt the well-known sum-product algorithm over a wireless network (SPAWN) framework in our study. To address the challenge brought by severely quantized measurements, we adopt the principle of importance sampling and design appropriate proposal distributions. Moreover, we propose a parametric SPAWN in order to reduce both the communication overhead and the computational complexity. Experiments with real data corroborate that the proposed algorithms can achieve satisfactory localization accuracy for severely quantized RSS measurements. In particular, the proposed parametric SPAWN outperforms its competitors by far in terms of communication cost. We further demonstrate that knowledge about non-connected sensors can further improve the localization accuracy of the proposed algorithms.

The commercial interest in proximity services is increasing. Application examples include location-based information and advertisements, logistics, social networking, file sharing, etc. In this paper, we consider network-based positioning based on times series of proximity reports from a mobile device, either only a proximity indicator, or a vector of RSS from observed nodes. Such positioning corresponds to a latent and nonlinear observation model. To address these problems, we combine two powerful tools, namely particle filtering and Gaussian process regression (GPR) for radio signal propagation modeling. The latter also provides some insights into the spatial correlation of the radio propagation in the considered area. Radio propagation modeling and positioning performance are evaluated in a typical office area with Bluetooth-Low-Energy (BLE) beacons deployed for proximity detection and reports. Results show that the positioning accuracy can be improved by using GPR.

Drive cycle following is important for concept comparisons when evaluating vehicle concepts, but it can be time consuming to develop good driver models that can achieve accurate following of a specific velocity profile. Here, a new approach is proposed where a simple driver model based on a PID controller is extended with an Iterative Learning Control (ILC) algorithm. Simulation results using a nonlinear vehicle and control system model show that it is possible to achieve very good cycle following in a few iterations with little tuning effort. It is also possible to utilize the repetitive behavior in the drive cycle to accelerate the convergence of the ILC algorithm even further.

In this paper, we propose a new method to identify biochemical reaction networks (i.e. both reactions and kinetic parameters) from heterogeneous datasets. Such datasets can contain (a) data from several replicates of an experiment performed on a biological system; (b) data measured from a biochemical network subjected to different experimental conditions, for example, changes/perturbations in biological inductions, temperature, gene knock-out, gene over-expression, etc. Simultaneous integration of various datasets to perform system identification has the potential to avoid non-identifiability issues typically arising when only single datasets are used.