Information Processing

I Fundamentals of information extraction and system modeling (6 weeks)

Model fitting, relation of computer model and reality. Model types (disckrete-time, continuous-time, deterministic and stochastic, etc.). Analogy  of differennt physical phenomena (same difference equation).

Stochastic processes. Stationarity and ergodicity. Examples. Disrete Fourier Transform: properties of the DFT of randomly-timed periodic signals. Processes with continuous power spectral density.

Sampling, quantization, roudoff, dither. Theorems and practical applicability of these. Systems containing ADC's. Matching differently samples sequences, system design. Examples and counterexamples.

Averaging. Relation of discrete and continuous data processing. Averaging and lowpass filtering. Reconstruction of the continuous-time signal from samples. Explicite and recursive averaging, stability. Signal enhancement and moving average.

Basic quantities used in signal processing. Compression. Correlation function. Power spectral density. Periodogram and circular correlation. Spectral analysis with bandpass filters. Filter banks. Real and complex modulation, zoom, On-line signal processing.

Embedded systems, modeling and system identification. Network analysis. Measurement and experiment design. Excitation signals: multisine and sweep sine, noise, pseudorandom noise and impulse/step response.

II. Qualitative and knowledge-intensive methods of information processing

Machine learning (2 weeks)

      Learning and adaptivity. Model of the learning problem.

      Learning by examples. Learning theory.

     Supervised logics learning. Decision trees.

     Artificial neural networks. Backproparagion learning.

     Examples and demonstrations.

     Learning based on validation or decision value.

Probability nets (1 week)

     Network representation of probabilistic information processing.

     Data processing. Logical sampling.

     Learning of probabilities by examples. Diagnosis with nets.

Rule-based systems (1 week)

     Illustration and manipulation of information.

     Rule based systems. Forward and backward reasoning.

     speedup of rule-based systems. Implementations.

Fuzzy logic methods (1 week)

     Basics of fuzzy logic. Fuzzy sets and membership functions.

     Fuzzy inference.

     Typical fuzzy information processing schemes. Fuzzy signal processing. Fuzzy coontrollers, fuzzy radial functions.

III. Sensor fusion (1 week)

Levels of sensor fusion. Typical problems.

Fusion at signal processing level.

Consensus-based filters.

Fusion with neural and probabilistic nets.

Dempster-Shaffer theory, fusion with fuzzy logic.

Complex and hybrid examples.

Material for self-study:

Several details of sampling

Signal processing in the time domain, ad hoc methods, partial information extraction with fast algorithms. Measurement of rise time, delay, peak value.

Design of digital filters.