The course examines the construction and the performance analysis of deep neural networks using the Intel\u00ae neon\u2122 Framework.<\/p>\n
The following topics are covered:<\/p>\n
The course is practice oriented. There are 8 lectures (1.5 hours each) and 5 individual consultations in groups of 2-3 people (for each group). Lectures are held in plain lecture or master class (tutorial) form. The presentation of the theoretical material in most lectures\/master classes is supported by examples of developing a deep neural network architecture using the Intel\u00ae neon\u2122 Framework. The problem for which deep models are constructed is comprehensive and covers the entire lecture part, with the exception of an introductory lecture of a survey nature. The practice of the course is structured as follows: students are divided into groups of 2-3 people. Each group chooses a separate problem and tries to achieve the maximum quality by constructing different types of deep architectures and modifying their internal structure. Students follow the provided tutorials that represent step-by-step deep model development using the Intel\u00ae neon\u2122 Framework. The mode of collective development is simulated. The final control of knowledge assumes presentation of the developed project with demonstration of quality\/performance measurements of proposed deep neural networks.<\/p>\n
The course is aimed at engineers, teachers and researchers, as well as postgraduate students and students of higher educational institutions.<\/p>\n
The course is aimed at students who have basic programming skills in the scripting programming language Python. Along with this, the course requires theoretical knowledge in the field of optimization methods, probability theory, image processing and computer vision.<\/p>\n
Syllabus is available here<\/a>.<\/p>\n Sources for all practical classes to solve the task considered at the lectures are available here<\/a>. Experimental results are available here<\/a>.<\/p>\n The list of practical tasks for solving by the group of students is available here<\/a>.<\/p>\n The licence is available here<\/a>.<\/p>\n Kustikova Valentina Dmitrievna<\/strong>, Phd, Prof. Assistant, department of Computer software and supercomputer technologies, Institute of Information Technologies, Mathematics and Mechanics, Nizhny Novgorod State University. Lead and developer.<\/p>\n Zolotykh Nikolai Yurievich<\/strong>, Dr., Prof., department of Algebra, geometry and discrete mathematics, Institute of Information Technologies, Mathematics and Mechanics, Nizhny Novgorod State University. Scientific adviser.<\/p>\n Zhiltsov Maxim Sergeevich<\/strong>, master of the 1st year training, Institute of Information Technology, Mathematics and Mechanics, Nizhny Novgorod State University. Developer.<\/p>\n The course development is supported by Intel Corporation.<\/strong><\/em><\/p>\n LECTURE 1. Introduction to deep learning<\/strong><\/p>\n The notion of deep learning. Biological fundamentals of deep learning. Examples of practical problems. Classification of deep models.<\/p>\n (pptx<\/a>, docx<\/a>)<\/p>\n LECTURE 2. Multilayered fully-connected neural networks<\/strong><\/p>\n The structure of fully-connected neural networks (FCNN), types of activation functions. Training problem of FCNN, loss function. Backpropagation method.<\/p>\n (pptx<\/a>, docx<\/a>)<\/p>\n PRACTICE 0. Preprocessing and converting data to HDF5 format for the Intel\u00ae neon\u2122 Framework<\/strong><\/p>\n Preliminary practice to prepare dataset for the subsequent practical classes.<\/p>\n (docx<\/a>)<\/p>\n LECTURE 3. Introduction to the Intel\u00ae neon\u2122 Framework<\/strong><\/p>\n Introduction to the Intel\u00ae neon\u2122 Framework. Installation. The structure of application for training\/testing of the single-layer fully-connected neural network using the Intel\u00ae neon\u2122 Framework.<\/p>\n (pptx<\/a>, docx<\/a>)<\/p>\n PRACTICE 1. The development of fully-connected neural networks using the Intel\u00ae neon\u2122 Framework<\/strong><\/p>\n Problem statement for the laboratory works. Development of architectures of fully-connected networks with a different number of hidden layers and the number of hidden elements on each layer. Developing scripts for training\/testing the proposed architectures. Carrying out experiments, collecting performance results.<\/p>\n (docx<\/a>)<\/p>\n LECTURE 4. Convolutional neural networks. Deep residual networks<\/strong><\/p>\n The structure of convolutional layer and network. Example of training\/testing a single-layer convolutional network using the Intel\u00ae neon\u2122 Framework. Deep residual networks, a typical structural block, an example of a residual network.<\/p>\n (pptx<\/a>, docx<\/a>)<\/p>\n PRACTICE 2. The development of convolutional neural networks using the Intel\u00ae neon\u2122 Framework<\/strong><\/p>\n Development of convolutional network architectures with different number of hidden layers and filter parameters on each layer. Developing scripts for training\/testing the proposed architectures. Carrying out experiments, collecting performance results.<\/p>\n (docx<\/a>)<\/p>\n LECTURE 5. Transfer learning of deep neural networks<\/strong><\/p>\n Description of the general approach underlying the transfer learning in deep neural networks. An example of transfer learning application using the Intel\u00ae neon\u2122 Framework.<\/p>\n (pptx<\/a>, docx<\/a>)<\/p>\n PRACTICE 3. Application of transfer learning to solve a given problem using the Intel\u00ae neon\u2122 Framework<\/strong><\/p>\n Selection of the original problem (connected with a given problem) and a corresponded trained model. Modification of the network architecture for a given problem. Complete learning of the parameters of all network layers with arbitrary initialization. Training of all layers of parameters of all layers of the network with initialization, obtained as a result of learning the model to solve the original problem. Learning only the last layers (modified) of the network with initial initialization, obtained as a result of learning the model to solve the original problem.<\/p>\n (docx<\/a>)<\/p>\n LECTURE 6. Unsupervised learning: autoencoders, deconvolutional networks<\/strong><\/p>\n Unsupervised learning methods. The concept of an autoencoder, a stack of autoencoders, deconvolutional networks.<\/p>\n (pptx<\/a>, docx<\/a>)<\/p>\n PRACTICE 4. Initial pre-training the weights of the most perspective architectures of fully-connected networks for the subsequent solution of a given problem in supervised style using the Intel\u00ae neon\u2122 Framework<\/strong><\/p>\n Selection of several fully-connected neural networks. Developing a stack of autoencoders. Training of the developed architectures. Application of the obtained initial weights for training the network in supervised style to solve a given problem.<\/p>\n (docx<\/a>)<\/p>\n LECTURE 7. Recurrent neural networks<\/strong><\/p>\n The general structure of the model. Deploying a recurrent network in time. Recurrent networks training. Long short-term memory network. An example of training\/testing a simple recurrent network using the Intel\u00ae neon\u2122 Framework.<\/p>\n (pptx<\/a>, docx<\/a>)<\/p>\n PRACTICE 5. The development of recurrent neural networks using the Intel\u00ae neon\u2122 Framework<\/strong><\/p>\n Development of architectures of recurrent neural networks with a different number of hidden layers and the number of hidden elements on each layer. Developing scripts for training\/testing the proposed architectures. Carrying out experiments, collecting performance results.<\/p>\n (docx<\/a>)<\/p>\n LECTURE 8. Efficient execution of neural networks. The Intel\u00ae nGraph\u2122 overview<\/strong><\/p>\n Introduction to the Intel\u00ae nGraph\u2122. The neon\u2122 frontend to Intel\u00ae nGraph\u2122.<\/p>\n (pptx<\/a>, docx<\/a>)<\/p>\n","protected":false},"excerpt":{"rendered":" Description The course examines the construction and the performance analysis of deep neural networks using the Intel\u00ae neon\u2122 Framework. The following topics are covered: Introduction to deep learning. Multilayered fully-connected neural networks. Introduction to the Intel\u00ae neon\u2122 Framework. Convolutional neural … Continue reading Licence<\/h2>\n
Authors<\/h2>\n
The course structure<\/h2>\n