Deep Learning with Microsoft Cognitive Toolkit Quick Start Guide

Other Books You May Enjoy

Summary

Deploying your model to production

Running your first experiment

Exploring the machine learning workspace

Deploying Azure Machine Learning service

Using Azure Machine Learning service to manage models

Using ONNX models in C#

Storing a model in ONNX format

Storing portable models for use in other applications

Storing model checkpoints to continue training at a later point

Storing your models

Gathering feedback on your models

Deploying models to production

Training models in a continuous integration pipeline

Keeping track of your data

Using machine learning in a DevOps environment

Technical requirements

Deploying Models to Production

Summary

Predicting output

Training the neural network with time series data

Stacking multiple recurrent layers

Building the neural network structure

Building recurrent neural networks with CNTK

When to use other recurrent layer types

Working with long short-term memory units

Working with gated recurrent units

Using other recurrent layer types

Training a recurrent neural network

Making predictions with a recurrent neural network

How do recurrent neural networks work?

Stacking multiple recurrent layers

Predicting sequences based on sequences

Predicting a sequence based on a single sample

Predicting a single output based on a sequence

Recurrent neural networks variations

What are recurrent neural networks?

Technical requirements

Working with Time Series Data

Summary

Improving model performance with data augmentation

Picking the right combination of layers

Training the network with images

Building the network structure

Building convolutional networks

Other uses for convolutional networks

Working with pooling layers

Working with convolution layers

Network architecture used for image classification

Convolutional neural network architecture

Technical requirements

Working with Images

Summary

Using TensorBoard

Using ProgressPrinter

Using callbacks during training and validation

Monitoring your model

Measuring performance when working with a manual minibatch loop

Measuring performance when working with minibatch sources

Measuring performance for out-of-memory datasets

Measuring regression model performance in CNTK

Measuring the accuracy of your predictions

Validating performance of a regression model

Measuring classification performance in CNTK

Using the F-measure as an alternative to the confusion matrix

Using a confusion matrix to validate your classification model

Validating performance of a classification model

What about underfitting and overfitting?

Using k-fold cross-validation

Using a hold-out dataset for validation

Choosing a good strategy to validate model performance

Technical requirements

Validating Model Performance

Summary

Taking control over the minibatch loop

Feeding data into a training session

Creating CTF files

Creating a MinibatchSource instance

Working with large datasets

Working with pandas DataFrames

Working with numpy arrays

Working with small in-memory datasets

Training a neural network efficiently with minibatches

Technical requirements

Getting Data into Your Neural Network

Summary

Improving the model

Making predictions with a neural network

Checking the performance of the neural network

Feeding data into the trainer to optimize the neural network

Choosing a learner and setting up training

Training the neural network

Recording metrics

Picking a loss function

Choosing an activation function for the hidden layers

Choosing an activation function for the output layer

Choosing an activation function

Building the network structure

Building your first neural network

Model metrics

Loss functions

Using learners and trainers to optimize the parameters in a neural network

Customizing layer settings

Building neural networks using layer functions

Basic neural network concepts in CNTK

Technical requirements

Building Neural Networks with CNTK

Summary

Enabling GPU usage on Linux

Enabling GPU usage on Windows

Using your GPU with CNTK

Installing the CNTK package

Upgrading pip to the latest version

Installing Anaconda

Installing on Linux

Installing CNTK

Upgrading pip

Installing Anaconda

Installing on Windows

Installing CNTK

Using models from C# and Java

Loading and processing large datasets

Measuring model performance

Basic building blocks for quickly creating neural networks

A high-speed low-level API

Features of CNTK

What is CNTK?

Optimizing a neural network

Predicting output with a neural network

Artificial neurons

The neural network architecture

How does deep learning work?

Limitations of machine learning

The relationship between AI machine learning and deep learning

Getting Started with CNTK

Reviews

Get in touch

Conventions used

Code in Action

Download the example code files

To get the most out of this book

What this book covers

Who this book is for

Preface

Packt is searching for authors like you

About the reviewer

About the author

Contributors

Packt.com

Why subscribe?

About Packt

Dedication

Deep Learning with Microsoft Cognitive Toolkit Quick Start Guide

Copyright and Credits

Title Page

coverpage

coverpage

Title Page

Copyright and Credits

Deep Learning with Microsoft Cognitive Toolkit Quick Start Guide

Dedication

About Packt

Why subscribe?

Packt.com

Contributors

About the author

About the reviewer

Packt is searching for authors like you

Preface

Who this book is for

What this book covers

To get the most out of this book

Download the example code files

Code in Action

Conventions used

Get in touch

Reviews

Getting Started with CNTK

The relationship between AI machine learning and deep learning

Limitations of machine learning

How does deep learning work?

The neural network architecture

Artificial neurons

Predicting output with a neural network

Optimizing a neural network

What is CNTK?

Features of CNTK

A high-speed low-level API

Basic building blocks for quickly creating neural networks

Measuring model performance

Loading and processing large datasets

Using models from C# and Java

Installing CNTK

Installing on Windows

Installing Anaconda

Upgrading pip

Installing CNTK

Installing on Linux

Installing Anaconda

Upgrading pip to the latest version

Installing the CNTK package

Using your GPU with CNTK

Enabling GPU usage on Windows

Enabling GPU usage on Linux

Summary

Building Neural Networks with CNTK

Technical requirements

Basic neural network concepts in CNTK

Building neural networks using layer functions

Customizing layer settings

Using learners and trainers to optimize the parameters in a neural network

Loss functions

Model metrics

Building your first neural network

Building the network structure

Choosing an activation function

Choosing an activation function for the output layer

Choosing an activation function for the hidden layers

Picking a loss function

Recording metrics

Training the neural network

Choosing a learner and setting up training

Feeding data into the trainer to optimize the neural network

Checking the performance of the neural network

Making predictions with a neural network

Improving the model

Summary

Getting Data into Your Neural Network

Technical requirements

Training a neural network efficiently with minibatches

Working with small in-memory datasets

Working with numpy arrays

Working with pandas DataFrames

Working with large datasets

Creating a MinibatchSource instance

Creating CTF files

Feeding data into a training session

Taking control over the minibatch loop

Summary

Validating Model Performance

Technical requirements

Choosing a good strategy to validate model performance

Using a hold-out dataset for validation

Using k-fold cross-validation

What about underfitting and overfitting?

Validating performance of a classification model

Using a confusion matrix to validate your classification model

Using the F-measure as an alternative to the confusion matrix

Measuring classification performance in CNTK

Validating performance of a regression model

Measuring the accuracy of your predictions

Measuring regression model performance in CNTK

Measuring performance for out-of-memory datasets

Measuring performance when working with minibatch sources

Measuring performance when working with a manual minibatch loop

Monitoring your model

Using callbacks during training and validation

Using ProgressPrinter

Using TensorBoard

Summary

Working with Images

Technical requirements

Convolutional neural network architecture

Network architecture used for image classification

Working with convolution layers

Working with pooling layers

Other uses for convolutional networks

Building convolutional networks

Building the network structure

Training the network with images

Picking the right combination of layers

Improving model performance with data augmentation

Summary

Working with Time Series Data

Technical requirements

What are recurrent neural networks?

Recurrent neural networks variations

Predicting a single output based on a sequence

Predicting a sequence based on a single sample

Predicting sequences based on sequences

Stacking multiple recurrent layers

How do recurrent neural networks work?

Making predictions with a recurrent neural network

Training a recurrent neural network

Using other recurrent layer types

Working with gated recurrent units

Working with long short-term memory units

When to use other recurrent layer types

Building recurrent neural networks with CNTK

Building the neural network structure

Stacking multiple recurrent layers

Training the neural network with time series data

Predicting output

Summary

Deploying Models to Production

Technical requirements

Using machine learning in a DevOps environment

Keeping track of your data

Training models in a continuous integration pipeline

Deploying models to production

Gathering feedback on your models

Storing your models

Storing model checkpoints to continue training at a later point

Storing portable models for use in other applications

Storing a model in ONNX format

Using ONNX models in C#

Using Azure Machine Learning service to manage models

Deploying Azure Machine Learning service

Exploring the machine learning workspace

Running your first experiment

Deploying your model to production

Summary

Other Books You May Enjoy