Add kernels ResNetCell and TransformerCell#276

Open

andidr wants to merge 19 commits intomasterfrom

andi/benchmarks

Commits on Aug 2, 2019

Add partial support for duplication of virtual tensors
andidr
committed
Add kernel composition functions applying an optional activation function
andidr
committed
Add kernel representing a single ResNet cell
andidr
committed
Add displaying and parsing functions for ActivationFunction its Option
andidr
committed
NOT A COMMIT YET: Add ResNetCell kernel to cuda_search of telamon-cli
andidr
committed
Add function applying the softmax function to n-dimensional arrays in place
andidr
committed
Add kernel composition function calculating sum of all elements of a tensor
andidr
committed
Add kernel composition function for element-wise division of a tensor
andidr
committed
Add kernel representing a single Transformer cell
andidr
committed
NOT A COMMIT YET: Add TransformerCell kernel to cuda_search of telamon-cli
andidr
committed
Allow 0-dimensional arrays when reading data from device to host
andidr
committed
Add kernel with first part of operations of TransformerCell split at softmax
andidr
committed
NOT A COMMIT YET: Add TransformerCellTopHalf kernel to cuda_search of telamon-cli
andidr
committed
Add kernel with second part of operations of TransformerCell split at softmax
andidr
committed
NOT A COMMIT YET: Add TransformerCellBottomHalf kernel to cuda_search of telamon-cli
andidr
committed
Add kernel with operations of ResNetCell before split at second multiplication
andidr
committed
NOT A COMMIT YET: Add ResNetCellTopHalf kernel to cuda_search of telamon-cli
andidr
committed
Add kernel with operations of ResNetCell after split at second multiplication
andidr
committed
NOT A COMMIT YET: Add ResNetCellBottomHalf kernel to cuda_search of telamon-cli
andidr
committed