October 3, 2021 CNN

Training RNNs as Fast as CNNs

News SRU++, a new SRU variant, is released. [tech report] [blog] The experimental code and SRU++ implementation are available on the dev branch which will be merged into master later. About SRU is a recurrent unit that can run over 10 times faster than cuDNN LSTM, without loss of accuracy tested on many tasks. Average processing time of LSTM, conv2d and SRU, tested on GTX 1070 For example, the figure above presents the processing time of a single mini-batch of […]

September 25, 2021 CNN

Auralisation of learned features in CNN (for audio)

This repo is for an example of auralisastion of CNNs that is demonstrated on ISMIR 2015. Files auralise.py: includes all required function for deconvolution. example.py: includes the whole code – just clone and run it by python example.py You might need to use older version of Keras, e.g. this (ver 0.3.x) Folders src_songs: includes three songs that I used in my blog posting. Usage Load weights that you want to auralise. I’m using this function W = load_weights() to load […]

September 25, 2020 CNN

CNN for Short-Term Stocks Prediction using Tensorflow

In machine learning, a convolutional neural network (CNN, or ConvNet) is a class of neural networks that has successfully been applied to image recognition and analysis. In this project I’ve approached this class of models trying to apply it to stock market prediction, combining stock prices with sentiment analysis. The implementation of the network has been made using TensorFlow, starting from the online tutorial. In this article, I will describe the following steps: dataset creation, CNN training and evaluation of […]