PyTorch

Efficient Neural Architecture Search (ENAS) in PyTorch

PyTorch implementation of Efficient Neural Architecture Search via Parameters Sharing. ENAS reduce the computational requirement (GPU-hours) of Neural Architecture Search (NAS) by 1000x via parameter sharing between models that are subgraphs within a large computational graph. SOTA on Penn Treebank language modeling. Prerequisites Python 3.6+ PyTorch==0.3.1 tqdm, scipy, imageio, graphviz, tensorboardX Usage Install prerequisites with: conda install graphviz pip install -r requirements.txt To train ENAS to discover a recurrent cell for RNN: python main.py –network_type rnn –dataset ptb –controller_optim adam […]

Read more
Images

A PyTorch Implementation of Neural IMage Assessment

NIMA: Neural IMage Assessment This is a PyTorch implementation of the paper NIMA: Neural IMage Assessment (accepted at IEEE Transactions on Image Processing) by Hossein Talebi and Peyman Milanfar. You can learn more from this post at Google Research Blog. Implementation Details The model was trained on the AVA (Aesthetic Visual Analysis) dataset containing 255,500+ images. You can get it from here. Note: there may be some corrupted images in the dataset, remove them first before you start training. Use […]

Read more
Images

Given a content photo and a style photo with python

FastPhotoStyle Given a content photo and a style photo, the code can transfer the style of the style photo to the content photo. The details of the algorithm behind the code is documented in our arxiv paper. Please cite the paper if this code repository is used in your publications. GitHub https://github.com/NVIDIA/FastPhotoStyle    

Read more
Images

A python implementation of Deep-Image-Analogy based on pytorch

Deep-Image-Analogy This project is a python implementation of Deep Image Analogy. Some results Requirements python 3 opencv3 If you use anaconda, you can install opencv3 by conda install opencv pytorch See pytorch for installation Codes in branch “master” works with pytorch 0.4 Codes in branch “pytorch0.3” works with pytorch 0.3 cuda (CPU version is not implemented yet) Usage (demo) python main.py –resize_ratio 0.5 –weight 2 –img_A_path data/demo/ava.png –img_BP_path data/demo/mona.png –use_cuda True GitHub https://github.com/Ben-Louis/Deep-Image-Analogy-PyTorch    

Read more
Network

Pytorch implementation of i-RevNets

i-RevNet: Deep Invertible Networks Pytorch implementation of i-RevNets. i-RevNets define a family of fully invertible deep networks, built from a succession of homeomorphic layers. Reference: Jörn-Henrik Jacobsen, Arnold Smeulders, Edouard Oyallon. i-RevNet: Deep Invertible Networks. International Conference on Learning Representations (ICLR), 2018. (https://iclr.cc/) The i-RevNet and its dual. The inverse can be obtained from the forward model with minimal adaption and is an i-RevNet as well. Read the paper for theoretical background and detailed analysis of the trained models. Pytorch […]

Read more
PyTorch

An implementation of shampoo, proposed in Shampoo

shampoo.pytorch An implementation of shampoo, proposed in Shampoo : Preconditioned Stochastic Tensor Optimization by Vineet Gupta, Tomer Koren and Yoram Singer. # Suppose the size of the tensor grad (i, j, k), # dim_id = 1 and dim = j grad = grad.transpose_(0, dim_id).contiguous() # (j, i, k) transposed_size = grad.size() grad = grad.view(dim, -1) # (j, i x k) grad_t = grad.t() # (i x k, j) precond.add_(grad @ grad_t) # (j, j) inv_precond.copy_(_matrix_power(state[precond, -1 / order)) # (j, […]

Read more
Images

PyTorch NIMA: Neural IMage Assessment

PyTorch NIMA: Neural IMage Assessment PyTorch implementation of Neural IMage Assessment by Hossein Talebi and Peyman Milanfar. You can learn more from this post at Google Research Blog. Installing Docker docker run -it truskovskiyk/nima:latest /bin/bash PYPI package (In Progress) pip install nima VirtualEnv git clone https://github.com/truskovskiyk/nima.pytorch.git cd nima.pytorch virtualenv -p python3.7 env source ./env/bin/activate Dataset The model was trained on the AVA (Aesthetic Visual Analysis) datasetYou can get it from hereHere are some examples of images with theire scores Pre-train […]

Read more
Python

Python’s ChainMap: Manage Multiple Contexts Effectively

Sometimes when you’re working with several different dictionaries, you need to group and manage them as a single one. In other situations, you can have multiple dictionaries representing different scopes or contexts and need to handle them as a single dictionary that allows you to access the underlying data following a given order or priority. In those cases, you can take advantage of Python’s ChainMap from the collections module. ChainMap groups multiple dictionaries and mappings in a single, updatable view […]

Read more
QUESTION ANSWERING

Baseline code for Korean open domain question answering

Open-Domain Question Answering(ODQA)는 다양한 주제에 대한 문서 집합으로부터 자연어 질의에 대한 답변을 찾아오는 task입니다. 이때 사용자 질의에 답변하기 위해 주어지는 지문이 따로 존재하지 않습니다. 따라서 사전에 구축되어있는 Knowledge Resource(본 글에서는 한국어 Wikipedia)에서 질문에 대답할 수 있는 문서를 찾는 과정이 필요합니다. VumBleBot은 ODQA 문제를 해결하기 위해 설계되었습니다. 질문에 관련된 문서를 찾아주는 Retriever, 관련된 문서를 읽고 간결한 답변을 내보내주는 Reader가 구현되어 있습니다. 이 두 단계를 거쳐 만들어진 VumBleBot은 어떤 어려운 질문을 던져도 척척 답변을 해주는 질의응답 시스템입니다. bookmark_tabs Wrap-up report에 모델, 실험 […]

Read more
Transformer

Keeping Your Eye on the Ball Trajectory Attention in Video Transformers with python

Motionformer This is an official pytorch implementation of paper Keeping Your Eye on the Ball: Trajectory Attention in Video Transformers. In this repository, we provide PyTorch code for training and testing our proposed Motionformer model. Motionformer use proposed trajectory attention to achieve state-of-the-art results on several video action recognition benchmarks such as Kinetics-400 and Something-Something V2. If you find Motionformer useful in your research, please use the following BibTeX entry for citation. @misc{patrick2021keeping, title={Keeping Your Eye on the Ball: Trajectory […]

Read more
1 … 546 547 548 549 550 … 939