June 19, 2021 NLP

Connecting What to Say With Where to Look by Modeling Human Attention Traces

June 17, 2021 By: Zihang Meng, Licheng Yu, Ning Zhang, Tamara Berg, Babak Damavandi, Vikas Singh, Amy Bearman Abstract We introduce a unified framework to jointly model images, text, and human attention traces. Our work is built on top of the recent Localized Narratives annotation framework, where each word of a given caption is paired with a mouse trace segment. We propose two novel tasks: (1) predict a trace given an image and caption (i.e., visual grounding), and (2) predict […]

June 19, 2021 PyTorch

PyTorch implementation and pretrained models for XCiT models

Cross-Covariance Image Transformer (XCiT) PyTorch implementation and pretrained models for XCiT models. See XCiT: Cross-Covariance Image Transformer Linear complexity in time and memory Our XCiT models has a linear complexity w.r.t number of patches/tokens: Peak Memory (inference) Millisecond/Image (Inference) Scaling to high resolution inputs XCiT can scale to high resolution inputs both due to cheaper compute requirement as well as better adaptability to higher resolution at test time (see Figure 3 in the paper) Detection and Instance Segmentation for Ultra […]

June 19, 2021 Games

Partially-observed visual reinforcement learning domain

CowHerd CowHerd is a partially-observed reinforcement learning environment, where the player walks around an area and is rewarded for milking cows. The cows try to escape and the player can place fences to help capture them. The implementation of CowHerd is based on the Crafter environment. Play Yourself You can play the game yourself with an interactive window and keyboard input.The mapping from keys to actions, health level, and inventory state are printedto the terminal. # Install with GUI pip3 […]

June 19, 2021 Tool

The REDLI Tool follows the path of the URL

redli v1.0 Have you ever wondered: Where does this link go? The REDLI Tool follows the path of the URL. It allows you to see the complete path a redirected URL goes through. It will show you the full redirection path of URLs, shortened links, or tiny URLs. Requirements Python 3, requests and colorama libraries. Update: apt-get update Python 3: apt-get install python3 Requests: pip install requests colorama: pip install colorama Kali Linux / Termux git clone https://github.com/JayaKumar-pypro/redli.git cd redli […]

June 19, 2021 Machine Learning

Simulate the notspot quadrupedal robot using Gazebo and ROS with python

Notspot robot simulation – Python version This repository contains all the files and code needed to simulate the notspot quadrupedal robot using Gazebo and ROS. The software runs on ROS noetic and Ubuntu 20.04. If you want to use a different ROS version, you might have to do some changes to the source code. Setup cd src && catkin_init_workspace cd .. && catkin_make source devel/setup.bash roscd notspot_controller/scripts && chmod +x robot_controller_gazebo.py cp -r RoboticsUtilities ~/.local/lib/python3.8/site-packages roscd notspot_joystick/scripts && chmod +x […]

June 19, 2021 Robot

A personal assistant chatbot capable to perform many tasks same as Google Assistant plus

PersonalAssistant It is an Personal Assistant, capable to perform many tasks with some unique features, that you haven’e seen yet…. Features / Tasks it can perform: Game (eg, Rock Paper Scissor with GUI) Search anything from wikipedia, google maps, etc Play video from YouTube Email Sender WhatsApp Message Sender COVID Tracker Weather Jokes News High Security (Face Unlock) Capture Photo Math Calculations Timer In-built search image display Smart Dictionary Search OS Info, Battery Info Window, Tab Operations Opening Websites File […]

June 19, 2021 Adaptation

LoRA: Low-Rank Adaptation of Large Language Models

LoRA This repo contains the implementation of LoRA in GPT-2 and steps to replicate the results in our recent paper LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu*, Yelong Shen*, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Weizhu ChenPaper: https://arxiv.org/abs/2106.09685 LoRA reduces the number of trainable parameters by learning pairs of rank-decompostion matrices and freezing the original weights. This vastly reduces the storage requirement for large language models adapted to specific tasks and enables efficient task-switching during deployment […]

June 19, 2021 Dungeondraft

Utility to extract Fantasy Grounds Unity Line-of-sight and lighting files from a Univeral VTT file exported

uvtt2fgu Utility to extract Fantasy Grounds Unity Line-of-sight and lighting files from a Univeral VTT file exported from Dungeondraft This program works with Fantasy Grounds Unity v4.1 or higher as that is the version where dynamic lighting effects were added. This was last used with Dungeondraft v1.0.1.3. Requirements uvtt2fgu.py requires a python3 installation with PIP. Usage Create your map in Dungeondraft Export the map in Universal VTT format You do not have to use the default “Best Quality” Grid Preset. […]

June 19, 2021 Images

Pipeline for chemical image-to-text competition

BMS-Molecular-Translation Pipeline for chemical image-to-text competition. This is a pipeline for Bristol-Myers Squibb – Molecular Translation by Vadim Timakin and Maksim Zhdanov. We got bronze medals in this competition. Significant part of code was originated from Y.Nakama’s notebook This competition was about image-to-text translation of images with molecular skeletal strucutures to InChI chemical formula identifiers. InChI=1S/C16H13Cl2NO3/c1-10-2-4-11(5-3-10)16(21)22-9-15(20)19-14-8-12(17)6-7-13(14)18/h2-8H,9H2,1H3,(H,19,20) Solution General Encoder-Decoder concept Most participants used CNN encoder to acquire features with decoder (LSTM/GRU/Transformer) to get text sequences. That’s a casual approach to […]

June 19, 2021 Natural Language Processing

An Efficient Pipeline For Bloom’s Taxonomy Using Natural Language Processing

Pipeline-For-NLP-With-Blooms-Taxonomy Pipeline For NLP with Bloom’s Taxonomy Using Improved Question Classification and Question Generation using Deep Learning This repository contains all the source code that is needed for the Project : An Efficient Pipeline For Bloom’s Taxonomy with Question Generation Using Natural Language Processing and Deep Learning. Outline : An examination assessment undertaken by educational institutions is an essential process, since it is one of the fundamental steps to determine a student’s progress and achievements for a distinct subject or […]

« 1 … 607 608 609 610 611 … 927 »