Deep Learning, NLP, NMT, AI, ML
To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies. Learn more, including about available controls: Cookies Policy I Agree
Read more
Abstract Attention mechanisms have shown promising results in sequence modeling tasks that require long term memory. Recent work investigated mechanisms to reduce the computational cost of preserving and storing memories (Rae et al., 2020). However, not all content in the past is equally important to remember. We propose Expire-Span, a method that learns to retain the most important information and expire the irrelevant information. This forgetting of memories enables Transformers to scale to attend over tens of thousands of previous […]
Read more
Abstract Pretraining and multitask learning are widely used to improve the speech to text translation performance. In this study, we are interested in training a speech to text translation model along with an auxiliary text to text translation task. We conduct a detailed analysis to understand the impact of the auxiliary task on the primary task within the multitask learning framework. Our analysis confirms that multitask learning tends to generate similar decoder representations from different modalities and preserve more information […]
Read more
August 23, 2021 By: Jacob Donley, Vladimir Tourbabin, Boaz Rafaely, Ravish Mehra Abstract Automated solutions to multi-channel signal enhancement for improving speech communication in noisy environments has become a popular goal among the research community. Many proposed approaches focus on adapting to speech signals based on their temporal characteristics but these methods are primarily limited to specific types of desired and undesired sound sources. This paper outlines a new method to adapt to desired and undesired signals using their spatial […]
Read more
rcpm This repository is by Brandon Amos, Samuel Cohen and Yaron Lipman and contains the JAX source code to reproduce the experiments in our ICML 2021 paper on Riemannian Convex Potential Maps. Modeling distributions on Riemannian manifolds is a crucial component in understanding non-Euclidean data that arises, e.g., in physics and geology. The budding approaches in this space are limited by representational and computational tradeoffs. We propose and study a class of flows that uses convex potentials from Riemannian optimal […]
Read more
OrienMask This repository implements the framework OrienMask for real-time instance segmentation. It achieves 34.8 mask AP on COCO test-dev at the speed of 42.7 FPS evaluated with a single RTX 2080Ti. (log) Paper: Real-time Instance Segmentation with Discriminative Orientation Maps Installation Please see INSTALL.md to prepare the environment and dataset. Usage Place the pre-trained backbone (link) and trained model (link) as follows for convenience (otherwise update the corresponding path in configurations): ├── checkpoints │ ├── pretrained │ │ ├──pretrained_darknet53.pth │ […]
Read more
lsf_stats Summarize LSF job properties by parsing log files of workflows executed by Snakemake. Installation $ pip install lsf_stats Usage $ lsf_stats –help Usage: lsf_stats [OPTIONS] COMMAND [ARGS]… Summarize LSF job properties by parsing log files. Options: –version Show the version and exit. –help Show this message and exit. Commands: gather Aggregate information from log files in single dataframe. summarize Summarize and visualize aggregated information. Example Assume that you executed your Snakemake workflow using the lsf-profile and all generated log […]
Read more
Paginator – discord_components This repository is just an example code for how to carry out pagination using the discord_components library for python. Its fairly easy, and once you get the hang of it you can modify it as per your choice 😀 The code contains an in-built timeout feature, where after 10 seconds of inactivity, the buttons are disabled automatically! Pre Requisites Basic knowledge of Python Python 3.7+ installed on your computer Discord Account Libraries Simply install these by running […]
Read more
AdamBNN This is the pytorch implementation of our paper “How Do Adam and Training Strategies Help BNNs Optimization?”, published in ICML 2021.  In this work, we explore the intrisic reasons why Adam is superior to other optimizers like SGD for BNN optimization and provide analytical explanations that support specific training strategies. By visualizing the optimization trajectory, we show that the optimization lies in extremely rugged loss landscape and the second-order momentum in Adam is crucial to revitalize the […]
Read more
Tomcter Python Tomcat Login Bruteforce ⚡ Installing / Getting started A quick guide of how to install and use Tomcter. 1. Clone the repository with git clone https://github.com/oppsec/tomcter.git 2. Install the libraries with pip3 install -r requirements.txt 3. Insert the targets URL on src/core/data/urls.txt file (ex: https://www.google.com) 4. Run Tomcter with python3 main.py 🐳 Docker If you want to use Tomcter in a Docker container, follow this commands: 1. Clone the repository – git clone https://github.com/oppsec/tomcter.git 2. Build the image […]
Read more