Repository for the Bias Benchmark for QA dataset

Repository for the Bias Benchmark for QA dataset. Authors: Alicia Parrish, Angelica Chen, Nikita Nangia, Vishakh Padmakumar, Jason Phang, Jana Thompson, Phu Mon Htut, and Samuel R. Bowman. About BBQ It is well documented that NLP models learnsocial biases present in the world, but littlework has been done to show how these biasesmanifest in actual model outputs for appliedtasks like question answering (QA). We introduce the Bias Benchmark for QA (BBQ), adataset consisting of question-sets constructedby the authors that highlightattestedsocialbiases […]

Read more

Map Compressibility Assessment for LiDAR Registration

This repo contains the released version of code and datasets used for our IROS 2021 paper: “Map Compressibility Assessment for LiDAR Registration [link]. If you find the code useful for your work, please cite: @inproceedings{Chang21iros, author = {M.-F. Chang and W. Dong and J.G. Mangelson and M. Kaess and S. Lucey}, title = {Map Compressibility Assessment for {LiDAR} Registration}, booktitle =    

Read more

Gait Recognition in the Wild: A Benchmark

GREW-BENCHMARCH This repository contains the code for our ICCV 2021 paper Gait Recognition in the Wild: A Benchmark GREW-BENCHMARK project is mainly maintained By Xianda Guo and Zheng Zhu. For all main contributors, please check contributing. Dataset Download GREW datasets. You can decompress the compressed package with the following command unzip -P password train.zip (password 是要解压的密码 ) tar -xzvf train.tgz cd train ls *.tgz | xargs -n1 tar xzvf Folder structure after decompression is as follows:

Read more

Load and performance benchmark tool in python

Yandextank has been moved to Python 3. Latest stable release for Python 2 here. Yandex.Tank is an extensible open source load testing tool for advanced linux users which is especially good as a part of an automated load testing suite Main features different load generators supported: Evgeniy Mamchits’ phantom is a very fast (100 000+ RPS) shooter written in C++ (default) JMeter is an extendable and widely known one BFG is a Python-based generator that allows you to write your […]

Read more

OpenMMLab Semantic Segmentation Toolbox and Benchmark

MMSegmentation MMSegmentation is an open source semantic segmentation toolbox based on PyTorch. It is a part of the OpenMMLab project. The master branch works with PyTorch 1.3+. Major features Unified Benchmark We provide a unified benchmark toolbox for various semantic segmentation methods. Modular Design We decompose the semantic segmentation framework into different components and one can easily construct a customized semantic segmentation framework by combining different modules. Support of multiple methods out of box The toolbox directly supports popular and […]

Read more

Raster processing benchmarks for Python and R packages

Raster processing benchmarks This repository contains a collection of raster processing benchmarks for Python and R packages. The tests cover the most common operations such as loading data, extracting values by points, downsampling, calculating NDVI, writing multilayer, cropping by extent and calculating zonal statistics. The comparison is made from the user’s perspective (the simplest functions are used and the code is not optimized), so the results do not represent the best performance. The detailed results are available at https://kadyb.github.io/raster-benchmark/report.html. Reproduction […]

Read more