August 5, 2021 Beginner, Machine Learning, NLP, Project, Python, Text

Identifying The Language of A Document Using NLP!

This article was published as a part of the Data Science Blogathon Introduction The goal of this article is to identify the language from the written text. The text in documents is available in many languages and when we don’t know the language it becomes very difficult sometimes to tell this to google translator as well. For most translators, we have to tell both the input language and the desired language. If you had a text written in Spanish and you […]

August 5, 2021 Python

NumPy views: saving memory, leaking memory, and subtle bugs

If you’re using Python’s NumPy library, it’s usually because you’re processing large arrays that use plenty of memory. To reduce your memory usage, chances are you want to minimize unnecessary copying, NumPy has a built-in feature that does this transparently, in many common cases: memory views. However, this feature can also cause higher memory usage by preventing arrays from being garbage collected. And in some cases it can cause bugs, with data being mutated in unexpected ways. To avoid these […]

August 4, 2021 Graph

Continuous Query Decomposition for Complex Query Answering in Incomplete Knowledge Graphs

Continuous Query Decomposition Continuous Query Decomposition for Complex Query Answering in Incomplete Knowledge Graphs Update We implemented CQD in the KGReasoning framework, a library from SNAP implementing several Complex Query Answering models, which also supports experimenting with the Query2Box and BetaE datasets (in this repo, we only consider the former). Our implementation is available at this link. This repository contains the official implementation for our ICLR 2021 (Oral, Outstanding Paper Award) paper, Complex Query Answering with Neural Link Predictors: @inproceedings{ […]

August 4, 2021 Attack

A Python framework for adversarial attacks and model training in NLP

TextAttack TextAttack is a Python framework for adversarial attacks, data augmentation, and model training in NLP. If you’re looking for information about TextAttack’s menagerie of pre-trained models, you might want the TextAttack Model Zoo page. Slack Channel For help and realtime updates related to TextAttack, please join the TextAttack Slack! Why TextAttack? There are lots of reasons to use TextAttack: Understand NLP models better by running different adversarial attacks on them and examining the output Research and develop different NLP […]

August 4, 2021 Network

Dynamic Hybrid Relation Network for Cross-Domain Context-Dependent Semantic Parsing

R²SQL The PyTorch implementation of paper Dynamic Hybrid Relation Network for Cross-Domain Context-Dependent Semantic Parsing. (AAAI 2021) Requirements The model is tested in python 3.6 with following requirements: torch==1.0.0 transformers==2.10.0 sqlparse pymysql progressbar nltk numpy six spacy All experiments on SParC and CoSQL datasets were run on NVIDIA V100 GPU with 32GB GPU memory. Tips: The 16GB GPU memory may appear out-of-memory error. Setup The SParC and CoSQL experiments in two different folders, you need to download different datasets from […]

August 4, 2021 Generator

Procedural 3D data generation pipeline for architecture in python

Synthetic Dataset Generator This is a tool that generates a dataset of synthetic buildings of different typologies. The generated data includes: Mesh files of generated buildings, .obj format Rendered images of the mesh, .png format Rendered segmentation masks, .png format Depth annotation, .png and .exr format Surface normals annotation, .png format Point cloud files, .ply format (the number of points by default is 2048, can be changed in dataset_config.py) How To Use Install Blender>=2.90. After installation make sure to add […]

August 4, 2021 Tutorial

How to setup a multi-client ethereum Eth1-Eth2 merge testnet with python

Mergenet tutorial How to setup a multi-client ethereum Eth1-Eth2 merge testnet with python Preparing the setup environment In this tutorial, we use a series of scripts to generate configurationfiles, and these scripts have dependencies that we need toinstall. You can either install these dependencies on your host or youcan run those scripts inside a docker container. We call thisenvironment setupenv. Preparing the setup environment on your host: apt-get install python3-dev python3-pip python3-venv golang # Check that you have Go 1.16+ […]

August 4, 2021 Command-line Tools

Like the unix tree command but for GCP Org Heirarchy

gcptree Like the unix tree command but for GCP Org Heirarchy. For a note on coloring, the org node is green, folders and blue, and projects that are not ACTIVE are dimmed. These styles won’t show up if you redirect output and Windows is supported by virtue of the colorama package. pip install gcptree First make sure you are authenticated to gcloud and have your application default credentials set using: gcloud auth login –update-adc You just need your org id, […]

August 4, 2021 IRC

A bouncer-style Matrix IRC bridge in python

Heisenbridge a bouncer-style Matrix IRC bridge. Heisenbridge brings IRC to Matrix by creating an environment where every user connects to each network individually like they would with a traditional IRC bouncer. Simplicity is achieved by exposing IRC in the most straightforward way as possible where it makes sense so it feels familiar for long time IRC users. Please file an issue when you find something is missing or isn’t working that you’d like to see fixed. Pull requests are more […]

August 4, 2021 Tool

A collection of Blender tools Build With Python

A collection of Blender tools I’ve written for myself over the years. I use these daily so they should be bug-free, mostly. Feel free to take and use any parts of this project. gret can be typed with one hand in the search bar. Blender 2.92 or later required. Download the latest release. In Blender, go to Edit → Preferences → Add-ons → Install. Find and select the downloaded zip file, then click Install Add-on. Enable the add-on by clicking […]

« 1 … 564 565 566 567 568 … 972 »