NLP

Issue #128 – Using Context in Neural MT Training Objectives

29 Apr21 Issue #128 – Using Context in Neural MT Training Objectives Author: Dr. Danielle Saunders, Research Scientist @ RWS We have a guest post this week, but it’s not really a “guest” as the recently acquired SDL team joins forces with Iconic as part of RWS! Nevertheless, we are pleased to have Dr. Danielle Saunders describe her most recent paper on using context in Minimum Risk Training to improve machine translation tuning and to fix hallucinations. Enjoy! Introduction In […]

Read more
Maps

A python package that extends Google Earth Engine

eemont Google Earth Engine is a cloud-based service for geospatial processing of vector and raster data. The Earth Engine platform has a JavaScript and a Python API with different methods to process geospatial objects. Google Earth Engine also provides a HUGE PETABYTE-SCALE CATALOG of raster and vector data that users can process online (e.g. Landsat Missions Image Collections, Sentinel Missions Image Collections, MODIS Products Image Collections, World Database of Protected Areas, etc.). The eemont package extends the Google Earth Engine […]

Read more
Database

Data testing and monitoring for SQL accessible data

Soda SQL Data testing, monitoring, and profiling for SQL-accessible data. Soda SQL is an open-source command-line tool. It utilizes user-defined input to prepare SQL queries that run tests on tables in a data warehouse to find invalid, missing, or unexpected data. When tests fail, they surface “bad” data that you can fix to ensure that downstream analysts are using “good” data to make decisions. Test your data If your organization uses data to make decisions, you should always be testing […]

Read more
Machine Learning

Python package to study microbial communities using metabolic modeling

MICOM MICOM is a Python package for metabolic modeling of microbial communities currently developed in the Gibbons Lab at the Institute for Systems Biology and the Human Systems Biology Group of Prof. Osbaldo Resendis Antonio at the National Institute of Genomic Medicine Mexico. MICOM allows you to construct a community model from a list on input COBRA models and manages exchange fluxes between individuals and individuals with the environment. It explicitly accounts for different abundances of individuals in the community […]

Read more
Graph

Quickly visualize docker networks with graphviz

Docker Network Graph Visualize the relationship between Docker networks and containers as a neat graphviz graph. Usage usage: docker-net-graph.py [-h] [-v] [-o OUT] Visualize docker networks. optional arguments: -h, –help show this help message and exit -v, –verbose Verbose output -o OUT, –out OUT Write output to file In most cases what you want to run are the following couple commands: git clone https://github.com/LeoVerto/docker-network-graph.git cd docker-network-graph pipenv install pipenv run python docker-net-graph.py -o output.svg This will generate an .svg file […]

Read more
Images

A CNN based image segmentation tool oriented to marine data analysis

TagLab TagLab was created to support the activity of annotation and extraction of statistical data from ortho-maps of benthic communities. The tool includes different types of CNN-based segmentation networks specially trained for agnostic (relative only to contours) or semantic (also related to species) recognition of corals. Interaction TagLab allows to : zoom and navigate a large map using (zoom/mouse wheel, pan/’Move’ tool selected + left button). With every other tool selected the pan is activated with ctrl + left button […]

Read more
Python

Build a Platform Game in Python With Arcade

For many video game players, the lure of writing games is a prime reason to learn computer programming. However, building a 2D platform game such as Lode Runner, Pitfall!, or Super Mario Bros. without proper tools or guidance can leave you frustrated. Fortunately, the Python arcade library makes creating a 2D game in Python accessible for many programmers! If you haven’t already heard about it, the arcade library is a modern Python framework for crafting games with compelling graphics and […]

Read more
Download

Download all Snapchat video & photo memories with python

Snapchat “Memories” Fetcher In compliance with the California Consumer Privacy Act of 2018 (“CCPA”), businesses which collect and store user data must allow customers the ability to request data the company has collected about the requesting user: “… you may ask businesses to disclose what personal information they have about you and what they do with that information, to delete your personal information and not to sell your personal information. You also have the right to be notified, before or […]

Read more
Network

A simple URL shortener built with Flask

URL Shortener A simple URL shortener built with Flask and MongoDB. Getting Started With Docker Prerequisites Running From your terminal/command prompt run: docker-compose up Then point your browser to http://127.0.0.1:5000/. Without Docker Installing Requirements (Optional) Install virtualenv andvirtualenvwrapper and create a new environment. Run pip install -r requirements.txt. Setting up MongoDB You can either: Install MongoDB locally by going here. or: Configuration The following properties can be configured: Name Purpose Default DEBUG If debug mode is enabled. False ENV Environment […]

Read more
Tool

Build custom OSINT tools and APIs with python

osint Build custom OSINT tools and APIs with this python package! It includes different OSINT modules for performing reconnaissance on the target, and a built-in database for mapping and visuialzing some of the reconnaissance results. The final results is a json output that can be intergrated with other projects Install pip3 install osint Usage Example – Scan ips or domains for http and https #Remember you need higher privileges from osint import QBDns, QBScan targets = QBDns().convert_to_ips([“http://test.com”,”1.2.3.4″] ) targets = […]

Read more
1 … 666 667 668 669 670 … 935