Scripts

A toy compiler that can convert Python scripts to pickle bytecode

Pickora A small compiler that can convert Python scripts to pickle bytecode. Requirements No third-party modules are required. Usage usage: pickora.py [-h] [-d] [-r] [-o OUTPUT] file A toy compiler that can convert Python scripts to pickle bytecode. positional arguments: file the Python script to compile optional arguments: -h, –help show this help message and exit -d, –dis disassamble compiled pickle bytecode -r, –eval, –run run the pickle bytecode -o OUTPUT, –output OUTPUT Write compiled pickle to file For exmple, […]

Read more
Json

Import Python modules from dicts and JSON formatted documents

Paker Paker is module for importing Python packages/modules from dictionaries and JSON formatted documents. It was inspired by httpimporter. Installation From PyPI pip install paker From source git clone https://github.com/desty2k/paker.git cd paker pip install . Usage In Python script You can import Python modules directly from string, dict or bytes (without disk IO). import paker import logging MODULE = {“somemodule”: {“type”: “module”, “code”: “fun = lambda x: x**2”}} logging.basicConfig(level=logging.NOTSET) if __name__ == ‘__main__’: with paker.loads(MODULE) as loader: # somemodule will […]

Read more
HTTP

Module for remote in-memory Python package/module loading through HTTP/S

httpimport Remote, in-memory Python package/module importing through HTTP/S A feature that Python2/3 misses and has become popular in other languages is the remote loading of packages/modules. httpimport lets Python2/3 packages and modules to be imported directly in Python interpreter’s process memory, through remote URIs, and more… Examples Load a simple package/module through HTTP/S >>> with httpimport.remote_repo([‘package1′,’package2′,’package3’], ‘http://my-codes.example.com/python_packages’): … import package1 … Load directly from a GitHub/BitBucket/GitLab repo Load a python file from a github-gist (using this gist): import httpimport url […]

Read more
Download

Python script to automatically download from Zippyshare

Zippyshare downloader and Links Extractor Python script to automatically download from Zippyshare using Selenium package and Internet Download Manager. Download IDM from here for downloading multiple files. Run the main.py script after checking the Requirements preferrably in a virtual env. See features for usage examples. The Links will be saved in a text file which can then be imported to idm from: Tasks>Import>from text file Other option is set the START_DOWNLOADING variable to 1 in the config file which will […]

Read more
Maps

A ninja Python package behind rgee, rgeeExtra and eemont

A ninja Python package behind rgee, rgeeExtra and eemont. Google Earth Engine is a cloud-based service for geospatial processing of vector and raster data. The Earth Engine platform has a JavaScript and a Python API with different methods to process geospatial objects. Google Earth Engine also provides a HUGE PETABYTE-SCALE CATALOG of raster and vector data that users can process online (e.g. Landsat Missions Image Collections, Sentinel Missions Image Collections, MODIS Products Image Collections, World Database of Protected Areas, etc.). […]

Read more
Command-line Tools

view RedFlagDeals.com from the command line

RFD This is a CLI utility that allows you to view RedFlagDeals.com on the command line. Motivation It is often faster to use a CLI than to load up a web page and navigate web elements. This tool can search for deals and sort them based on score and views. It is also able to load entire threads (without pagination) for additional analysis. Installation :information_source: python2 may still work but it is no longer supported. python3 -m pip install –user […]

Read more
Neural Machine Translation (NMT), NMT Leave a comment

Machine Translation Weekly 85: The Incredibility of MT Evaluation

This week, I will comment on a paper that quantifies and exactly measures the dimensions of the elephant in the room of machine translation: the lack of empirical support of claims in research papers on machine translation. The title of the paper is Scientific Credibility of Machine Translation Research: A Meta-Evaluation of 769 Papers, it has awill appear at this year’s ACL.uthors from NICT in Japan and was awarded as an oustanding paper ACL 2021. The authors manually annotated an […]

Read more
NLP

Hugging Face – Issue 10 – Jun 15th 2021

Events & Talks 📗Chapter 3: Fine-tuning a pretrained model This chapter will teach you all about training NLP models. Two versions are available; one using PyTorch, showing the Trainer API and the Hugging Face Accelerate library; and the other one using TensorFlow, showing how to leverage NLP models using Keras. Join either live session to cover Chapter 3 with us! Chapter 3 — PyTorch, with Lewis (Twitter/LinkedIn): Wednesday, June 30th (8:00-9:00 UTC) Chapter 3 — PyTorch,    

Read more
PDF

Uses PyPDF3 for reading and writing PDF files written in python

pystitcher pystitcher stitches your PDF files together, generating nice customizable bookmarks for you using a declarative input in the form of a markdown file. It is written in pure python and uses PyPDF3 for reading and writing PDF files. pystitcher is a command line tool, with very few cli options: usage: pystitcher [-h] [–version] [-v] [–cleanup | –no-cleanup] spine.md output.pdf Stitch PDF files together positional arguments: spine.md Input markdown file output.pdf Output PDF file optional arguments: -h, –help show this […]

Read more
Machine Learning

Polygon Yolov5 with adjustments to enable polygon prediction boxes

Polygon-Yolov5 This repository is based on Ultralytics/yolov5, with adjustments to enable polygon prediction boxes. Section I. Description The codes are based on Ultralytics/yolov5, and several functions are added and modified to enable polygon prediction boxes. The modifications compared with Ultralytics/yolov5 and their brief descriptions are summarized below: data/polygon_ucas.yaml : Exemplar UCAS-AOD dataset to test the effects of polygon boxes data/images/UCAS-AOD : For the inference of polygon-yolov5s-ucas.pt models/common.py :3.1. class Polygon_NMS : Non-Maximum Suppression (NMS) module for Polygon Boxes3.2. class Polygon_AutoShape […]

Read more
1 … 583 584 585 586 587 … 940