A Generalization of Transformer Networks to Graphs

Source code for the paper “A Generalization of Transformer Networks to Graphs” by Vijay Prakash Dwivedi and Xavier Bresson, at AAAI’21 Workshop on Deep Learning on Graphs: Methods and Applications (DLG-AAAI’21). We propose a generalization of transformer neural network architecture for arbitrary graphs: Graph Transformer. Compared to the Standard Transformer, the highlights of the presented architecture are: The attention mechanism is a function of neighborhood connectivity for each node in the graph. The position encoding is represented by Laplacian eigenvectors, […]

Read more

Machine Translation Weekly 95: Minimum Bayes Risk Decoding – the Cooler the Metric, the Cooler it gets

This week I am returning to a topic that I follow with fascination (cf. MT Weekly #20, #61, #63, and #66) without actually doing any research myself – decoding in machine learning models. The preprint I will discuss today comes from Google Research and has the title Minimum Bayes Risk Decoding with Neural Metrics of Translation Quality. It shows that Minimum Bayes Risk (MBR) decoding can outperform beam search when done properly and that there might be some serious problems […]

Read more

When you should switch to Python 3.10

Python 3.10 is now available–but should you switch to it immediately? And if not now, when? The short answer after its immediate release was, no, you probably don’t want to switch immediately; quite possibly you can’t switch immediately. Now that some time has passed, we’re getting closer to yes, or at least a maybe. To understand why, we need to consider Python packaging, the software development process, and take a look at the history of past releases. We can then […]

Read more

Buying products for your job: estimating value, convincing your boss

You’ve discovered a product that might help you with your job: perhaps a book that will teach you a new and relevant skill, or software that will speed up development. Since you do want to write software better and faster, you are considering buying this product. But, then again, the product costs money, and maybe that money is better spent on something else. So should you buy the product or not? How do you decide? And if it is worth […]

Read more

Pymongo based CLI client, to run operation on existing databases and collections

Pymongo based CLI client, to run operation on existing databases and collections Program developed by Gustavo Wydler Azuaga – 12-01-2021 NOTE: Program screenshots can be viewed in the Screenshots folder Program description: The program is a command line interface client developed in python, which uses the pymongo libraries to connect to existing databases, and run operations and queries. It is an interactive program based on numbered options. Requirements to operate the program: Mongo server running on localhost At least one […]

Read more

Fast subdomain scanner, Takes arguments from a Json file (“args.json”) and outputs the subdomains

Fast subdomain scanner, Takes arguments from a Json file (“args.json”) and outputs the subdomains. File Structure core/ db/ README.md LICENCE subx.py args.json Installation ▶ git clone https://github.com/whoamisec75/subx.git ▶ cd subx ▶ python3 subx.py Usage First add domain, concurrency, wordlist in args.json: { “domain”: “google.com”, “concurrency”: 40, “wordlist”: “db/wordlist.txt” } Now run    

Read more

An interactive aquarium for your terminal

An interactive aquarium for your terminal, written using pytermgui. The project got its name from the Common Watersnake, also known as Nerodia Sipedon. It is meant to be an example project for the pytermgui framework, but later down the line might become its own entity as TUI game. Updates might not be too frequent, as the parent framework enjoys priority at the moment. This is a passion project of mine however, so I do not plan on abandoning it. It […]

Read more

Geographical Process Automation with Python on Esri ArcGIS and QGIS

Introducción Python es un potente lenguaje de programación interpretado con licencia de código abierto que soporta orientación a objetos y es comúnmente utilizado para la automatización de tareas en herramientas geográficas en ArcGIS Desktop y QGIS. Las herramientas que hacen parte de Python están disponibles en versiones de 32 y 64 bits, existiendo una limitante de hasta máximo 2GB en el tamaño de los archivos que pueden ser cargados en memoria para sistemas de 32 bits. Para el procesamiento profesional […]

Read more

Create Discord Accounts Semi-Automatically Without Captcha Solving API Key

Create Discord Accounts Semi-Automatically without captcha solving api key IMPORTANT: Your chromedriver version should be the same version as your chrome browser version! Get chromedriver from here: https://chromedriver.chromium.org/downloads Feautures Automatically generate username Automatically generate password Automatically generate email Randomly choose date Automatically get 0Auth token Future Goals Verify account with temporary mail Install all the required python modules: To run this program, you should execute this: You have to fill in the captcha! The program is made to not do […]

Read more
1 375 376 377 378 379 976