Data pipeline architecture for onboarding public datasets to Datasets for Google Cloud

Public Datasets Pipelines Cloud-native, data pipeline architecture for onboarding public datasets to Datasets for Google Cloud. We use Pipenv to make environment setup more deterministic and uniform across different machines. If you haven’t done so, install Pipenv using the instructions found here. Now with Pipenv installed, run the following command: pipenv install –ignore-pipfile –dev This uses the Pipfile.lock found in the project root and installs all the development dependencies. Finally, initialize the Airflow database: pipenv run airflow initdb Configuring, generating, […]

Read more

Recurrent Multi-view Alignment Network for Unsupervised Surface Registration

RMA-Net This repo is the implementation of the paper: Recurrent Multi-view Alignment Network for Unsupervised Surface Registration (CVPR 2021). Paper address: https://arxiv.org/abs/2011.12104 Project webpage: https://wanquanf.github.io/RMA-Net.html Prerequisite Installation The code has been tested with Python3.8, PyTorch 1.6 and Cuda 10.2: conda create –name rmanet conda activate rmanet conda install pytorch=1.6.0 torchvision=0.7.0 cudatoolkit=10.2 -c pytorch conda install -c conda-forge igl Other requirements include: eigen3, Openmesh and MeshlabServer. Build the cuda extension: python build_cuda.py Usage Pre-trained Models Download the pre-trained models and put […]

Read more

A look-ahead multi-entity Transformer for modeling coordinated agents in python

baller2vec++ This is the repository for the paper: Michael A. Alcorn and Anh Nguyen. baller2vec++: A Look-Ahead Multi-Entity Transformer For Modeling Coordinated Agents. arXiv. 2021. To learn statistically dependent agent trajectories, baller2vec++ uses a specially designed self-attention mask to simultaneously process three different sets of features vectors in a single Transformer. The three sets of feature vectors consist of location feature vectors like those found in baller2vec, look-ahead trajectory feature vectors, and starting location feature vectors. This design allows the […]

Read more

A Telegram bot to all media and documents files to web link

FileStreamBot Telegram File to Link Fastest Bot , also used for movies streaming This bot will give you stream links for Telegram files without the need of waiting till the download completes ♢ How to make your own : Either you could locally host or deploy on Heroku ♢ Click on This Drop-down and get more details Deploy on Heroku : Fork This Repo Click on Deploy Easily So Follow Above Steps 👆 and then also deply other wise not […]

Read more

AWS Data Engineering Pipeline with python

AWS Data Engineering Pipeline This is a repository for the Duke University Cloud Computing course project on Serverless Data Engineering Pipeline. For this project, I recreated the below pipeline in iCloud9 (reference: https://github.com/noahgift/awslambda): Below are the steps of how to build this pipeline in AWS: 1️⃣ Create a new iCloud9 environment dedicated to this project. 🤔 Need a refresher? Please check this repo. ⚠️ Make sure to use name as your unique id for your items in the fang table. […]

Read more

Udemy Downloader with DRM support in python

udemy-downloader A Udemy downloader that can download DRM protected videos and non-DRM protected videos. Simple program to download a Udemy course, has support for DRM videos but requires the user to aquire the decryption key (for legal reasons). Windows is the primary development OS, but I’ve made an effort to support linux also. You would need to download ffmpeg, aria2c, mp4decrypt (from Bento4 SDK) and yt-dlp (pip install yt-dlp). Ensure they are in the system path (typing their name in […]

Read more

Display spotify listening status on READMEs with python

Spotify playing README A really easy way to display your spotify listening status on READMEs and Websites too! Demo Here’s the embed of Card from the site. Customized card, with theming Security notice As a security notice, We’re not storing any of the sensitive tokens, We just store theaccess tokens securely, used for generating temporary refresh tokens, and getting just the status data, withonly read permissions and scopes. You can check it in the configuration file for the scopes. URL […]

Read more

Python and REST APIs: Interacting With Web Services

In this section, you’ll look at three popular frameworks for building REST APIs in Python. Each framework has pros and cons, so you’ll have to evaluate which works best for your needs. To this end, in the next sections, you’ll look at a REST API in each framework. All the examples will be for a similar API that manages a collection of countries. The fields name, capital, and area store data about a specific country somewhere in the world. Most […]

Read more

A simple text editor build with python

WhirlEdit WhirlEdit the simple text editor. v3 will include great features.. some of them are > multi-language syntax highlighting (thanks to @rdbende for tkcode) > Side bar – > Files – > Looks – > Settings > minor bug fix > and more to come.. v3 as of now CHANGELOG: v2: > complete rewrite > python syntax > tabs > scrollbar fix > key bindings > runner > new theme (azure ttk theme) > made with ttk instead of tk […]

Read more

A Python-based application demonstrating various search algorithms

Algorithmic-Maze-Runner A Python-based application demonstrating various search algorithms, namely Depth-First Search (DFS), Breadth-First Search (BFS), and the A* Search (using the Manhattan Distance Heuristic) Running the .py File Clone the repository Install dependencies by entering pip install – r requirements.txt Run the .py file Files main.py: python file for application main.exe: executable version of main.py GitHub https://github.com/flintlok/Algorithmic-Maze-Runner    

Read more
1 517 518 519 520 521 903