Transformer

Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context

This repository contains the code in both PyTorch and TensorFlow for our paper Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context Zihang Dai*, Zhilin Yang*, Yiming Yang, Jaime Carbonell, Quoc V. Le, Ruslan Salakhutdinov (*: equal contribution) Preprint 2018 TensorFlow The source code is in the tf/ folder, supporting (1) single-node multi-gpu training, and (2) multi-host TPU training. Besides the source code, we also provide pretrained “TensorFlow” models with state-of-the-art (SoTA) performances reported in the paper. Please refer to tf/README.md […]

Read more
Command-line Tools

A Python Command line parser for common log format

Command line parser for common log format (Nginx default). Usage It counts most important data: referrers, operating systems, browsers and daily unique visitors (IPs). # Console output python parse.py sitename.log.gz # HTML output python parse.py sitename.log.gz –html ~/sitename/logs.html Install and update PIP packages. pip install -U -r requirements.txt Speed logparser 24,249/s GoAccess 6,234/s Outputs HTML output is based on Jinja2 templates. It can be improved as you see fit. Console output for Subreply for    

Read more
URL

A custom ListView with a header that displays pictures from an URL

What is BlurStickyHeaderListView? It is a custom ListView with a header that displays pictures from an URL. It then adds a nice blur/parallax effect to the downloaded picture. It also provides the option of a sticky title. Here is a video of it in action. How do I use the thing? Add compile ‘me.emmano:blurstickyheaderlistview:0.1.+’ to the dependencies{} in your build.gradle. If you do not aleady have jcenter() added to your project, do so by adding the following to build.gradle: repositories […]

Read more
Plot

Python partial dependence plot toolbox

python partial dependence plot toolbox Motivation This repository is inspired by ICEbox. The goal is to visualize the impact of certain features towards model prediction for any supervised learning algorithm. (now support all scikit-learn algorithms) The common headache When using black box machine learning algorithms like random forest and boosting, it is hard to understand the relations between predictors and model outcome. For example, in terms of random forest, all we get is the feature importance. Although we can know […]

Read more
Natural Language Processing, NLP, Python

The NLP Cypher | 06.06.21

Welcome back to the simulation ✌ . So ACL 2021 data dump happened and now we have a huge list of repos to get through in the Repo Cypher this week. 😁 Also, we are updating the NLP index very soon with 100+ new repos (many of which are mentioned here) alongside 30+ new NLP notebooks like this one 👇 . If you would like to get an email alert for future newsletters and asset updates, you can sign-up here. […]

Read more
Natural Language Processing, NLP, Python

The NLP Cypher | 06.13.21

TextStyleBrush can recognize style of text in pictures and edit the words while maintaining the style. It’s “… the first self-supervised AI model that replaces text in images of both handwriting and scenes — in one shot — using a single example word.” Examples: Install TensorFlow v2.5 and the tensorflow-metal PluggableDevice to accelerate training with Metal on Mac GPUs. Chris Farber highlights how to use Postgres for common Redis use-cases. In all, he describes 3 use-cases of job-queuing, application locks, […]

Read more
Natural Language Processing, NLP, Python

The NLP Cypher | 07.04.21

Hey Welcome back! Want to wish everyone in the US a happy 4th of July🎆🎇! Also, want to quickly mention that the NLP Index has doubled in size (since its inception) with now housing over 6,000 repos, pretty cool!!! 😎 And as always, it gets updated weekly. But first, this week we asked 100 NLP developers: Name one thing Microsoft got for paying $7.5 billi for GitHub, and $1 billi to OpenAI? SURVEY SAYS: 7.5B + 1B = GitHub CoPilot […]

Read more
Natural Language Processing, NLP, Python

The NLP Cypher | 07.11.21

Welcome back! Hope you had a great week. We have a new leader on the SuperGLUE benchmark with a new Ernie model from Baidu comprising of 10 billion parameters trained on on a 4TB corpus. FYI, human baseline was already beat by Microsoft’s DeBERTa model at the beginning of the year… time for a new SuperSuperGLUE benchmark??? Paper BTW, if you are still interested in GitHub’s CoPilot, I stumbled upon the Codex paper this week: Paper DeepMind’s Perceiver transformer allows […]

Read more
Natural Language Processing, NLP, Python

The NLP Cypher | 07.18.21

Sometimes… cool things happen. A new chatbot from Facebook AI was released this Friday with remarkable features. This chatbot, BlenderBot 2.0, is an improvement on their previous bot from last year. The bot has better long-term memory and can search the internet for information during conversation! This is a convenient improvement versus traditional bots since information is not statically “memorized” but instead has the option to be dynamic and “staying up to date” via the internet. 🤯 I’ve recently tested […]

Read more
Natural Language Processing, NLP, Python

The NLP Cypher | 07.25.21

Welcome back! This week’s Cypher will be a bit shorter than usual, it was a slow week in NLP land. But first, I want to update you on the BlenderBot 2.0 situation. On last week’s Cypher, the last hurdle to overcome with the instantiation of blenderbot inference was the search server (which gives the bot the ability to comb the web to answer factoid type of questions). Well we finally have a search server repo to work with! Thank you […]

Read more
1 … 467 468 469 470 471 … 943