Instruction-tuning Stable Diffusion with InstructPix2Pix

This post explores instruction-tuning to teach Stable Diffusion to follow instructions to translate or process input images. With this method, we can prompt Stable Diffusion using an input image and an “instruction”, such as – Apply a cartoon filter to the natural image.


Figure 1: We explore the instruction-tuning To finish reading, please visit source site Categories Categories Search for: Recent Posts Porting fairseq wmt19 translation system to transformers Leveraging Pre-trained Language Model Checkpoints for Encoder-Decoder Models How we sped up transformer inference 100x for 🤗 API customers Fit More and Train Faster With ZeRO via DeepSpeed and FairScale Faster TensorFlow models in Hugging Face Transformers Tags Attention blogathon Calculus Command-line Tools Data Preparation data science data visualization Deep Learning Deep Learning for Computer Vision Deep Learning for Natural Language Processing Deep Learning for Time Series Deep Learning Performance Deep Learning with PyTorch Ensemble Learning Generative Adversarial Networks Imbalanced Classification Linear Algebra Long Short-Term Memory Networks machine learning Machine Learning Algorithms Machine Learning Process Machine Learning Resources machine translation Matplotlib Natural language processing Natural Language Processing & Speech Neural MT nlp NMT opencv Optimization pandas Probability python Python for Machine Learning Python Machine Learning Resources R Machine Learning scikit-learn sentiment analysis Start Machine Learning Statistics Time Series Weka Machine Learning XGBoost Categories Categories Archives Archives Powered by WordPress and Rubine.

Figure 1: We explore the instruction-tuning

To finish reading, please visit source site