フレッシュ スペース & テクノロジー NEWS📢
April 16, 2023Introduction When I first started playing with Stable Diffusion text-to-image generation, in August 2022, my immediate reaction was, “ZOMG! I need to make art prints for my art wall!”. Only to then immediately face-plant because vanilla Stable Diffusion is quite challenging to tame. If you are trying to reproduce a specific subject, you…
Image: Ian C. Haydon / UW Institute for Protein Design Description RFdiffusion is an open source method for structure generation, with or without conditional information (a motif, target etc). It can perform a whole range of protein design challenges as we have outlined in the RFdiffusion paper. Things Diffusion can do Motif Scaffolding Unconditional protein…
Stable unCLIP unCLIP is the approach behind OpenAI’s DALL·E 2, trained to invert CLIP image embeddings. We finetuned SD 2.1 to accept a CLIP ViT-L/14 image embedding in addition to the text encodings. This means that the model can be used to produce image variations, but can also be combined with a text-to-image embedding prior…
Fine-tuning against a modified noise, enables Stable Diffusion to generate very dark or light images easily.Denoising Diffusion Probabilistic Models are a relatively new form of generative neural network model – models which produce samples from a high-dimensional probability distribution learned from data. Other approaches to the same class of problem include Generative Adversarial Networks, Normalizing…
