Skip to content

zmwv823/ComfyUI_Anytext

Repository files navigation

Look at the node tooltip for instruction.

1、AnyText: Unofficial custom_node for AnyText: Multilingual Visual Text Generation And Editing

Option 1: full AnyText checkpoint.

Huggingface:

Modelscope:

Workflow in example_workflows dir:

Option 2: any sd1.5 checkpoint with AnyText control model.

Huggingface:

Workflow in example_workflows dir:

If want chinese prompt without translator, use MiaoBi clip.

Huggingface:

Workflow in example_workflows dir:

Font: select Auto_Download from huggingface or manual download from huggingface or modelscope or use any other fonts in ComfyUI\models\fonts.

Huggingface:

Modelscope:

Zh to En Translators:

T5: Auto_Download from huggingface or manual download or git clone from huggingface into ComfyUI\models\prompt_generator\models--utrobinmv--t5_translate_en_ru_zh_small_200.

nlp_csanmt_translation_zh2en: Auto_Download from modelscope or manual download or git clone from modelscope into ComfyUI\models\prompt_generator\modelscope--damo--nlp_csanmt_translation_zh2en.

2、Glyph-ByT5: Unofficial custom_node for Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Rendering--TEST FAILED ON MY PC

Limitations: background result worse than original SDXL checkpoint, image resolution locked at 1024x1024, input mask and image aspect ratio must be 1:1.

Place Glyph-ByT5 checkpoints in ComfyUI\custom_nodes\ComfyUI_Anytext\Image_Generation\Glyph_SDXL\checkpoints

Place google/byt5-small text_encoder into ComfyUI\models\text_encoders or select Auto_Download from huggingface.

Workflow in example_workflows dir:

It's a typical canny controlnet implementation by diffusers library.

Comfy Ksampler workflow recommended, sd1.5、sd2.1、sdxl canny works.

For JoyType controlnet, download from https://huggingface.co/jdh-algo/JoyType-v1-1M into ComfyUI\models\controlnet. It's a diffusers format canny controlnet, compitable with comfy sampler.

Workflow in example_workflows dir: