Midjourney人物一致性探索

发布时间 2023-12-20 09:29:26作者: 梅丹隆

原图

a 25 years old male in ancient Chinese robe with black big back hair and small eyes and normal nose and small mouth and a small face

image.png
image.png

垫图

https://s.mj.run/gBMdKDa7UJo, a 25 years old male in ancient Chinese robe with black big back hair and small eyes and normal nose and small mouth and a small face, looks curious and determined, is running and thinking, at ancient market and busy streets --seed 3363398341

image.png

https://s.mj.run/gBMdKDa7UJo, XiaoShuai is a 25 years old male in ancient Chinese robe with black big back hair and small eyes and normal nose and small mouth and a small face, he looks curious and determined, is running and thinking, at ancient market and busy streets --seed 3363398341

image.png
:::warning
普通描述则结果倾向于生成与垫图相似的人物半身照
:::

调整关键词顺序

https://s.mj.run/gBMdKDa7UJo, XiaoShuai looks curious and determined, running and thinking, at ancient market and busy streets. he is a 25 years old male in ancient Chinese robe with black big back hair and small eyes and normal nose and small mouth and a small face --seed 3363398341

image.png

https://s.mj.run/gBMdKDa7UJo, he is running and thinking, at ancient market and busy streets. he is a 25 years old male in ancient Chinese robe with black big back hair and small eyes and normal nose and small mouth and a small face, looks curious and determined, --seed 3363398341

image.png
:::warning
将动作放在最前,生图的效果最好
:::

更换场景背景和人物动作

https://s.mj.run/gBMdKDa7UJo, he is smiling and cooking, at beach of sea. he is a 25 years old male in ancient Chinese robe with black big back hair and small eyes and normal nose and small mouth and a small face, looks curious and determined, --seed 3363398341

image.png

https://s.mj.run/gBMdKDa7UJo, He is looking back with his back to the camera, at train station. he is a 25 years old male in ancient Chinese robe with black big back hair and small eyes and normal nose and small mouth and a small face, looks curious and determined, --seed 3363398341

image.png
:::warning
有垫图默认生成正面半身像,效果达到预期。
如果要求生成侧面或者背身的图片,则结果并不是很像
:::

去掉固定种子

https://s.mj.run/gBMdKDa7UJo, He is looking back with his back to the camera, at train station. he is a 25 years old male in ancient Chinese robe with black big back hair and small eyes and normal nose and small mouth and a small face, looks curious and determined

image.png

https://s.mj.run/gBMdKDa7UJo, he is running and thinking, at ancient market and busy streets. he is a 25 years old male in ancient Chinese robe with black big back hair and small eyes and normal nose and small mouth and a small face, looks curious and determined

image.png
:::warning
有垫图的情况下,种子参数可以不要
:::

调整动作权重

https://s.mj.run/gBMdKDa7UJo, XiaoShuai is a 25 years old male in ancient Chinese robe with black big back hair and small eyes and normal nose and small mouth and a small face, he looks curious and determined, is running and thinking::1, at ancient market and busy streets --seed 3363398341

image.png

https://s.mj.run/gBMdKDa7UJo, XiaoShuai is a 25 years old male in ancient Chinese robe with black big back hair and small eyes and normal nose and small mouth and a small face, he looks curious and determined, is running and thinking::1.5, at ancient market and busy streets --seed 3363398341

image.png
:::warning
使用::来添加权重,效果不明显
:::

是否可以用垫图代替角色人物特征描述?

https://s.mj.run/gBMdKDa7UJo, he looks curious and determined, is running and thinking, at ancient market and busy streets --seed 3363398341

image.png

https://s.mj.run/gBMdKDa7UJo, XiaoShuai looks curious and determined, is running and thinking, at ancient market and busy streets --seed 3363398341

image.png
:::warning
如果只有垫图而省略人物特征描述,则生成结果不理想
:::

Custom Zoom

he is running and thinking, at ancient market and busy streets. he is a 25 years old male in ancient Chinese robe with black big back hair and small eyes and normal nose and small mouth and a small face, looks curious and determined, --seed 3363398341 --ar 1:1 --zoom 2

image.png
:::warning
相当于是固定原图内容,在扩大的范围内进行绘画创作
:::

InsightSwapFace换脸

https://github.com/deepinsight/insightface/tree/master/web-demos/swapping_discord
邀请InsightSwapFace机器人链接
:::danger
非本地部署,有公用队列等待问题。只可测试不可用于正常业务
:::
image.png

XiaoShuai is a 25 years old male in ancient Chinese robe with black big back hair and small eyes and normal nose and small mouth and a small face, he looks curious and determined, is running and thinking::1.5, at ancient market and busy streets --seed 3363398341

image.png

测试一

image.png
换脸后
image.png

测试二

image.png
换脸后
image.png
再看一眼小帅的模版
image.png
整体效果可以接受,但是放大仔细看...
image.png
明显是脸部图片的遮罩,但是对肤色的调整还是不错的可以以假乱真。

如果是多人物场景是否也能通过换脸达到人物的一致性?

创建XiaoMei人物

a 25 years old girl in ancient Chinese robe with long blue hair and big eyes and a small face

image.png
真是糟糕...头发颜色跟衣服串了。不过选择一张吧
image.png
image.png
image.png

测试一

XiaoShuai and XiaoMei is fighting, XiaoShuai is on the left side of the scene.XiaoMei is on the right side of the scene

image.png
换脸后
image.png
:::warning
只能替换为同一个人物的脸
:::
切换成“小帅”人物,换脸后
image.png
image.png

测试二

XiaoShuai and XiaoMei is smiling, XiaoShuai is on the left side of the scene.XiaoMei is on the right side of the scene

image.png
image.png
保存图片,使用/swapid处理
image.png
image.png

测试三

image.png
image.png


参考:
https://zhuanlan.zhihu.com/p/630911067