this post was submitted on 05 Jul 2023
1 points (100.0% liked)

Text 2 Video

2 readers
1 users here now

Community for text 2 video AI generation using tools like runway Gen2, modelscope, zeroscope, or vidcrafter.


Open Source

Using Auto1111 text2video extension

Modelscope
damo-vilab/modelscope-damo-text-to-video-synthesis

Zeroscope
cerspense/zeroscope_v2_576w
cerspense/zeroscope_v2_XL

Potat1
camenduru/potat1


Closed Source

Runway Gen2
https://research.runwayml.com/gen2


founded 1 year ago
MODERATORS
1
Space I - ZeroScope v2 (feed.timeloop.tv)
submitted 1 year ago* (last edited 1 year ago) by [email protected] to c/[email protected]
 

Model - Zeroscope v2 576w

454 x 256 (16:9)

24 Frames @ 15FPS

Date - 07/05/2023

{
'prompt': 'Traveling through space, stars, galaxies, rainbow of colors', 
'n_prompt': 'text, watermark, copyright, blurry, nsfw', 
'steps': 30, 
'frames': 24,
'seed': 3485857997, 
'scale': 17, 
'width': 454, 
'height': 256,
'eta': 0.0,
'cpu_vae': 'GPU',
'device': device(type='cuda'),
'skip_steps': 0,
'strength': 0
}
top 6 comments
sorted by: hot top controversial new old
[–] [email protected] 1 points 1 year ago (1 children)

Upscale using ZeroScope v2 XL

[–] [email protected] 1 points 1 year ago

Upscale again using ZeroScope v2 XL.

Not seeing a huge change

[–] [email protected] 1 points 1 year ago

Another generation with the same prompt at ZeroScope 576w default resolution of 576 x 320.

{
'prompt': 'Traveling through space, stars, galaxies, rainbow of colors', 
'n_prompt': 'text, watermark, copyright, blurry, nsfw', 
'steps': 30, 
'frames': 24, 
'seed': 4037714052, 
'scale': 17, 
'width': 576, 
'height': 320, 
'eta': 0.0, 
'cpu_vae': 'GPU', 
'device': device(type='cuda'), 
'skip_steps': 0, 
'strength': 0
}

[–] [email protected] 1 points 1 year ago (2 children)

Adding some quality descriptors seemed to help.

 {
'prompt': 'Traveling through space, stars, galaxies, rainbow of colors, cinematic, imax, movie, film grain', 
'n_prompt': 'text, watermark, copyright, blurry, nsfw', 
'steps': 30, 
'frames': 24, 
'seed': 3824253423, 
'scale': 17, 
'width': 576, 
'height': 320, 
'eta': 0.0, 
'cpu_vae': 'GPU', 
'device': device(type='cuda'), 
'skip_steps': 0, 
'strength': 0
}

[–] [email protected] 1 points 1 year ago

Batch of 4 with the same prompt.

\

\

\

[–] [email protected] 1 points 1 year ago

Upscale using ZeroScope v2 XL