Google DeepMind 推出 Gemini Omni 1.1 Flash 版本,强调更精细的任务控制能力,适合需要精确输出格式的开发者。
Omni 现在可以提供工作室级别的视频制作能力,包括场景延伸、首尾帧插值、高清 4K 画质提升、更快的原型迭代等功能。
Product Manager, Google DeepMind
Product Manager, Google DeepMind
Your browser does not support the audio element.
我们正式发布 Gemini Omni 1.1 Flash,这是一款面向开发者的生产级更新,在生成式视频方面提供了更强的可控性。现在你可以延伸场景、指定起始帧和结束帧以实现平滑过渡,并生成高分辨率 4K 输出。通过 Google AI Studio 或 Gemini Enterprise Agent Platform 访问模型,立即开始构建。
"Gemini Omni 1.1 Flash" 让开发者对生成式视频项目拥有更好的控制能力。
Google 刚刚发布了 Gemini Omni 1.1 Flash,为开发者提供了更强大的 AI 视频创作和编辑工具。它可以延伸视频片段、控制镜头运动、制作高质量 4K 素材。开发者还可以创建快速的低分辨率草稿,以更低成本、更快速度验证创意。这对于任何从事创意视频软件开发的团队来说,都是一次重大飞跃。
今天,我们正式发布 Gemini Omni 1.1 Flash,这是一套全新的创意控制功能和生成式视频能力,旨在为开发者提供更好的支持。Gemini Omni 将现实世界推理能力带入了生成式创作领域,而今天的更新使 Omni 1.1 通过 Google AI Studio 中的 Gemini API 达到生产就绪状态,可用于专业场景。无论你是在构建生成式视频工作流、创意工具还是媒体编辑软件,这些更新都会让生成式视频变得更具可控性、迭代速度更快,且更适合真实场景部署。以下是本次更新的详细内容:
场景延伸功能允许你基于一段现有视频,从中断处继续生成画面,实现无缝衔接。
借助 Omni 1.1,模型现在可以分析最多 10 秒的先前上下文——这相比之前只能参考最后一秒的模型是重大飞跃。得益于此,视觉一致性和叙事连贯性得到显著提升,让你能够构建更长的故事或探索新的创作方向。你可以按 10 秒为增量延伸视频,最长可达 40 秒的总时长。
Prompt 1: Camera slightly pans and we now see she is talking to a man with curly hair, we see man's back, he says "I see it too" dramatic music score
Prompt 2: Camera slowly pulls out, forgotten dusty catacombs, dramatic music score.
Prompt 3: Camera slowly pulls out, a vast library where shelves and books float weightlessly in a dusty void, dramatic music score.
Prompt 1: Continue the video. Execute a cinematic optical dolly-zoom shot. The camera dollies forward while simultaneously zooming out, keeping the character's frozen shocked face locked at the exact same size. The long corridor of stone pillars in the background dramatically stretches and deepens with intense optical perspective distortion. Clean architecture, continuous unbroken shot.
Prompt 2: Continue the video. The camera executes a fast mechanical snap-zoom directly into the character's wide eyes. Stylized cinematic camera control.
Prompt 3: Continue the video. Time completely freezes into a static moment: the character, their windblown coat. The camera performs a smooth, high-speed 360-degree orbital rotation around the frozen character, showcasing dramatic 3D depth and parallax across the colonnade. Flawless continuity.
Prompt 1: The man in the blue sweater replies: "Did your father go out on the boat too?"
Prompt 2: The camera pulls back in one continuous movement as he continues his story: "He used to say that this harbour had a soul. And that the boats were a part of us." The music swells.
Prompt 1: The looks directly at the camera and talks about what the final chapter will end with!
Prompt 2: He then stands up walks around the desk to the camera and says "what would you choose?"
以下是你如何通过 Gemini API 延伸场景的示例代码:
from google import genai
client = genai.Client()
interaction = client.interactions.create(
model="gemini-omni-1.1-flash",
previous_interaction_id=previous_video_interaction.id,
input=[
{"type": "text", "text": "Continue the scene."}
],
response_format={
"resolution": "360p",
},
)
通过指定镜头的起始帧和结束帧,实现平滑的过渡效果和镜头运动。Omni 1.1 可以在两个关键帧之间生成连续视频,非常适合复杂的镜头环绕、缩放过渡或无缝循环片段。
Prompt 1: A close-up low-angle shot of a stylish drummer in a beige suit playing a red drum kit in a grand hall transitions as the camera whip-pans to the side, revealing an older saxophonist playing alongside a ballet dancer spinning in a white outfit under soft purple stage lights. One continuous shot, no jump cuts.
Prompt 2: The camera zooms into the TV screen, where we see the same woman and the same scene from the beginning. Seamless video. One continuous shot, no jump cuts.
以 360p 分辨率生成轻量级预览,速度比 Omni 1.1 标准 720p 分辨率快最高 60%,成本降低三分之二。这对于快速原型设计、故事板迭代以及开发者平台中的快速渲染非常有帮助。
*基于 360p 与 720p 分辨率的系统吞吐量对比,最高可提升 60% 生成速度
Prompt: A microscopic view of iridescent marine diatoms, displaying intricate, glass-like silica shells with breathtaking natural symmetry. The colors range from deep volcanic amber and warm copper to vibrant turquoise and violet, mimicking the rich palette of earth and ocean. Tiny, delicate structures glow softly against a clean dark field background. High-fidelity scientific imaging, sharp details, organic textures, micro-photography. Maintain the microscope lens effect throughout the entire video.
使用 Omni 1.1 生成精致、高分辨率的 1080p 或 4K 输出,可直接用于专业制作。
Prompt 1: Fish swimming, tracking shot
Prompt 2: A little chipmunk darting out of the woods from the left side of the screen and sniffing the air inquisitively before darting out of frame on the right side
Prompt 3: Cinematic macro close-up of vibrant golden-orange Japanese maple leaves on a delicate branch, gently rustling and swaying in a soft, rhythmic autumn breeze. Sunlight filters through the translucent foliage, creating a warm, glowing effect. Shallow depth of field, dreamy bokeh background, hyper-detailed textures, photorealistic, 4k.
在构建场景时引用最多三秒的视频素材,让你能够基于视频参考保持视觉一致性和角色连贯性。
Prompt: Use the three uploaded videos of dancers and replace them with the provided characters. Have them perform their individual dances from the reference videos, all together in the large, open space from the provided image.
The dog character dog.png should do the classical dance from dance3.mp4. The octopus octo.png should do the hip hop dance from dance1.mp4, and the bear bear.png should do the breakdance from dance2.mp4. The final result should be one continuous shot with no scene cuts.
以下是一些创意示例,展示开发者如何将这些新能力应用到自定义工具和创意工作流中。
在这个应用中,你可以放入首帧和尾帧,通过预设或提示词框在它们之间生成过渡——这得益于 Omni 完整的上下文推理能力,能够生成看起来真实自然的镜头运动。
这个应用中,镜头穿过各个房间移动。它环绕、推进、拉远。它以理想的时间展示了家的样子。它不会添加不存在家具或细节。
创作者通常在得到满意结果之前要生成多个视频。Draft Room 让这种探索变得廉价且结构化:以 360p 生成 3-4 个草稿变体,每次只改变一个变量,然后并排对比。
我们的客户已经通过 Agent Platform API 将 Gemini Omni Flash 应用于真实的生产环境。探索他们创作的视频,并了解他们如何使用该模型。
Adobe 将 Gemini Omni Flash 集成到了 Adobe Firefly 中。观看这个视频,了解其视频编辑能力。
"Gemini Omni Flash 是 Figma Weave 中可用的最强视频模型之一,画布帮助创意团队在每一次生成中持续迭代——附加参考、衍生不同版本、塑造独特作品。借助延伸、更丰富的参考素材和 4K 分辨率,Gemini Omni Flash 让团队不再只是生成视频,而是真正意义上地导演视频。" —— Itay Schiff,创意总监,Figma Weave
"在 GMI Cloud,我们为创作者提供集中访问全球最强大模型的入口。Gemini Omni Flash 最突出的是它的准确性:细节经得起审视。对于创作教育和解释性内容的客户来说,正确性至关重要,这种可靠性比任何单一功能都更有价值。Omni 让 AI 视频在之前无法依赖它的细分领域变得真正可行。" —— Louisa Guo,市场副总裁,GMI Cloud
"Omni Flash 自然地融入了人们已有的 Runway 使用方式:从提示词、图片或视频开始,然后从那里生成或编辑。这为我们用户提供了一种在想法之间快速切换的新方式。" —— Jamie Umpherson,首席创意官,Runway
Gemini Omni 1.1 Flash 的定价表。
Omni 1.1 正在向整个 Google 开发者生态系统推出:
Omni 1.1 今日起也面向全球所有 Google AI Plus、Pro 和 Ultra 订阅用户在 Google Flow 中开放。场景延伸功能今日起面向全球所有 Google AI Plus、Pro 和 Ultra 订阅用户在 Gemini 应用中开放。