# Stable Video Diffusion-Controlnet_Lora_Lane_Pedestrian

**Repository Path**: chengwendong/video_generation_controlnet_lora_lane_pedestrian

## Basic Information

- **Project Name**: Stable Video Diffusion-Controlnet_Lora_Lane_Pedestrian
- **Description**: 使用行人和车道数据集基于controlnet和lora微调stable video diffusion，提升生成的视频的质量，流畅度，多样性。
- **Primary Language**: Unknown
- **License**: Apache-2.0
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 1
- **Forks**: 0
- **Created**: 2025-06-16
- **Last Updated**: 2025-06-21

## Categories & Tags

**Categories**: Uncategorized

**Tags**: aigc, diffusion, controlnet, LoRa

## README

# Video_generation_controlnet_lora_lane_pedestrian

#### 介绍
使用行人和车道数据集基于controlnet和lora联合微调stable video diffusion, 提升生成的视频的质量，流畅度，多样性。



# Video_generation_controlnet_lora_lane_pedestrian

**Using the pedestrian and lane dataset, jointly fine-tuning Stable Video Diffusion based on ControlNet and Lora 🚀**


## Part: Inference

### Result
#### Due to the limitation of computing resources, the training steps is also limited.


<div style="display: flex; overflow-x: auto;">
  <table>
    <tr>
      <td style="min-width: 300px;"> 输入图片</td>
      <td style="min-width: 300px;"> 控制信号</td>
      <td style="min-width: 300px;"> 生成结果</td>
    </tr>
    <tr>
      <td style="min-width: 300px;"><img src="https://gitee.com/chengwendong/video_generation_controlnet_lora_lane_pedestrian/raw/master/assets/example01.jpg" width="500"></td>
      <td style="min-width: 300px;"><img src="https://gitee.com/chengwendong/video_generation_controlnet_lora_lane_pedestrian/raw/master/assets/example01_canny_00.jpg" width="200"><br>.<br>.<br>.<br>
                                    <img src="https://gitee.com/chengwendong/video_generation_controlnet_lora_lane_pedestrian/raw/master/assets/example01_canny_13.jpg" width="200"></td>
      <td style="min-width: 300px;"><img src="https://gitee.com/chengwendong/video_generation_controlnet_lora_lane_pedestrian/raw/master/assets/example01.gif" width="500"></td>
    </tr>
    <tr>
      <td style="min-width: 300px;"><img src="https://gitee.com/chengwendong/video_generation_controlnet_lora_lane_pedestrian/raw/master/assets/example02.jpg" width="500"></td>
      <td style="min-width: 300px;"><img src="https://gitee.com/chengwendong/video_generation_controlnet_lora_lane_pedestrian/raw/master/assets/example02_canny_00.jpg" width="200"><br>.<br>.<br>.<br>
                                    <img src="https://gitee.com/chengwendong/video_generation_controlnet_lora_lane_pedestrian/raw/master/assets/example02_canny_13.jpg" width="200"></td>
      <td style="min-width: 300px;"><img src="https://gitee.com/chengwendong/video_generation_controlnet_lora_lane_pedestrian/raw/master/assets/example02.gif" width="500"></td>
    </tr>
    <tr>
      <td style="min-width: 300px;"><img src="https://gitee.com/chengwendong/video_generation_controlnet_lora_lane_pedestrian/raw/master/assets/example03.jpg" width="500"></td>
      <td style="min-width: 300px;"><img src="https://gitee.com/chengwendong/video_generation_controlnet_lora_lane_pedestrian/raw/master/assets/example03_canny_00.jpg" width="200"><br>.<br>.<br>.<br>
                                    <img src="https://gitee.com/chengwendong/video_generation_controlnet_lora_lane_pedestrian/raw/master/assets/example03_canny_13.jpg" width="200"></td>
      <td style="min-width: 300px;"><img src="https://gitee.com/chengwendong/video_generation_controlnet_lora_lane_pedestrian/raw/master/assets/example03.gif" width="500"></td>
    </tr>
  </table>
</div>



### Code file description