首页 星云 工具 资源 星选 资讯 热门工具
:

PDF转图片 完全免费 小红书视频下载 无水印 抖音视频下载 无水印 数字星空

基于CLIP模型的视频文本检索设计与实现

行业研究 5.01MB 22 需要积分: 1
立即下载

资源介绍:

针对现有基于CLIP预训练模型方法存在的训练时间长、模型规模大等问题,本文在CLIP4Clip模型的基础上,采用关键帧保存方案和Adapter Tuning低参数量微调,提高了计算资源有限情况下的训练效率和模型性能。 训练速度方面,本文首先采用帧保存方案,将视频库中的关键帧提取并保存为图片,从而加快数据加载速度,将训练速度提高了14.6倍;然后采用AIM模型的Adapter设计方案,在CLIP4Clip模型中插入可训练的Adapter层,只训练少量参数实现快速收敛,最终实现训练速度提高34倍。 模型性能方面,论文证明了平均选取视频关键帧,比按照最大帧间差选取视频关键帧的效果更优;然后证明了AIM在视频检索领域的有效性;并可以使用AIM来提高模型性能,将模型在MSR-VTT数据集上的R@1从42.2%提升至43.4%,R@5从70.2%提升为71.1%。 本文设计并实现了一个视频文本检索系统,为了保障系统的检索速度,搭建了向量数据库,并测试了不同数据保存方式的数据存取速度。系统使用Django搭建了Web端应用,实现了多种功能需求,展示了本文方法在视频文本检索系统中的应用效果和潜力。
# 毕业设计:《基于CLIP模型的视频文本检索设计与实现》 ### 主要内容 针对现有基于CLIP预训练模型方法存在的训练时间长、模型规模大等问题,本文在CLIP4Clip模型的基础上,采用关键帧保存方案和Adapter Tuning低参数量微调,提高了计算资源有限情况下的训练效率和模型性能。 1. 训练速度方面,本文首先采用帧保存方案,将视频库中的关键帧提取并保存为图片,从而加快数据加载速度,将训练速度提高了14.6倍;然后采用AIM模型的Adapter设计方案,在CLIP4Clip模型中插入可训练的Adapter层,只训练少量参数实现快速收敛,最终实现训练速度提高34倍。 2. 模型性能方面,论文证明了平均选取视频关键帧,比按照最大帧间差选取视频关键帧的效果更优;然后证明了AIM在视频检索领域的有效性;并可以使用AIM来提高模型性能,将模型在MSR-VTT数据集上的R@1从42.2%提升至43.4%,R@5从70.2%提升为71.1%。 3. 本文设计并实现了一个视频文本检索系统,为了保障系统的检索速度,搭建了向量数据库,并测试了不同数据保存方式的数据存取速度。系统使用Django搭建了Web端应用,实现了多种功能需求,展示了本文方法在视频文本检索系统中的应用效果和潜力。 关键词:视频文本检索;CLIP模型;CLIP4Clip模型;低参数量微调;训练加速 ### 技术实现 1. 模型基于[CLIP](https://github.com/openai/CLIP)、[CLIP4Clip](https://github.com/ArrowLuo/CLIP4Clip)、[AIM](https://github.com/taoyang1122/adapt-image-models),数据集主要使用[MSR-VTT](http://ms-multimedia-challenge.com/2017/dataset); 2. 界面后端由Django实现; ### 图片

检索结果展示页面

视频播放页面

用户搜索视频流程图

算法整体结构

模型整体结构

资源文件列表:

video-text-retrieval-main.zip 大约有262个文件
  1. video-text-retrieval-main/
  2. video-text-retrieval-main/README.md 3.67KB
  3. video-text-retrieval-main/code/
  4. video-text-retrieval-main/code/Graduation_Project/
  5. video-text-retrieval-main/code/Graduation_Project/.idea/
  6. video-text-retrieval-main/code/Graduation_Project/.idea/Graduation_Project.iml 619B
  7. video-text-retrieval-main/code/Graduation_Project/.idea/inspectionProfiles/
  8. video-text-retrieval-main/code/Graduation_Project/.idea/inspectionProfiles/Project_Default.xml 4.65KB
  9. video-text-retrieval-main/code/Graduation_Project/.idea/inspectionProfiles/profiles_settings.xml 174B
  10. video-text-retrieval-main/code/Graduation_Project/.idea/misc.xml 215B
  11. video-text-retrieval-main/code/Graduation_Project/.idea/modules.xml 288B
  12. video-text-retrieval-main/code/Graduation_Project/.idea/workspace.xml 1.11KB
  13. video-text-retrieval-main/code/Graduation_Project/Graduation_Project/
  14. video-text-retrieval-main/code/Graduation_Project/Graduation_Project/__init__.py
  15. video-text-retrieval-main/code/Graduation_Project/Graduation_Project/__pycache__/
  16. video-text-retrieval-main/code/Graduation_Project/Graduation_Project/__pycache__/__init__.cpython-39.pyc 242B
  17. video-text-retrieval-main/code/Graduation_Project/Graduation_Project/__pycache__/settings.cpython-39.pyc 2.57KB
  18. video-text-retrieval-main/code/Graduation_Project/Graduation_Project/__pycache__/urls.cpython-39.pyc 1.05KB
  19. video-text-retrieval-main/code/Graduation_Project/Graduation_Project/__pycache__/wsgi.cpython-39.pyc 667B
  20. video-text-retrieval-main/code/Graduation_Project/Graduation_Project/asgi.py 413B
  21. video-text-retrieval-main/code/Graduation_Project/Graduation_Project/settings.py 3.7KB
  22. video-text-retrieval-main/code/Graduation_Project/Graduation_Project/urls.py 807B
  23. video-text-retrieval-main/code/Graduation_Project/Graduation_Project/wsgi.py 413B
  24. video-text-retrieval-main/code/Graduation_Project/README.md 1.89KB
  25. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/
  26. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Model/
  27. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Model/AIM.py 6.16KB
  28. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Model/CLIP4Clip.py 4.1KB
  29. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Model/My_Model.py 4.99KB
  30. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Model/__pycache__/
  31. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Model/__pycache__/AIM.cpython-39.pyc 4.67KB
  32. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Model/__pycache__/CLIP4Clip.cpython-39.pyc 3.81KB
  33. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Model/__pycache__/My_Model.cpython-39.pyc 5KB
  34. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Model/clip/
  35. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Model/clip/__init__.py 20B
  36. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Model/clip/__pycache__/
  37. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Model/clip/__pycache__/__init__.cpython-38.pyc 177B
  38. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Model/clip/__pycache__/__init__.cpython-39.pyc 172B
  39. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Model/clip/__pycache__/clip.cpython-38.pyc 8.65KB
  40. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Model/clip/__pycache__/clip.cpython-39.pyc 8.75KB
  41. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Model/clip/__pycache__/model.cpython-38.pyc 16.16KB
  42. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Model/clip/__pycache__/model.cpython-39.pyc 16.1KB
  43. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Model/clip/__pycache__/simple_tokenizer.cpython-38.pyc 7.76KB
  44. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Model/clip/__pycache__/simple_tokenizer.cpython-39.pyc 7.71KB
  45. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Model/clip/bpe_simple_vocab_16e6.txt.gz 1.29MB
  46. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Model/clip/clip.py 9.83KB
  47. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Model/clip/model.py 22KB
  48. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Model/clip/simple_tokenizer.py 8.53KB
  49. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/TensorDataBase/
  50. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/TensorDataBase/TensorDataBase.py 4.48KB
  51. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/TensorDataBase/__init__.py
  52. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/TensorDataBase/__pycache__/
  53. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/TensorDataBase/__pycache__/TensorDataBase.cpython-39.pyc 4.08KB
  54. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/TensorDataBase/__pycache__/__init__.cpython-39.pyc 188B
  55. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/TensorDataBase/construct.py 7.47KB
  56. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/TensorDataBase/construct_dataloader.py 1.38KB
  57. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/Tools.py 7.76KB
  58. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/VideoSearchSystem.py 5.14KB
  59. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/__init__.py
  60. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/__pycache__/
  61. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/__pycache__/Tools.cpython-39.pyc 6.36KB
  62. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/__pycache__/VideoSearchSystem.cpython-39.pyc 4.59KB
  63. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/__pycache__/__init__.cpython-39.pyc 241B
  64. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/__pycache__/get_args.cpython-39.pyc 2.69KB
  65. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/get_args.py 5.61KB
  66. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/preprocess/
  67. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/preprocess/dataloader_keyFrame.py 3.51KB
  68. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/preprocess/frame_extract/
  69. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/preprocess/frame_extract/__init__.py
  70. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/preprocess/frame_extract/__pycache__/
  71. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/preprocess/frame_extract/__pycache__/__init__.cpython-39.pyc 179B
  72. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/preprocess/frame_extract/__pycache__/frame_extract_tool.cpython-39.pyc 5.52KB
  73. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/preprocess/frame_extract/__pycache__/keyFrameExtractor_Uniform.cpython-39.pyc 1.56KB
  74. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/preprocess/frame_extract/__pycache__/keyFrameExtractor_diff.cpython-39.pyc 4.84KB
  75. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/preprocess/frame_extract/frame_extract_tool.py 7.39KB
  76. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/preprocess/frame_extract/keyFrameExtractor_IFrame.py 809B
  77. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/preprocess/frame_extract/keyFrameExtractor_Uniform.py 2.05KB
  78. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/preprocess/frame_extract/keyFrameExtractor_diff.py 5.7KB
  79. video-text-retrieval-main/code/Graduation_Project/VideoSearchSystem/preprocess/train.csv文件创建.py 1.94KB
  80. video-text-retrieval-main/code/Graduation_Project/db.sqlite3 1.27MB
  81. video-text-retrieval-main/code/Graduation_Project/manage.py 674B
  82. video-text-retrieval-main/code/Graduation_Project/requirements.txt 81B
  83. video-text-retrieval-main/code/Graduation_Project/static/
  84. video-text-retrieval-main/code/Graduation_Project/static/style/
  85. video-text-retrieval-main/code/Graduation_Project/static/style/simple/
  86. video-text-retrieval-main/code/Graduation_Project/static/style/simple/general.css 474B
  87. video-text-retrieval-main/code/Graduation_Project/static/style/simple/header.css 1.67KB
  88. video-text-retrieval-main/code/Graduation_Project/static/style/simple/home.css 3.37KB
  89. video-text-retrieval-main/code/Graduation_Project/static/style/simple/icons/
  90. video-text-retrieval-main/code/Graduation_Project/static/style/simple/icons/explore.svg 777B
  91. video-text-retrieval-main/code/Graduation_Project/static/style/simple/icons/hamburger-menu.svg 354B
  92. video-text-retrieval-main/code/Graduation_Project/static/style/simple/icons/home.svg 331B
  93. video-text-retrieval-main/code/Graduation_Project/static/style/simple/icons/left.svg 242B
  94. video-text-retrieval-main/code/Graduation_Project/static/style/simple/icons/library.svg 387B
  95. video-text-retrieval-main/code/Graduation_Project/static/style/simple/icons/notifications.svg 637B
  96. video-text-retrieval-main/code/Graduation_Project/static/style/simple/icons/originals.svg 918B
  97. video-text-retrieval-main/code/Graduation_Project/static/style/simple/icons/playbutton.svg 423B
  98. video-text-retrieval-main/code/Graduation_Project/static/style/simple/icons/search.svg 509B
  99. video-text-retrieval-main/code/Graduation_Project/static/style/simple/icons/subscriptions.svg 390B
  100. video-text-retrieval-main/code/Graduation_Project/static/style/simple/icons/upload.svg 423B
  101. video-text-retrieval-main/code/Graduation_Project/static/style/simple/icons/voice-search-icon.svg 561B
  102. video-text-retrieval-main/code/Graduation_Project/static/style/simple/icons/youtube-apps.svg 609B
  103. video-text-retrieval-main/code/Graduation_Project/static/style/simple/icons/youtube-logo.svg 5.62KB
  104. video-text-retrieval-main/code/Graduation_Project/static/style/simple/icons/youtube-music.svg 451B
  105. video-text-retrieval-main/code/Graduation_Project/website/
  106. video-text-retrieval-main/code/Graduation_Project/website/__init__.py
  107. video-text-retrieval-main/code/Graduation_Project/website/__pycache__/
  108. video-text-retrieval-main/code/Graduation_Project/website/__pycache__/__init__.cpython-39.pyc 231B
  109. video-text-retrieval-main/code/Graduation_Project/website/__pycache__/admin.cpython-39.pyc 371B
  110. video-text-retrieval-main/code/Graduation_Project/website/__pycache__/apps.cpython-39.pyc 510B
  111. video-text-retrieval-main/code/Graduation_Project/website/__pycache__/models.cpython-39.pyc 1.23KB
  112. video-text-retrieval-main/code/Graduation_Project/website/__pycache__/urls.cpython-39.pyc 576B
  113. video-text-retrieval-main/code/Graduation_Project/website/__pycache__/views.cpython-39.pyc 2.75KB
  114. video-text-retrieval-main/code/Graduation_Project/website/admin.py 241B
  115. video-text-retrieval-main/code/Graduation_Project/website/apps.py 146B
  116. video-text-retrieval-main/code/Graduation_Project/website/db_build.py 4.3KB
  117. video-text-retrieval-main/code/Graduation_Project/website/migrations/
  118. video-text-retrieval-main/code/Graduation_Project/website/migrations/0001_initial.py 1006B
  119. video-text-retrieval-main/code/Graduation_Project/website/migrations/__init__.py
  120. video-text-retrieval-main/code/Graduation_Project/website/migrations/__pycache__/
  121. video-text-retrieval-main/code/Graduation_Project/website/migrations/__pycache__/0001_initial.cpython-39.pyc 961B
  122. video-text-retrieval-main/code/Graduation_Project/website/migrations/__pycache__/__init__.cpython-39.pyc 174B
  123. video-text-retrieval-main/code/Graduation_Project/website/models.py 1000B
  124. video-text-retrieval-main/code/Graduation_Project/website/templates/
  125. video-text-retrieval-main/code/Graduation_Project/website/templates/website/
  126. video-text-retrieval-main/code/Graduation_Project/website/templates/website/header.html 2.25KB
  127. video-text-retrieval-main/code/Graduation_Project/website/templates/website/home_valoff.html 1.89KB
  128. video-text-retrieval-main/code/Graduation_Project/website/templates/website/home_valon.html 3.3KB
  129. video-text-retrieval-main/code/Graduation_Project/website/templates/website/main.html 916B
  130. video-text-retrieval-main/code/Graduation_Project/website/templates/website/video_player.html 1.31KB
  131. video-text-retrieval-main/code/Graduation_Project/website/tests.py 60B
  132. video-text-retrieval-main/code/Graduation_Project/website/urls.py 577B
  133. video-text-retrieval-main/code/Graduation_Project/website/views.py 5.08KB
  134. video-text-retrieval-main/code/VideoSearchSystem/
  135. video-text-retrieval-main/code/VideoSearchSystem/Model/
  136. video-text-retrieval-main/code/VideoSearchSystem/Model/AIM.py 6.16KB
  137. video-text-retrieval-main/code/VideoSearchSystem/Model/CLIP4Clip.py 4.08KB
  138. video-text-retrieval-main/code/VideoSearchSystem/Model/My_Model.py 4.99KB
  139. video-text-retrieval-main/code/VideoSearchSystem/Model/clip/
  140. video-text-retrieval-main/code/VideoSearchSystem/Model/clip/__init__.py 20B
  141. video-text-retrieval-main/code/VideoSearchSystem/Model/clip/__pycache__/
  142. video-text-retrieval-main/code/VideoSearchSystem/Model/clip/__pycache__/__init__.cpython-38.pyc 177B
  143. video-text-retrieval-main/code/VideoSearchSystem/Model/clip/__pycache__/__init__.cpython-39.pyc 172B
  144. video-text-retrieval-main/code/VideoSearchSystem/Model/clip/__pycache__/clip.cpython-38.pyc 8.65KB
  145. video-text-retrieval-main/code/VideoSearchSystem/Model/clip/__pycache__/clip.cpython-39.pyc 8.75KB
  146. video-text-retrieval-main/code/VideoSearchSystem/Model/clip/__pycache__/model.cpython-38.pyc 16.16KB
  147. video-text-retrieval-main/code/VideoSearchSystem/Model/clip/__pycache__/model.cpython-39.pyc 16.1KB
  148. video-text-retrieval-main/code/VideoSearchSystem/Model/clip/__pycache__/simple_tokenizer.cpython-38.pyc 7.76KB
  149. video-text-retrieval-main/code/VideoSearchSystem/Model/clip/__pycache__/simple_tokenizer.cpython-39.pyc 7.71KB
  150. video-text-retrieval-main/code/VideoSearchSystem/Model/clip/bpe_simple_vocab_16e6.txt.gz 1.29MB
  151. video-text-retrieval-main/code/VideoSearchSystem/Model/clip/clip.py 9.83KB
  152. video-text-retrieval-main/code/VideoSearchSystem/Model/clip/model.py 22KB
  153. video-text-retrieval-main/code/VideoSearchSystem/Model/clip/simple_tokenizer.py 8.53KB
  154. video-text-retrieval-main/code/VideoSearchSystem/README.md 2.53KB
  155. video-text-retrieval-main/code/VideoSearchSystem/TensorDataBase/
  156. video-text-retrieval-main/code/VideoSearchSystem/TensorDataBase/TensorDataBase.py 4.46KB
  157. video-text-retrieval-main/code/VideoSearchSystem/TensorDataBase/__init__.py
  158. video-text-retrieval-main/code/VideoSearchSystem/TensorDataBase/construct.py 7.47KB
  159. video-text-retrieval-main/code/VideoSearchSystem/TensorDataBase/construct_dataloader.py 1.38KB
  160. video-text-retrieval-main/code/VideoSearchSystem/Tools.py 7.76KB
  161. video-text-retrieval-main/code/VideoSearchSystem/VideoSearchSystem.py 5.13KB
  162. video-text-retrieval-main/code/VideoSearchSystem/__init__.py
  163. video-text-retrieval-main/code/VideoSearchSystem/get_args.py 5.59KB
  164. video-text-retrieval-main/code/VideoSearchSystem/preprocess/
  165. video-text-retrieval-main/code/VideoSearchSystem/preprocess/dataloader_keyFrame.py 3.51KB
  166. video-text-retrieval-main/code/VideoSearchSystem/preprocess/frame_extract/
  167. video-text-retrieval-main/code/VideoSearchSystem/preprocess/frame_extract/__init__.py
  168. video-text-retrieval-main/code/VideoSearchSystem/preprocess/frame_extract/__pycache__/
  169. video-text-retrieval-main/code/VideoSearchSystem/preprocess/frame_extract/__pycache__/__init__.cpython-39.pyc 179B
  170. video-text-retrieval-main/code/VideoSearchSystem/preprocess/frame_extract/__pycache__/frame_extract_tool.cpython-39.pyc 5.52KB
  171. video-text-retrieval-main/code/VideoSearchSystem/preprocess/frame_extract/__pycache__/keyFrameExtractor_Uniform.cpython-39.pyc 1.56KB
  172. video-text-retrieval-main/code/VideoSearchSystem/preprocess/frame_extract/__pycache__/keyFrameExtractor_diff.cpython-39.pyc 4.84KB
  173. video-text-retrieval-main/code/VideoSearchSystem/preprocess/frame_extract/frame_extract_tool.py 7.39KB
  174. video-text-retrieval-main/code/VideoSearchSystem/preprocess/frame_extract/keyFrameExtractor_IFrame.py 809B
  175. video-text-retrieval-main/code/VideoSearchSystem/preprocess/frame_extract/keyFrameExtractor_Uniform.py 2.05KB
  176. video-text-retrieval-main/code/VideoSearchSystem/preprocess/frame_extract/keyFrameExtractor_diff.py 5.7KB
  177. video-text-retrieval-main/code/VideoSearchSystem/preprocess/train.csv文件创建.py 1.91KB
  178. video-text-retrieval-main/code/VideoSearchSystem/requirements.txt 201B
  179. video-text-retrieval-main/code/train/
  180. video-text-retrieval-main/code/train/README.md 346B
  181. video-text-retrieval-main/code/train/Tools.py 435B
  182. video-text-retrieval-main/code/train/dataloaders/
  183. video-text-retrieval-main/code/train/dataloaders/__pycache__/
  184. video-text-retrieval-main/code/train/dataloaders/__pycache__/data_dataloaders.cpython-38.pyc 2.16KB
  185. video-text-retrieval-main/code/train/dataloaders/__pycache__/data_dataloaders.cpython-39.pyc 2.15KB
  186. video-text-retrieval-main/code/train/dataloaders/__pycache__/dataloader_keyFrame.cpython-38.pyc 3.56KB
  187. video-text-retrieval-main/code/train/dataloaders/__pycache__/dataloader_keyFrame.cpython-39.pyc 3.56KB
  188. video-text-retrieval-main/code/train/dataloaders/__pycache__/dataloader_msvd_retrieval.cpython-38.pyc 4.9KB
  189. video-text-retrieval-main/code/train/dataloaders/__pycache__/dataloader_msvd_retrieval.cpython-39.pyc 4.91KB
  190. video-text-retrieval-main/code/train/dataloaders/__pycache__/rawvideo_util.cpython-38.pyc 3.53KB
  191. video-text-retrieval-main/code/train/dataloaders/__pycache__/rawvideo_util.cpython-39.pyc 3.5KB
  192. video-text-retrieval-main/code/train/dataloaders/data_dataloaders.py 2.97KB
  193. video-text-retrieval-main/code/train/dataloaders/dataloader_keyFrame.py 3.51KB
  194. video-text-retrieval-main/code/train/dataloaders/dataloader_msvd_retrieval.py 7.71KB
  195. video-text-retrieval-main/code/train/dataloaders/rawvideo_util.py 3.85KB
  196. video-text-retrieval-main/code/train/get_args.py 5.48KB
  197. video-text-retrieval-main/code/train/main_task_retrieval.py 27.02KB
  198. video-text-retrieval-main/code/train/metrics.py 2.96KB
  199. video-text-retrieval-main/code/train/modules/
  200. video-text-retrieval-main/code/train/modules/AIM.py 6.16KB
  201. video-text-retrieval-main/code/train/modules/CLIP4Clip.py 4.05KB
  202. video-text-retrieval-main/code/train/modules/My_Model.py 3.06KB
  203. video-text-retrieval-main/code/train/modules/__init__.py
  204. video-text-retrieval-main/code/train/modules/clip/
  205. video-text-retrieval-main/code/train/modules/clip/__init__.py 20B
  206. video-text-retrieval-main/code/train/modules/clip/__pycache__/
  207. video-text-retrieval-main/code/train/modules/clip/__pycache__/__init__.cpython-38.pyc 177B
  208. video-text-retrieval-main/code/train/modules/clip/__pycache__/__init__.cpython-39.pyc 172B
  209. video-text-retrieval-main/code/train/modules/clip/__pycache__/clip.cpython-38.pyc 8.65KB
  210. video-text-retrieval-main/code/train/modules/clip/__pycache__/clip.cpython-39.pyc 8.75KB
  211. video-text-retrieval-main/code/train/modules/clip/__pycache__/model.cpython-38.pyc 16.16KB
  212. video-text-retrieval-main/code/train/modules/clip/__pycache__/model.cpython-39.pyc 16.1KB
  213. video-text-retrieval-main/code/train/modules/clip/__pycache__/simple_tokenizer.cpython-38.pyc 7.76KB
  214. video-text-retrieval-main/code/train/modules/clip/__pycache__/simple_tokenizer.cpython-39.pyc 7.71KB
  215. video-text-retrieval-main/code/train/modules/clip/bpe_simple_vocab_16e6.txt.gz 1.29MB
  216. video-text-retrieval-main/code/train/modules/clip/clip.py 9.83KB
  217. video-text-retrieval-main/code/train/modules/clip/model.py 22KB
  218. video-text-retrieval-main/code/train/modules/clip/simple_tokenizer.py 8.53KB
  219. video-text-retrieval-main/code/train/modules/file_utils.py 7.83KB
  220. video-text-retrieval-main/code/train/modules/optimization.py 7.09KB
  221. video-text-retrieval-main/code/train/requirements.txt 203B
  222. video-text-retrieval-main/code/train/util.py 2.44KB
  223. video-text-retrieval-main/code/其他/
  224. video-text-retrieval-main/code/其他/.idea/
  225. video-text-retrieval-main/code/其他/.idea/inspectionProfiles/
  226. video-text-retrieval-main/code/其他/.idea/inspectionProfiles/Project_Default.xml 4.65KB
  227. video-text-retrieval-main/code/其他/.idea/inspectionProfiles/profiles_settings.xml 174B
  228. video-text-retrieval-main/code/其他/.idea/misc.xml 211B
  229. video-text-retrieval-main/code/其他/.idea/modules.xml 264B
  230. video-text-retrieval-main/code/其他/.idea/workspace.xml 1.11KB
  231. video-text-retrieval-main/code/其他/.idea/其他.iml 500B
  232. video-text-retrieval-main/code/其他/MSVD数据集csv创建.py 1.74KB
  233. video-text-retrieval-main/code/其他/README.md 157B
  234. video-text-retrieval-main/code/其他/inputs.txt 40.13KB
  235. video-text-retrieval-main/code/其他/inputs1.txt 40.13KB
  236. video-text-retrieval-main/code/其他/inputs2.txt 37.06KB
  237. video-text-retrieval-main/code/其他/temp/
  238. video-text-retrieval-main/code/其他/temp/Tools.py 1.69KB
  239. video-text-retrieval-main/code/其他/temp/__init__.py
  240. video-text-retrieval-main/code/其他/temp/__pycache__/
  241. video-text-retrieval-main/code/其他/temp/__pycache__/Tools.cpython-39.pyc 1.79KB
  242. video-text-retrieval-main/code/其他/temp/__pycache__/__init__.cpython-39.pyc 127B
  243. video-text-retrieval-main/code/其他/temp/__pycache__/frame_extract_tool.cpython-39.pyc 5.48KB
  244. video-text-retrieval-main/code/其他/temp/__pycache__/keyFrameExtractor_Uniform.cpython-39.pyc 1.51KB
  245. video-text-retrieval-main/code/其他/temp/__pycache__/keyFrameExtractor_diff.cpython-39.pyc 4.79KB
  246. video-text-retrieval-main/code/其他/temp/frame_extract_tool.py 7.33KB
  247. video-text-retrieval-main/code/其他/temp/keyFrameExtractor_Uniform.py 2.05KB
  248. video-text-retrieval-main/code/其他/temp/keyFrameExtractor_diff.py 5.81KB
  249. video-text-retrieval-main/code/其他/去除重复行.py 849B
  250. video-text-retrieval-main/code/其他/数据统计.py 2.62KB
  251. video-text-retrieval-main/code/其他/数据统计_recall.py 3.22KB
  252. video-text-retrieval-main/code/其他/数据统计_画图.py 4.19KB
  253. video-text-retrieval-main/code/其他/测试jpg_png.py 582B
  254. video-text-retrieval-main/code/其他/测试ln_and_bn.py 1.41KB
  255. video-text-retrieval-main/code/其他/测试pickle和pandas性能.py 2.05KB
  256. video-text-retrieval-main/code/其他/画diff图.py 682B
  257. video-text-retrieval-main/image/
  258. video-text-retrieval-main/image/检索结果展示页面.jpg 274.84KB
  259. video-text-retrieval-main/image/模型整体结构.svg 8.14KB
  260. video-text-retrieval-main/image/用户搜索视频流程图.svg 10.56KB
  261. video-text-retrieval-main/image/算法整体结构.svg 8.44KB
  262. video-text-retrieval-main/image/视频播放页面.jpg 208.02KB
0评论
提交 加载更多评论
其他资源 永磁同步电机的EKF观测器滤波控制
针对《现代永磁同步电机控制》一书中,扩展卡尔曼滤波算法仿真模型的搭建
河南师范大学软件学院C语言题面_筛选后.zip
河南师范大学软件学院C语言题面_筛选后.zip
Q-Learning在路径规划中的应用(MATLAB版)
针对于已知环境中的路径规划问题,本文提出Q-Learning解决智能体在复杂环境中找到最优路径。最终阶段包括查询 Q 表以选择最佳行动路径。训练完成后,呈现了历时、最小步数、最大奖励值等结果,以及 Q 表的可视化、最短路径和整个训练过程。Q-learning 是强化学习中的一种基于值函数的学习方法,用于解决无模型的马尔可夫决策过程(MDP)问题。在 Q-learning 中,代理尝试学习一个价值函数 Q(s, a),它估计在状态 s 采取动作 a 后所能获得的长期回报的价值。状态 s、动作a、奖励信号r、Q 值函数 (Q-table)、折扣因子 γ、学习率 α、探索-利用策略。图1 Q-Learning结构图状态s:在 Q-learning 中,代理与环境进行交互,环境处于不同的状态。状态是描述环境的特定情况或配置的抽象表示。
Android开发实战经典-030802-文件存储-B-资源文件视频教程.zip
Android开发实战经典_030802_文件存储_B_资源文件视频教程.zip
c语言队列实现(不强制数据类型,包含三种实现)
c语言队列实现(不强制数据类型,包含三种实现)
Allegro-Skill-Xtool一键gerber及生产资料归档工具
Allegro-Skill_Xtool一键gerber及生产资料归档工具
FreeRTOS西西菜鸟.zip
FreeRTOS西西菜鸟.zip
wxFormBuilder-V3.9 绿色免安装版
wxFormBuilder是由softonic推出的一款界面编辑设计工具,这款软件用于生成跨平台编译代码,能够快速搭建GUI开发环境,而且软件右边的编辑栏还会自动变成对应控件的属性编辑,其你可以修改该控件和窗体的各类属性,非常实用。另外,wxFormBuilder也支持快速生成C++,python,Lua等代码和XRC资源文件,而且还搭建高效的带有GUI界面编辑器的开发环境,其操作非常简便,界面简洁清晰,有需求的用户快来下载体验吧!