# milvus-io-bootcamp

**Repository Path**: calledbo/milvus-io-bootcamp

## Basic Information

- **Project Name**: milvus-io-bootcamp
- **Description**: milvus bootcamp
- **Primary Language**: Unknown
- **License**: Apache-2.0
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 1
- **Forks**: 0
- **Created**: 2023-06-11
- **Last Updated**: 2024-02-26

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

<!-- PROJECT LOGO -->

<p align="center">
  <a href="https://github.com/milvus-io/bootcamp">
    <img src="images/logo.png" alt="Logo">
  </a>
  <p align="center" style="padding-left: 100px; padding-right: 100px">
      Dealing with all unstructured data, such as reverse image search, audio search, molecular search, video analysis, question and answer systems, NLP, etc.
    <br />
    <br />
    <a href="https://github.com/milvus-io/bootcamp/issues">Report Bug or Request Feature</a>
  </p>
<!-- DEMO -->
<table>
  <tr>
    <td width="30%">
      <a href="https://milvus.io/milvus-demos/">
        <img src="https://zilliz-cms.s3.us-west-2.amazonaws.com/image_search_59a64e4f22.gif" />
      </a>
    </td>
    <td width="30%">
<a href="https://milvus.io/milvus-demos/">
<img src="https://zilliz-cms.s3.us-west-2.amazonaws.com/qa_df5ee7bd83.gif" />
</a>
    </td>
    <td width="30%">
<a href="https://milvus.io/milvus-demos/">
<img src="https://zilliz-cms.s3.us-west-2.amazonaws.com/mole_search_76f8340572.gif" />
</a>
    </td>
  </tr>
  <tr>
    <th align="center">
      <a href="https://milvus.io/milvus-demos/">Reverse Image search</a>
    </th>
    <th align="center">
      <a href="https://milvus.io/milvus-demos/">Chatbots</a>
    </th>
    <th align="center">
      <a href="https://milvus.io/milvus-demos/">Chemical structure search</a>
    </th>
  </tr>
</table>

<!-- TABLE OF CONTENTS -->
<details open="open">
  <summary>Table of Contents</summary>
  <ol>
    <li>
      <a href="#mega-about-milvus-bootcamp">About Milvus Bootcamp</a>
    </li>
    <li>
      <a href="#pencil-solutions">Solutions</a>
      <ul>
        <li><a href="#icecream-run-locally">Run locally</a></li>
        <li><a href="#clapper-live-demo">Live demo</a></li>
      </ul>
    </li>
    <li>
      <a href="#mag-benchmark-tests">Benchmark Tests</a>
      <ul>
        <li><a href="#dart-1-million-benchmark-testing">1 million benchmark testing</a></li>
        <li><a href="#art-100-million-benchmark-testing">100 million benchmark testing</a></li>
      </ul>
    </li>
    <li><a href="#two_women_holding_hands-collaborations">Collaborations</a></li>
      <ul>
        <li><a href="#clap-milvus_and_onnx">Milvus_and_ONNX</a></li>
      </ul>
    <li><a href="#pencil-contributing">Contributing</a></li>
    <li><a href="#fire-supports">Supports</a></li>
    </ol>
</details>

<!-- ABOUT MILVUS Bootcamp -->

## :mega: About Milvus Bootcamp

**Embed everything**, thanks to AI, we can use neural networks to extract feature vectors from unstructured data, such as image, audio and vide etc. Then analyse the unstructured data by calculating the feature vectors, for example calculating the Euclidean or Cosine distance of the vectors to get the similarity.

[Milvus Bootcamp](https://github.com/milvus-io/bootcamp) is designed to expose users to both the simplicity and depth of the [**Milvus**](https://milvus.io/) vector database. Discover how to run **benchmark tests** as well as build similarity search applications like **chatbots**, **recommender systems**, **reverse image search**, **molecular search**, **video search**, **audio search**, and more.

<!--ALL SOLUTIONS-->

## :pencil: Solutions

### :icecream: Run locally

Here are several solutions for a wide range of scenarios. Each solution contains a Jupyter Notebook and a Docker deployable solution, meaning anyone can run it on their local machine. In addition to this there are also some related technical articles and live streams.

> You can also refer to the [Bootcamp FAQ](./bootcamp_faq.md) for troubleshooting, and if you have any ideas or suggestions, you are more than welcome to [submit an issue](https://github.com/milvus-io/bootcamp/issues).

<table>
   <tr>
        <td width="40%"><b>Solutions</b></td>
     		<td><b>Have fun with it</b></td>
        <td><b>Article</b></td>
        <td><b>Video</b></td>
   </tr>
   <tr>
       <td><a href="./solutions/image/reverse_image_search">Reverse Image Search</a>
        <p>Build a reverse image search system using Milvus paired with Towhee for feature extraction.</p>
     </td>
      <td>
        <p>- <a href="https://github.com/towhee-io/examples/tree/main/image/reverse_image_search">Jupyter notebook</a></p>
        <p>- <a href="solutions/image/reverse_image_search/quick_deploy">Quick deploy</a></p>
        <p>- <a href="solutions/image/reverse_image_search/object_detection">Object detection</a></p>
     </td>
      <td>
        <p>- <a href="https://zhuanlan.zhihu.com/p/517360724">10 行代码搞定以图搜图</a></p>
        <p>- <a href="https://milvus.io/blog/building-a-search-by-image-shopping-experience-with-vova-and-milvus.md">Building a Search by Image Shopping Experience with VOVA and Milvus</a></p>
     </td>
     <td>
        <p>- <a href="https://www.bilibili.com/video/BV1SN411o79n">中文</a></p>
     </td>
   </tr>
   <tr>
      <td>
        <p><a href="./solutions/image/text_image_search">Text Image Search</a></p>
        <p>Search for matched or related images given an input text by Milvus and Towhee. </p></td>
      <td>- <a href="https://github.com/towhee-io/examples/tree/main/image/text_image_search">Jupyter notebook</a></td>
      <td>
        <p>- <a href="https://zhuanlan.zhihu.com/p/531951677">从零到一，教你搭建「CLIP 以文搜图」搜索服务（一）</a></p>
        <p>- <a href="https://zhuanlan.zhihu.com/p/537123858">从零到一，教你搭建「CLIP 以文搜图」搜索服务（二）：5 分钟实现原型</a></p>
      </td>
      <td></td>
   </tr>
   <tr>
      <td rowspan="2">
        <p><a href="./solutions/nlp/question_answering_system">Question Answering</a></p>
        <p>System Build an intelligent chatbot using Milvus and Towhee for natural language processing (NLP).</p>
     </td>
      <td>
        <p>-<a href="https://github.com/towhee-io/examples/tree/main/nlp/question_answering"> Jupyter notebook</a></p>
        <p>-<a href="solutions/nlp/question_answering_system/quick_deploy"> Quick deploy</a></p>
     </td>
      <td>
          <p>-<a href="https://mp.weixin.qq.com/s/BZp4CMv2yuVb0oEyuDKNkw">快速搭建对话机器人，就用这一招！</a></p>
        <p>-<a href="https://medium.com/voice-tech-podcast/building-an-intelligent-qa-system-with-nlp-and-milvus-75b496702490">Building an Intelligent QA System with NLP and Milvus</a></p>
     </td>
     <td>
        <p>-<a href="https://www.bilibili.com/video/BV1ki4y1t72o">中文</a></p>
     </td>
   </tr>
   <tr>
      <td>
        <p>-<a href="https://github.com/PaddlePaddle/PaddleNLP/tree/develop/pipelines/examples/question-answering">PaddlePaddle(QA 中文)</a></p>
        <p>-<a href="https://github.com/PaddlePaddle/PaddleNLP/tree/develop/pipelines/examples/FAQ">PaddlePaddle(FAQ 中文)</a></p>
     </td>
      <td></td>
      <td></td>
   </tr>
   <tr>
      <td rowspan="2">
        <p><a href="./solutions/nlp/text_search_engine">Text Search Engine</a></p>
        <p>Build a text search engine using Milvus and BERT model. </p>
     </td>
      <td>
        <p>- <a href="https://github.com/towhee-io/examples/tree/main/nlp/text_search">Jupyter notebook</a></p>
        <p>- <a href="solutions/nlp/text_search_engine/quick_deploy">Quick deploy</a></p>
     </td>
      <td>- <a href="https://mp.weixin.qq.com/s/OUrBSCqnLuh9btyK3SxWgQ">Milvus 实战 | Milvus 与 BERT 搭建文本搜索</a></td>
      <td>- <a href="https://www.bilibili.com/video/BV1Xi4y1E7Tb">中文</a></td>
   </tr>
     <tr>
      <td>
        <p>- <a href="https://github.com/PaddlePaddle/PaddleNLP/tree/develop/applications/neural_search">PaddlePaddle(中文)</a></p>
     </td>
      <td></td>
      <td></td>
   </tr>
   <tr>
      <td>
        <p><a href="./solutions/nlp/recommender_system">Recommender System </a></p>
        <p>Build an AI-powered movie recommender system using Milvus paired with PaddlePaddle’s deep learning framework. </p>
     </td>
      <td>
        <p>- <a href="solutions/nlp/recommender_system/recommender_system.ipynb">Jupyter notebook</a></p>
        <p>- <a href="solutions/nlp/recommender_system/quick_deploy">Quick deploy </a></td>
      <td>- <a href="https://mp.weixin.qq.com/s/nAr45u-ruvhWQ8LcVxbhOg">强强联手！Milvus 与 PaddlePaddle 深度整合，赋能工业级 AI 应用</a></td>
      <td></td>
   </tr>
   <tr>
      <td><p><a href="./solutions/video/video_similarity_search">Video Similarity Search</a></p>
        <p>Build a video similarity search engine using Milvus and Towhee. </p>
     </td>
      <td>
        <p>- <a href="https://github.com/towhee-io/examples/tree/main/video/reverse_video_search">Jupyter notebook</a></p>
        <p>- <a href="solutions/video/video_similarity_search/quick_deploy">Quick deploy</a> </p>
        <p>- <a href="solutions/video/video_similarity_search/object_detection">Object detection </a></p>
     </td>
      <td>
        <p>- <a href="https://mp.weixin.qq.com/s/DOfiGP5BG_9sD7zZair4ew">Milvus实战｜ 以图搜视频系统</a></p>
  		<p>- <a href="https://milvus.io/blog/2021-10-10-milvus-helps-analyze-videos.md">Building a Video Analysis System with Milvus Vector Database</a></p>
	  </td>
	  <td></td>
   </tr>
   <tr>
      <td>
        <p><a href="./solutions/video/video_deduplication">Video Deduplication</a></p>
        <p>Build a video deduplication system to detect copied video sharing duplicate segments.</p>
     </td>
     <td>
        <p>- <a href="https://github.com/towhee-io/examples/tree/main/video/video_deduplication">Jupyter notebook</a></p>
      </td>
      <td></td>
      <td></td>
   </tr>
   <tr>
      <td>
        <p><a href="./solutions/video/text_video_search">Text Video Search </a></p>
        <p>Search for matched or related videos given an input text by Milvus and Towhee. </p>
     </td>
      <td>- <a href="https://github.com/towhee-io/examples/tree/main/video/text_video_retrieval">Jupyter notebook</a></td>
      <td>- <a href="https://zhuanlan.zhihu.com/p/584641533">5分钟实现「视频检索」：基于内容理解，无需任何标签</a></td>
      <td></td>
   </tr>
   <tr>
      <td>
        <p><a href="./solutions/audio/audio_similarity_search">Audio Similarity Search</a> </p>
        <p>Build an audio search engine using Milvus paired with PANNs for audio pattern recognition. </p>
     </td>
      <td>
        <p>- <a href="solutions/audio/audio_similarity_search/audio_similarity_search.ipynb">Jupyter notebook </a></p>
        <p>- <a href="solutions/audio/audio_similarity_search/quick_deploy">Quick deploy </a></p>
     </td>
      <td>- <a href="https://mp.weixin.qq.com/s/PJfO71YOTW2gXO6SL-OOuA">基于 Milvus 的音频检索系统</a></td>
      <td></td>
   </tr>
   <tr>
      <td>
        <p><a href="./solutions/audio/audio_classification">Audio Classification</a></p>
        <p>Build an audio classification engine using Milvus & Towhee to classify audio.</p>
     </td>
      <td>
        <p>- <a href="https://github.com/towhee-io/examples/tree/main/audio/audio_classification">Jupyter notebook</a></p>
     </td>
      <td></td>
      <td></td>
   </tr>
   <tr>
      <td>
        <p><a href="./solutions/audio/audio_fp">Audio Fingerprinting</a> </p>
        <p>Build engines based on audio fingerprints using Milvus & Towhee, such as music detection system.</p>
     </td>
      <td>
        <p>- <a href="https://github.com/towhee-io/examples/tree/main/audio/audio_fingerprint">Jupyter notebook</a></p>
     </td>
      <td></td>
      <td></td>
   </tr>
   <tr>
      <td>
        <p><a href="./solutions/medical/molecular_similarity_search">Molecular Similarity Search </a></p>
        <p>Build a molecular similarity search system using Milvus paired with RDKit for cheminformatics. </p>
     </td>
      <td><p>- <a href="https://github.com/towhee-io/examples/tree/main/medical/molecular_search">Jupyter notebook</a></p>
          <p>- <a href="solutions/medical/molecular_similarity_search/quick_deploy">Quick deploy</a></p>
      </td>
      <td>- <a href="https://mp.weixin.qq.com/s/ZIH_zYltT6aJNQYMhOSsAg">Milvus 赋能 AI 药物研发</a></td>
      <td>- <a href="https://www.bilibili.com/video/BV1dD4y1D7zS">中文</a></td>
   </tr>
   <tr>
      <td>
        <p><a href="./solutions/medical/dna_sequence_classification">DNA Sequence Classification</a></p>
        <p>Build a DNA sequence classification system using Milvus with k-mers & CountVectorizer. </p>
     </td>
      <td>
        <p>- <a href="solutions/medical/dna_sequence_classification/dna_sequence_classification.ipynb">Jupyter notebook</a></p>
        <p>- <a href="solutions/medical/dna_sequence_classification/quick_deploy">Quick deploy </a></p>
      </td>
      <td>- <a href="https://my.oschina.net/u/4209276/blog/5191465">用 AI 识别基因，从向量化 DNA 序列开始</a></td>
      <td></td>
   </tr>
   <tr>
      <td>
        <p><a href="./solutions/image/face_recognition_system">Face Recognition System</a></p>
        <p>Build a Face Recognition Pipeline using Milvus Vector Database to store face embeddings & perform face similaity search. </p>
     </td>
      <td>
        <p>- <a href="./solutions/image/face_recognition_system/face_recognition_bootcamp.ipynb">Jupyter notebook </a></p>
        <p>- <a href="./solutions/image/face_recognition_system/quick_deploy">Quick deploy </a></p>
      </td>
      <td></td>
      <td></td>
   </tr>
</table>

### :clapper: Live Demo

We have built [online demos](https://milvus.io/milvus-demos/) for reverse image search, chatbot and molecular search that everyone can have fun with.

<!-- BENCHMARK TESTS-->

## :mag: Benchmark Tests

The [Benchmark Test](./benchmark_test) contains 1 million and 100 million vector tests that indicate how your system will react to differently sized datasets.

 ### :dart: [1 million benchmark testing](https://github.com/milvus-io/bootcamp/blob/master/benchmark_test/lab1_sift1b_1m.md)

We extracted one million vectors from the [SIFT1B Dataset](http://corpus-texmex.irisa.fr/) for **accuracy tests** and **performance tests**. Through [this test](./benchmark_test/lab1_sift1b_1m.md), you can learn the basic operations of Milvus, including creating collections, inserting data, building indexes, searching, etc.

 ### :art: [100 million benchmark testing](https://github.com/milvus-io/bootcamp/blob/master/benchmark_test/lab2_sift1b_100m.md)

We extracted 100 million vectors from the [SIFT1B Dataset](http://corpus-texmex.irisa.fr/) for **accuracy tests** and **performance tests**. Through [this test](./benchmark_test/lab2_sift1b_100m.md), you can learn the basic operations of Milvus, including creating collections, inserting data, building indexes, searching, etc.

<!--THE COLLABORATIONS-->

## :two_women_holding_hands: Collaborations

### :clap: [Milvus_and_ONNX](etc/onnx_and_milvus)

Build a reverse image search system with Milvus using various AI models in collaboration with the Open Neural Network Exchange (ONNX).


## :pencil: Contributing

Contributions to Milvus Bootcamp are welcome from everyone. See [Guidelines for Contributing](./contributing.md) for details. 


## :fire: Supports

Join the Milvus community on [Slack](https://join.slack.com/t/milvusio/shared_invite/zt-e0u4qu3k-bI2GDNys3ZqX1YCJ9OM~GQ) to give feedback, ask for advice, and direct questions to our engineering team. We also have a [WeChat group](images/wechat_group.png).