ultralytics 8.2.70 Segment Anything Model 2 (SAM 2) (#14813)
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com> Co-authored-by: UltralyticsAssistant <web@ultralytics.com> Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
This commit is contained in:
Laughing
GitHub
parent
80f699ae21
commit
8648572809
36 changed files with 3276 additions and 77 deletions
16
docs/en/reference/models/sam2/modules/decoders.md
Normal file
16
docs/en/reference/models/sam2/modules/decoders.md
Normal file
|
|
@ -0,0 +1,16 @@
|
|||
---
|
||||
description: Explore the MaskDecoder and MLP modules in Ultralytics for efficient mask prediction using transformer architecture. Detailed attributes, functionalities, and implementation.
|
||||
keywords: Ultralytics, MaskDecoder, MLP, machine learning, transformer architecture, mask prediction, neural networks, PyTorch modules
|
||||
---
|
||||
|
||||
# Reference for `ultralytics/models/sam2/modules/decoders.py`
|
||||
|
||||
!!! Note
|
||||
|
||||
This file is available at [https://github.com/ultralytics/ultralytics/blob/main/ultralytics/models/sam2/modules/decoders.py](https://github.com/ultralytics/ultralytics/blob/main/ultralytics/models/sam2/modules/decoders.py). If you spot a problem please help fix it by [contributing](https://docs.ultralytics.com/help/contributing/) a [Pull Request](https://github.com/ultralytics/ultralytics/edit/main/ultralytics/models/sam2/modules/decoders.py) 🛠️. Thank you 🙏!
|
||||
|
||||
<br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.decoders.MaskDecoder
|
||||
|
||||
<br><br>
|
||||
28
docs/en/reference/models/sam2/modules/encoders.md
Normal file
28
docs/en/reference/models/sam2/modules/encoders.md
Normal file
|
|
@ -0,0 +1,28 @@
|
|||
---
|
||||
description: Discover the Ultralytics SAM 2 module for object segmentation. Learn about its components, such as image encoders and mask decoders, in this comprehensive guide.
|
||||
keywords: Ultralytics, SAM 2 Module, object segmentation, image encoder, mask decoder, prompt encoder, AI, machine learning
|
||||
---
|
||||
|
||||
# Reference for `ultralytics/models/sam2/modules/encoders.py`
|
||||
|
||||
!!! Note
|
||||
|
||||
This file is available at [https://github.com/ultralytics/ultralytics/blob/main/ultralytics/models/sam2/modules/encoders.py](https://github.com/ultralytics/ultralytics/blob/main/ultralytics/models/sam2/modules/encoders.py). If you spot a problem please help fix it by [contributing](https://docs.ultralytics.com/help/contributing/) a [Pull Request](https://github.com/ultralytics/ultralytics/edit/main/ultralytics/models/sam2/modules/encoders.py) 🛠️. Thank you 🙏!
|
||||
|
||||
<br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.encoders.MemoryEncoder
|
||||
|
||||
<br><br><hr><br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.encoders.ImageEncoder
|
||||
|
||||
<br><br><hr><br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.encoders.FpnNeck
|
||||
|
||||
<br><br><hr><br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.encoders.Hiera
|
||||
|
||||
<br><br>
|
||||
20
docs/en/reference/models/sam2/modules/memory_attention.md
Normal file
20
docs/en/reference/models/sam2/modules/memory_attention.md
Normal file
|
|
@ -0,0 +1,20 @@
|
|||
---
|
||||
description: Explore detailed documentation of various SAM 2 encoder modules such as MemoryAttentionLayer, MemoryAttention, available in Ultralytics' repository.
|
||||
keywords: Ultralytics, SAM 2 encoder, MemoryAttentionLayer, MemoryAttention
|
||||
---
|
||||
|
||||
# Reference for `ultralytics/models/sam2/modules/memory_attention.py`
|
||||
|
||||
!!! Note
|
||||
|
||||
This file is available at [https://github.com/ultralytics/ultralytics/blob/main/ultralytics/models/sam2/modules/memory_attention.py](https://github.com/ultralytics/ultralytics/blob/main/ultralytics/models/sam2/modules/memory_attention.py). If you spot a problem please help fix it by [contributing](https://docs.ultralytics.com/help/contributing/) a [Pull Request](https://github.com/ultralytics/ultralytics/edit/main/ultralytics/models/sam2/modules/memory_attention.py) 🛠️. Thank you 🙏!
|
||||
|
||||
<br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.memory_attention.MemoryAttentionLayer
|
||||
|
||||
<br><br><hr><br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.memory_attention.MemoryAttention
|
||||
|
||||
<br><br>
|
||||
16
docs/en/reference/models/sam2/modules/sam2.md
Normal file
16
docs/en/reference/models/sam2/modules/sam2.md
Normal file
|
|
@ -0,0 +1,16 @@
|
|||
---
|
||||
description: Discover the Ultralytics SAM 2 module for object segmentation. Learn about its components, such as image encoders and mask decoders, in this comprehensive guide.
|
||||
keywords: Ultralytics, SAM 2 Module, object segmentation, image encoder, mask decoder, prompt encoder, AI, machine learning
|
||||
---
|
||||
|
||||
# Reference for `ultralytics/models/sam2/modules/sam2.py`
|
||||
|
||||
!!! Note
|
||||
|
||||
This file is available at [https://github.com/ultralytics/ultralytics/blob/main/ultralytics/models/sam2/modules/sam2.py](https://github.com/ultralytics/ultralytics/blob/main/ultralytics/models/sam2/modules/sam2.py). If you spot a problem please help fix it by [contributing](https://docs.ultralytics.com/help/contributing/) a [Pull Request](https://github.com/ultralytics/ultralytics/edit/main/ultralytics/models/sam2/modules/sam2.py) 🛠️. Thank you 🙏!
|
||||
|
||||
<br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.sam2.SAM2Model
|
||||
|
||||
<br><br>
|
||||
56
docs/en/reference/models/sam2/modules/sam2_blocks.md
Normal file
56
docs/en/reference/models/sam2/modules/sam2_blocks.md
Normal file
|
|
@ -0,0 +1,56 @@
|
|||
---
|
||||
description: Explore detailed documentation of various SAM 2 modules such as MaskDownSampler, CXBlock, and more, available in Ultralytics' repository.
|
||||
keywords: Ultralytics, SAM 2 encoder, DropPath, MaskDownSampler, CXBlock, Fuser, TwoWayTransformer, TwoWayAttentionBlock, RoPEAttention, MultiScaleAttention, MultiScaleBlock. PositionEmbeddingSine, do_pool
|
||||
---
|
||||
|
||||
# Reference for `ultralytics/models/sam2/modules/sam2_blocks.py`
|
||||
|
||||
!!! Note
|
||||
|
||||
This file is available at [https://github.com/ultralytics/ultralytics/blob/main/ultralytics/models/sam2/modules/sam2_blocks.py](https://github.com/ultralytics/ultralytics/blob/main/ultralytics/models/sam2/modules/sam2_blocks.py). If you spot a problem please help fix it by [contributing](https://docs.ultralytics.com/help/contributing/) a [Pull Request](https://github.com/ultralytics/ultralytics/edit/main/ultralytics/models/sam2/modules/sam2_blocks.py) 🛠️. Thank you 🙏!
|
||||
|
||||
<br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.sam2_blocks.DropPath
|
||||
|
||||
<br><br><hr><br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.sam2_blocks.MaskDownSampler
|
||||
|
||||
<br><br><hr><br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.sam2_blocks.CXBlock
|
||||
|
||||
<br><br><hr><br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.sam2_blocks.Fuser
|
||||
|
||||
<br><br><hr><br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.sam2_blocks.TwoWayAttentionBlock
|
||||
|
||||
<br><br><hr><br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.sam2_blocks.TwoWayTransformer
|
||||
|
||||
<br><br><hr><br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.sam2_blocks.RoPEAttention
|
||||
|
||||
<br><br><hr><br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.sam2_blocks.MultiScaleAttention
|
||||
|
||||
<br><br><hr><br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.sam2_blocks.MultiScaleBlock
|
||||
|
||||
<br><br><hr><br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.sam2_blocks.PositionEmbeddingSine
|
||||
|
||||
<br><br><hr><br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.sam2_blocks.do_pool
|
||||
|
||||
<br><br>
|
||||
44
docs/en/reference/models/sam2/modules/utils.md
Normal file
44
docs/en/reference/models/sam2/modules/utils.md
Normal file
|
|
@ -0,0 +1,44 @@
|
|||
---
|
||||
description: Explore the detailed API reference for Ultralytics SAM 2 models.
|
||||
keywords: Ultralytics, SAM 2, API Reference, models, window partition, data processing, YOLO
|
||||
---
|
||||
|
||||
# Reference for `ultralytics/models/sam2/modules/utils.py`
|
||||
|
||||
!!! Note
|
||||
|
||||
This file is available at [https://github.com/ultralytics/ultralytics/blob/main/ultralytics/models/sam2/modules/utils.py](https://github.com/ultralytics/ultralytics/blob/main/ultralytics/models/sam2/modules/utils.py). If you spot a problem please help fix it by [contributing](https://docs.ultralytics.com/help/contributing/) a [Pull Request](https://github.com/ultralytics/ultralytics/edit/main/ultralytics/models/sam2/modules/utils.py) 🛠️. Thank you 🙏!
|
||||
|
||||
<br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.utils.select_closest_cond_frames
|
||||
|
||||
<br><br><hr><br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.utils.get_1d_sine_pe
|
||||
|
||||
<br><br><hr><br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.utils.init_t_xy
|
||||
|
||||
<br><br><hr><br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.utils.compute_axial_cis
|
||||
|
||||
<br><br><hr><br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.utils.reshape_for_broadcast
|
||||
|
||||
<br><br><hr><br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.utils.apply_rotary_enc
|
||||
|
||||
<br><br><hr><br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.utils.window_partition
|
||||
|
||||
<br><br><hr><br>
|
||||
|
||||
## ::: ultralytics.models.sam2.modules.utils.window_unpartition
|
||||
|
||||
<br><br>
|
||||
Loading…
Add table
Add a link
Reference in a new issue