ISAT with segment anything

Image segmentation annotation tool with segment anything.

Quick annotate for image segmentation by segment anything

Project updating，suggestions welcome

Demo Video：youtube

演示视频：bilibili

中文 English

Feature

Support semantic segmentation and instance segmentation
Get the mask by SAM (segment anything model) and convert the mask into polygon.
Interactive correction mask, by clicking on the area of interest (not of interest) with the left (right) mouse button.
Support manual creation of polygons.
Support modifying polygons.
Support for adjusting polygon occlusion.
Support opening JSON files annotated by labelme (please backup a copy before opening).
Support exporting annotations as single-channel png images.

INSTALL

1. Run the source code

(1) Create environment

conda create -n ISAT_with_segment_anything python==3.8
conda activate ISAT_with_segment_anything

(2) Install Segment anything

git clone git@github.com:facebookresearch/segment-anything.git
cd segment-anything
pip install -e .
cd ..

(3) Install ISAT_with_segment_anything

git clone https://github.com/yatengLG/ISAT_with_segment_anything.git
cd ISAT_with_segment_anything
pip install -r requirements.txt

(4) Download Segment anything pretrained checkpoint.

Download the checkpoint，and save in the path: ISAT_with_segment_anything/segment_any

H-checkpoint:sam_vit_h_4b8939.pth

H checkpoint has best effect, but need more resources.VRAM needs at least 8G.
L-checkpoint:sam_vit_l_0b3195.pth

L checkpoint has normal effect and normal resources.VRAM needs at least 7G.
B-checkpoint:sam_vit_b_01ec64.pth

B checkpoint has pool effect, but need less resources.VRAM needs at least 6G.

(5) Run

python main.py

Explain

The software needs to run well under the GPU and enought VRAM.
If you don't have a GPU or don't have enought VARM, please manually draw polygons for labeling by ISAT.

Citation

@misc{ISAT with segment anything,
  title={{ISAT with segment anything}: Image segmentation annotation tool with segment anything},
  url={https://github.com/yatengLG/ISAT_with_segment_anything},
  note={Open source software available from https://github.com/yatengLG/ISAT_with_segment_anything},
  author={yatengLG and horffmanwang},
  year={2023},
}

2.9 KiB Raw Blame History Unescape Escape