Skip to content

General AI methods for Anything: AnyObject, AnyGeneration, AnyModel, AnyTask, AnyX

Notifications You must be signed in to change notification settings

VainF/Awesome-Anything

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 

Repository files navigation

Awesome-Anything

Awesome Awesome Anything

A curated list of general AI methods for Anything: AnyObject, AnyGeneration, AnyModel, AnyTask, etc.

Contributions are welcome!

  • Awesome-Anything
    • AnyObject - Segmentation, Detection, Classification, Medical Image, OCR, Pose, etc.
    • AnyGeneration - Text-to-Image Generation, Editing, Inpainting, Style Transfer, Video Frame Interpolation, etc.
    • Any3D - 3D Generation, Segmentation, etc.
    • AnyModel - Any Pruning, Any Quantization, Model Reuse.
    • AnyTask - LLM Controller + ModelZoo, General Decoding, Multi-Task Learning.
    • AnyX - Other Topics: Captioning, etc.
    • Paper List

AnyObject

Title & Authors Intro Useful Links
Star
Segment Anything
Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alex Berg, Wan-Yen Lo, Piotr Dollar, Ross Girshick
> Meta Research
> Preprint'23

[Segment Anything (Project)]
intro [Github]
[Page]
[Demo]
Star
OVSeg: Open-Vocabulary Semantic Segmentation with Mask-adapted CLIP
Feng Liang, Bichen Wu, Xiaoliang Dai, Kunpeng Li, Yinan Zhao, Hang Zhang, Peizhao Zhang, Peter Vajda, Diana Marculescu
> Meta Research
> Preprint'23

[OVSeg (Project)]
image [Github]
[Page]
Star
Learning to Segment Every Thing
Ronghang Hu, Piotr Dollar, Kaiming He, Trevor Darrell, Ross Girshick
> UC Berkeley, FAIR
> CVPR'18

[seg_every_thing (Project)]
image [Github]
[Page]
Star
Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection
Shilong Liu and Zhaoyang Zeng and Tianhe Ren and Feng Li and Hao Zhang and Jie Yang and Chunyuan Li and Jianwei Yang and Hang Su and Jun Zhu and Lei Zhang
> IDEA-Research
> Preprint'23

[Grounded-SAM, GroundingDINO (Project)]
intro [Github]
[Demo]
Star
SegGPT: Segmenting Everything In Context
Xinlong Wang, Xiaosong Zhang, Yue Cao, Wen Wang, Chunhua Shen, Tiejun Huang
> BAAI-Vision
> Preprint'23

[SegGPT (Project)]
image [Github]
V3Det: Vast Vocabulary Visual Detection Dataset
Jiaqi Wang, Pan Zhang, Tao Chu, Yuhang Cao, Yujie Zhou, Tong Wu, Bin Wang, Conghui He, Dahua Lin
> Shanghai AI Laboratory, CUHK
> Preprint'23
image --
Star
segment-anything-video (Project)
Kadir Nar
intro [Github]
Star
Towards Segmenting Anything That Moves
Achal Dave, Pavel Tokmakov, Deva Ramanan
> ICCV'19 Workshop

[segment-any-moving (Project)]
[Github]
Star
Semantic Segment Anything
Jiaqi Chen, Zeyu Yang, Li Zhang

[Semantic-Segment-Anything (Project)]
image [Github]
Star
Grounded Segment Anything: From Objects to Parts (Project)
Peize Sun and Shoufa Chen
intro [Github]
Star
GroundedSAM-zero-shot-anomaly-detection (Project)
Yunkang Cao
image [Github]
Star
Segment Anything Labelling Tool (SALT) (Project)
Anurag Ghosh
intro [Github]
Star
Prompt-Segment-Anything (Project)
Rockey
intro [Github]
Star
SAM-RBox (Project)
Qingyun Li
intro [Github]
Star
VISAM (Project)
Feng Yan, Weixin Luo, Yujie Zhong, Yiyang Gan, Lin Ma
intro [Github]
Star
Segment Anything EO tools: Earth observation tools for Meta AI Segment Anything (Project)
Aliaksandr Hancharenka, Alexander Chichigin
intro [Github]
Star
napari-segment-anything: Segment Anything Model (SAM) native Qt UI (Project)
JordĂŁo Bragantini, Kyle I S Harrington, Ajinkya Kulkarni
image [Github]
Star
SAM-Medical-Imaging: Segment Anything Model (SAM) native Qt UI (Project)
JordĂŁo Bragantini, Kyle I S Harrington, Ajinkya Kulkarni
image [Github]
Star
OCR-SAM: Combining MMOCR with Segment Anything & Stable Diffusion. (Project)
Zhenhua Yang, Qing Jiang
image [Github]
Star
segment-anything-u-specify: using sam+clip to segment any objs u specify with text prompts. (Project)
MaybeShewill-CV
image [Github]
Star
Segment Everything Everywhere All at Once
Xueyan Zou, Jianwei Yang, Hao Zhang, Feng Li, Linjie Li, Jianfeng Gao, Yong Jae Lee

[SEEM (Project)]
image [Github]
Star
SegDrawer: Simple static web-based mask drawer (Project)
Harry
image [Github]
Star
Magic Copy: a Chrome extension (Project)
Harry
image [Github]
Star
Track Anything: Segment Anything Meets Videos
Jinyu Yang, Mingqi Gao, Zhe Li, Shang Gao, Fangjing Wang, Feng Zheng

[Track-Anything (Project)]
Image [Github]
[Demo]
Star
Count Anything (Project)
Liqi Yan
image [Github]
Star
Segment-and-Track-Anything (Project)
Zongxin Yang
image [Github]
Star
Pose for Everything: Towards Category-Agnostic Pose Estimation
Lumin Xu*, Sheng Jin*, Wang Zeng, Wentao Liu, Chen Qian, Wanli Ouyang, Ping Luo, Xiaogang Wang
> CUHK, SenseTime
> ECCV'22 Oral

[Pose-for-Everything (Project)]
image [Github]
Star
Relate Anything Model (Project)
Zujin Guo*, Bo Li*, Jingkang Yang*, Zijian Zhou*, Ziwei Liu
> MMLab@NTU
> VisCom Lab, KCL/TongJi
intro Github
Star
SegmentAnyRGBD (Project)
Jun Cen, Yizheng Wu, Xingyi Li, Jingkang Yang, Yixuan Pei, Lingdong Kong
> Visual Intelligence Lab@HKUST,
> HUST,
> MMLab@NTU,
> Smiles Lab@XJTU,
> NUS
intro Github

Retrieve Any Object via Prompt-based Tracking
Pha Nguyen, Kha Gia Quach, Kris Kitani, Khoa Luu
> CVIU@UArk,
> pdActive Inc.,
> RI@CMU
intro [ArXiv]
[Page]
Star
FoodSAM (Project)
Xing Lan, Jiayi Lyu, Hanyu Jiang, Kun Dong, Zehai Niu, Yi Zhang, Jian Xue
> UCAS
intro [Github]
[Page]
[ArXiv]



AnyGeneration

Title & Authors Intro Useful Links
Star
High-Resolution Image Synthesis with Latent Diffusion Models
Robin Rombach and Andreas Blattmann and Dominik Lorenz and Patrick Esser and Björn Ommer
> LMU MĂĽnchen, Runway ML
> CVPR'22

[Stable-Diffusion (Project)]
intro [Github]
[Page]
[Demo]
Star
Adding Conditional Control to Text-to-Image Diffusion Models
Lvmin Zhang, Maneesh Agrawala
> Stanford University
> Preprint'23

[ControlNet (Project)]
intro [Github]
[Demo]
GigaGAN: Large-scale GAN for Text-to-Image Synthesis
Minguk Kang, Jun-Yan Zhu, Richard Zhang, Jaesik Park, Eli Shechtman, Sylvain Paris, Taesung Park
> POSTECH, Carnegie Mellon University, Adobe Research
> CVPR'23
image [Page]
Star
Inpaint-Anything: Segment Anything Meets Image Inpainting (Project)
Tao Yu
intro [Github]
Star
IEA: Image Editing Anything (Project)
Zhengcong Fei
intro [Github]
Star
EditAnything (Project)
Shanghua Gao, Pan Zhou
intro [Github]
Star
Segment Anything for Stable Diffusion Webui (Project)
Chengsong Zhang
image [Github]
Star
Segment Anything with Clip (Project)
Jinwoo Park
intro [Github]
Star
ShowAnything: Edit and Generate Anything In Image and Video (Project)
Showlab, NUS
intro Github
Star
Transfer-Any-Style: About An interactive demo based on Segment-Anything for style transfer (Project)
LV-Lab, NUS
intro Github
Star
Anything To Image: Generate image from anything with ImageBind and Stable Diffusion (Project)
Zeqiang-Lai
intro Github
Star
Clearer Frames, Anytime: Resolving Velocity Ambiguity in Video Frame Interpolation
Zhihang Zhong, Gurunandan Krishnan, Xiao Sun, Yu Qiao, Sizhuo Ma, Jian Wang
> Shanghai AI Laboratory, Snap Inc.
> Preprint'23
intro [Github]
[Page]
[ArXiv]



Any3D

Title & Authors Intro Useful Links
Star
OpenIns3D: Snap and Lookup for 3D Open-vocabulary Instance Segmentation
Zhening Huang, Xiaoyang Wu, Xi Chen, Hengshuang Zhao, Lei Zhu, Joan Lasenby
> Cambridge, HKU, HKUST

[OpenIns3D]
image [Github]
[Page]
Star
Anything-3D: Segment-Anything + 3D, Let's lift the anything to 3D (Project)
LV-Lab, NUS
intro
intro2
Github
Star
SAM 3D Selector: Utilizing segment-anything to help the region selection of 3D point cloud or mesh. (Project)
Nexuslrf
intro Github
Star
3D-Box via Segment Anything. (Project)
dvlab-research
image [Github]
Star
SAM3D: Segment Anything in 3D Scenes
Yunhan Yang, Xiaoyang Wu, Tong He, Hengshuang Zhao, Xihui Liu
> Shanghai AI Laboratory, HKU

[SAM3D: Segment Anything in 3D Scenes (Project)]
image [Github]



AnyModel

Title & Authors Intro Useful Links
Star
DepGraph: Towards Any Structural Pruning
Gongfan Fang, Xinyin Ma, Mingli Song, Michael Bi Mi, Xinchao Wang
> Learning and Vision Lab @ NUS
> CVPR'23

[Torch-Pruning (Project)]
intro [Github]
[Demo]
Star
MQBench: Towards Reproducible and Deployable Model Quantization Benchmark
Yuhang Li and Mingzhu Shen and Jian Ma and Yan Ren and Mingxin Zhao and Qi Zhang and Ruihao Gong and Fengwei Yu and Junjie Yan
> SenseTime Research
> NeurIPS'21

[MQBench (Project)]
intro [Github]
[Page]
Star
OTOv2: Automatic, Generic, User-Friendly
Tianyi Chen, Luming Liang, Tianyu Ding, Ilya Zharkov
> Microsoft
> ICLR'23

[Only Train Once (Project)]
intro [Github]
Star
Deep Model Reassembly
Xingyi Yang, Daquan Zhou, Songhua Liu, Jingwen Ye, Xinchao Wang
LV Lab, NUS
> NeurIPS'22

[Deep Model Reassembly (Project)]
intro [Github]
[Page]



AnyTask

Title & Authors Intro Useful Links
Star
HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in HuggingFace
Yongliang Shen, Kaitao Song, Xu Tan, Dongsheng Li, Weiming Lu, Yueting Zhuang
> Zhejiang University, MSRA
Preprint'23

[Jarvis (Project)]
[Github]
[Demo]
TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIs
Yaobo Liang, Chenfei Wu, Ting Song, Wenshan Wu, Yan Xia, Yu Liu, Yang Ou, Shuai Lu, Lei Ji, Shaoguang Mao, Yun Wang, Linjun Shou, Ming Gong, Nan Duan
> Microsoft
> > Preprint'23
intro [Github]
Star
Generalized Decoding for Pixel, Image and Language
Xueyan Zou, Zi-Yi Dou, Jianwei Yang, Zhe Gan, Linjie Li, Chunyuan Li, Xiyang Dai, Harkirat Behl, Jianfeng Wang, Lu Yuan, Nanyun Peng, Lijuan Wang, Yong Jae Lee, Jianfeng Gao
> Microsoft
> CVPR'23

[X-Decoder (Project)]
intro [Github]
[Page]
[Demo]
Star
Pre-Trained Image Processing Transformer
Chen, Hanting and Wang, Yunhe and Guo, Tianyu and Xu, Chang and Deng, Yiping and Liu, Zhenhua and Ma, Siwei and Xu, Chunjing and Xu, Chao and Gao, Wen
> Huawei-Noah
> CVPR'21

[Pretrained-IPT (Project)]
intro [Github]
Star
OpenAGI: When LLM Meets Domain Experts
Yingqiang Ge, Wenyue Hua, Jianchao Ji, Juntao Tan, Shuyuan Xu, Yongfeng Zhang
> Rutgers University
> Preprint'23

[OpenAGI (Project)]
intro Github



AnyX

Title & Authors Intro Useful Links
Star
Caption Anything: Interactive Image Description with Diverse Multimodal Controls
Teng Wang, Jinrui Zhang, Junjie Fei, Hao Zheng, Yunlong Tang, Zhe Li, Mingqi Gao, Shanshan Zhao
> SUSTech VIP Lab
> Preprint'23

Caption Anything (Project)
intro [Github]
[Demo]
Star
Image2Paragraph:Transform Image into Unique Paragraph (Project)
Jinpeng Wang
intro Github
...



Paper List for Anything AI

A paper list for Anything AI

AnyObject

Paper First Author Venue Topic
Segment Anything Alexander Kirillov Preprint'23 Segmentation
Learning to Segment Every Thing Ronghang Hu CVPR'18
Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection Shilong Liu Preprint'23 Grounding+Detection
SegGPT: Segmenting Everything In Context Xinlong Wang Preprint'23 Segmentation
V3Det: Vast Vocabulary Visual Detection Dataset Jiaqi Wang Preprint'23 Dataset
Pose for Everything: Towards Category-Agnostic Pose Estimation Lumin Xu ECCV'22 Oral Pose
Type-to-Track: Retrieve Any Object via Prompt-based Tracking Pha Nguyen NeurIPS'23 Grounding+Tracking

AnyGeneration

Paper First Author Venue Topic
High-Resolution Image Synthesis with Latent Diffusion Models Robin Rombach CVPR'22 Text-to-Image Generation
Adding Conditional Control to Text-to-Image Diffusion Models Lvmin Zhang Preprint'23 Controlllable Generation
GigaGAN: Large-scale GAN for Text-to-Image Synthesis Minguk Kang CVPR'23 Large-scale GAN
Inpaint Anything: Segment Anything Meets Image Inpainting Tao Yu Preprint'23 Inpainting

AnyModel

Paper First Author Venue Topic
DepGraph: Towards Any Structural Pruning Gongfan Fang CVPR'23 Network Pruning
MQBench: Towards Reproducible and Deployable Model Quantization Benchmark Yuhang Li NeurIPS'21 Network Quantization
OTOv2: Automatic, Generic, User-Friendly Tianyi Chen ICLR'23 Network Pruning
Deep Model Reassembly Xingyi Yang NeurIPS'22 Model Reuse

AnyTask

Paper First Author Venue Topic
HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in HuggingFace Yongliang Shen Preprint'23 Modelzoo + LLM
TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIs Yaobo Liang Preprint'23 Modelzoo + LLM
Generalized Decoding for Pixel, Image and Language Xueyan Zou CVPR'23 Multi Tasking
Pre-Trained Image Processing Transformer Chen, Hanting CVPR'21 Low-level Vision

About

General AI methods for Anything: AnyObject, AnyGeneration, AnyModel, AnyTask, AnyX

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published