#

vision-language-model

Here are 106 public repositories matching this topic...

Fsoft-AIC / Z-GMOT

[NAACL 2024] Z-GMOT: Zero-shot Generic Multiple Object Tracking

video-understanding vision-language-model open-vocabulary-object-tracking

Updated May 3, 2024
Python

mtakamichi / ZEN-IQA

Official implementation of our IEEE Access paper (2024), ZEN-IQA: Zero-Shot Explainable and No-Reference Image Quality Assessment with Vision Language Model

pytorch clip iqa image-quality-assessment blind-image-quality-assessment pytorch-implementation nr-iqa vision-language-model

Updated May 16, 2024
Python

HaiyiMei / llava-docker

Docker image for LLaVA: Large Language and Vision Assistant

docker ai docker-image chatbot llm vision-language-model llava

Updated Mar 26, 2024
HCL

QuIIL / TQx

Towards a text-based quantitative and explainable histopathology image analysis (MICCAI 2024)

computational-pathology vision-language-model

Updated May 14, 2024

SHTUPLUS / GITM-MR

The official implementation for the ICCV 2023 paper "Grounded Image Text Matching with Mismatched Relation Reasoning".

vision-and-language vision-and-language-pre-training vision-language-dataset vision-language-model vision-language-learning

Updated Dec 8, 2023
Python

YiSyuanChen / SINC

Original PyTorch implementation for ICCV 2023 Paper "SINC: Self-Supervised In-Context Learning for Vision-Language Tasks."

low-resource in-context-learning vision-language-model

Updated Oct 23, 2023
Python

QQBrowserVideoSearch / CBVS-UniCLIP

A Large-Scale Chinese Image-Text Benchmark for Real-World Short Video Search Scenarios

nlp computer-science computer-vision pytorch transformer multi-modal clip vision-language-model

Updated Jan 24, 2024
Python

whwu95 / FreeVA

FreeVA: Offline MLLM as Training-Free Video Assistant

chatbot video-understanding zero-shot-video-captioning video-question-answering chatgpt vision-language-model llava training-free multimodal-large-language-models

Updated May 14, 2024
Python

Ravi-Teja-konda / TunedLlavaDelights

Explore the rich flavors of Indian desserts with TunedLlavaDelights. Utilizing the in Llava fine-tuning, our project unveils detailed nutritional profiles, taste notes, and optimal consumption times for beloved sweets. Dive into a fusion of AI innovation and culinary tradition

dessert nutrition nutrition-information finetuning multimodal multi-modality gpt4 tranformers dalle2 stable-diffusion chatgpt vision-language-model llava vision-language-learning llama2 gpt4v

Updated Mar 17, 2024
Python

jaiprakash1824 / VLM_Adv_Attack

In the dynamic landscape of medical artificial intelligence, this study explores the vulnerabilities of the Pathology Language-Image Pretraining (PLIP) model, a Vision Language Foundation model, under targeted attacks like PGD adversarial attack.

pytorch attention-mechanism clip vulnerability-detection pathology trustworthiness adversarial-attacks attention-visualization pathology-image histopathology-images pgd-adversarial-attacks contrastive-learning trustworthy-machine-learning vision-transformer trustworthy-ai plip-model histopathology-image-classfication vision-language-model

Updated Mar 15, 2024
Jupyter Notebook

Anastasiais-ml / sw_clip

vision-language-model

Updated Oct 31, 2023
Jupyter Notebook

turtle

turtleio / turtle

🐰 shoulda been an app - 🐢

android large-language-models llm vision-language-model llamacpp

Updated May 4, 2024

alexander-moore / vlm

Composition of Multimodal Language Models From Scratch

machine-learning ai vlm llm mllm vision-language-model multimodal-large-language-models mmllm

Updated May 7, 2024
Jupyter Notebook

Mamadou-Keita / FIDAVL

[ICPR 2024] The official repo for FIDAVL: Fake Image Detection and Attribution using Vision-Language Model

image-captioning gans image-forensics deepfake diffusion-models soft-prompt-tuning large-language-model vision-language-model vision-question-answering synthetic-image-attribution

Updated May 10, 2024

EricLee0224 / TOD3Cap

[Submission] A Toolkit for Outdoor 3D Dense Cap. Task with New Dataset and Baseline.

computer-vision dense-captioning 3d-scene-understanding vision-language-model

Updated Apr 3, 2024

williamcfrancis / vlm-comparison-gemini-cog

A comparitive study between the two of the best performing open source Vision Language Models - Google Gemini Vision and CogVLM

ai gemini vision vlm vision-and-language vision-language-model cogvlm google-gemini gemini-pro

Updated Jan 28, 2024
Python

srvCodes / clap4clip

bayesian-inference variational-inference continual-learning catastrophic-forgetting vision-language-model

Updated Apr 11, 2024
Python

Oztobuzz / Vista

This is the official repository for Vista dataset - A Vietnamese multimodal dataset contains more than 700,000 samples of conversations and images

open-source vietnamese dataset vista vietnamese-nlp multimodal multi-modality vision-language-model

Updated May 14, 2024
Python

HenryPengZou / ImplicitAVE

Dataset and Code of "ImplicitAVE: An Open-Source Dataset and Multimodal LLMs Benchmark for Implicit Attribute Value Extraction"

attribute-value-extraction vision-language-model multimodal-llm implicit-attribute-value-extraction

Updated Apr 25, 2024

MIFA-Lab / InstructionGPT-4

About Implementation for paper "InstructionGPT-4: A 200-Instruction Paradigm for Fine-Tuning MiniGPT-4" (https://arxiv.org/abs/2308.12067)

multi-modal-learning vision-language-model minigpt4

Updated Oct 9, 2023
Python

Improve this page

Add a description, image, and links to the vision-language-model topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the vision-language-model topic, visit your repo's landing page and select "manage topics."