#

multimodal-learning

Here are 237 public repositories matching this topic...

DmitryRyumin / ICASSP-2023-24-Papers

ICASSP 2023-2024 Papers: A complete collection of influential and exciting research papers from the ICASSP 2023-24 conferences. Explore the latest advancements in acoustics, speech and signal processing. Code included. Star the repository to support the advancement of audio and signal processing!

Updated Jun 7, 2024
Python

friedrichor / Awesome-Multimodal-Papers

A curated list of awesome Multimodal studies.

deep-learning multimodal-learning multimodal multimodal-deep-learning multimodal-data multimodal-dialogue multimodal-large-language-models large-multimodal-models

Updated Jun 6, 2024
HTML

AlfredsLapkovskis / MultimodalPlantClassifier-iOS

Source code of a sample iOS app for the paper by Alfreds Lapkovskis, Natalia Nefedova & Ali Beikmohammadi (2024): Automatic Fused Multimodal Deep Learning for Plant Identification

deep-learning neural-architecture-search plant-identification multimodal-learning architecture-search multimodal-fusion fusion-automation

Updated Jun 6, 2024
Swift

AlfredsLapkovskis / MultimodalPlantClassifier

Source code for the paper by Alfreds Lapkovskis, Natalia Nefedova & Ali Beikmohammadi (2024): Automatic Fused Multimodal Deep Learning for Plant Identification

deep-learning neural-architecture-search plant-identification multimodal-learning architecture-search multimodal-fusion fusion-automation

Updated Jun 6, 2024
PureBasic

JMcardenas / CS4ML

This is a repository for CS4ML. It is a general framework for active learning in regression problems. It approximates a target function arising from general types of data, rather than pointwise samples.

compressed-sensing tensorflow matlab generative-model partial-differential-equations polynomial-regression regression-models active-learning sampling-methods least-square-regression multimodal-learning mri-reconstruction burgers-equation leverage-score pinns christoffel-functions gradient-augmented

Updated Jun 5, 2024
MATLAB

moranyanuka / icc_code

[ACL 2024 (Findings)] ICC: Quantifying Image Caption Concreteness for Multimodal Dataset Curation

dataset-filtering multimodal-learning dataset-curation

Updated Jun 5, 2024

sangminwoo / awesome-vision-and-language

A curated list of awesome vision and language resources (still under construction... stay tuned!)

awesome awesome-list multimodal-learning vision-and-language

Updated Jun 5, 2024

yueying-teng / generate-language-image-instruction-following-data

mistral multimodal-learning llm langchain llava vllm llama-cpp-python instruction-following-data

Updated Jun 5, 2024
Python

pliang279 / awesome-multimodal-ml

Reading list for research topics in multimodal machine learning

machine-learning natural-language-processing reinforcement-learning computer-vision deep-learning robotics healthcare reading-list representation-learning speech-processing multimodal-learning

Updated Jun 5, 2024

UCSC-VLAA / CLIPA

[NeurIPS 2023] This repository includes the official implementation of our paper "An Inverse Scaling Law for CLIP Training"

deep-learning pytorch zero-shot-learning multimodal-learning contrastive-learning zero-shot-classification foundation-models neurips-2023

Updated Jun 3, 2024
Python

MMMU-Benchmark / MMMU

This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"

machine-learning natural-language-processing deep-neural-networks computer-vision deep-learning evaluation question-answering stem multimodality multimodal-learning visual-question-answering multimodal multimodal-deep-learning foundation-models large-language-models llm llms large-multimodal-models

Updated May 31, 2024
Python

pliang279 / MultiViz

[ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models

machine-learning natural-language-processing computer-vision multimodal-learning

Updated May 30, 2024
Python

pykale

pykale / pykale

Knowledge-Aware machine LEarning (KALE): accessible machine learning from multiple sources for interdisciplinary research, part of the 🔥PyTorch ecosystem. ⭐ Star to support our work!

python data-science machine-learning computer-vision deep-learning pytorch transfer-learning graph-analysis domain-adaptation meta-learning medical-image-analysis multimodal-learning multimodal knowledge-aware-learning

Updated May 29, 2024
Python

antonio-f / Phi-3-Vision

Phi-3-Vision model test - running locally

machine-learning computer-vision jupyter-notebook artificial-intelligence image-to-text multimodal-learning hands-on hugging-face multimodal-models llms running-locally tiny-models small-models phi-3 phi-3-vision

Updated May 29, 2024
Jupyter Notebook

minjoong507 / BM-DETR

[arXiv 23] Pytorch code for "Overcoming Weak Visual-Textual Alignment for Video Moment Retrieval"

multimodal-learning video-retrieval video-grounding

Updated May 28, 2024
Python

minjoong507 / MPGN

[EMNLP 2022] Pytorch code for "Modal-specific Pseudo Query Generation for Video Corpus Moment Retrieval"

multimodal-learning video-retrieval video-grounding

Updated May 28, 2024
Python

GAIR-Lab / IISAN

IISAN: Efficiently Adapting Multimodal Representation for Sequential Recommendation with Decoupled PEFT

representation-learning memory-efficient multimodal-learning peft efficiency-analysis multimodal-representation sequential-recommendation multimodal-recommendation iisan

Updated May 26, 2024
Python

RobinDong / tiny_multimodal

Tiny and simple implementation of multimodal models

computer-vision deep-learning pytorch language-model multimodal-learning

Updated May 26, 2024
Python

mlfoundations / open_flamingo

An open-source framework for training large multimodal models.

computer-vision deep-learning pytorch language-model flamingo multimodal-learning in-context-learning

Updated May 25, 2024
Python

PreferredAI / cornac

A Comparative Framework for Multimodal Recommender Systems

collaborative-filtering matrix-factorization recommendation-system recommendation-engine recommender-system recommendation-algorithms multimodality multimodal-learning

Updated May 24, 2024
Python

Improve this page

Add a description, image, and links to the multimodal-learning topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the multimodal-learning topic, visit your repo's landing page and select "manage topics."