Sep 19, 2023 · In this work, we introduce the Qwen-VL series, a set of large-scale vision-language models (LVLMs) designed to perceive and understand both texts and images. …

ipeline, and (iv) multilingual multimodal cleaned corpus. Beyond the conventional image description and question-answering, we imple-ment the grounding and text-reading ability of …

mation in transformer-based language models. However, these models fail to generalize past the sequence length they were trained on. We present YaRN (Yet another RoPE extensioN …

Sep 26, 2024 · Large language models (LLMs) have demonstrated remarkable capabilities in language understanding and generation, leading to their widespread adoption across various …

Sep 12, 2024 · Our experiments demonstrate AIR's effectiveness across state-of-the-art LLMs, achieving an attack success rate (ASR) exceeding $\textbf {90}$% on most models, including …

Welcome to the OpenReview homepage for ICLR 2024

Jan 16, 2024 · The aligned Large Language Models (LLMs) are powerful language understanding and decision-making tools that are created through extensive alignment with human feedback. …

Jan 16, 2024 · Recently, remarkable progress has been made on automated problem solving through societies of agents based on large language models (LLMs). Previous LLM-based …

MoE-A2.7B (henceforth Qwen) (Team, 2024) and Mixtral 8x7B (Jiang et al., 2024). For Qwen, we explore two levels of reducti n: merging the number of experts from 337 60 to 45 and further to …

Feb 1, 2024 · Despite their remarkable capabilities, large language models (LLMs) often produce responses containing factual inaccuracies due to their sole reliance on the parametric …