Skip to content

Commit

Permalink
[Doc] added multimodal
Browse files Browse the repository at this point in the history
Signed-off-by: Wallas Santos <[email protected]>
  • Loading branch information
wallashss committed Sep 18, 2024
1 parent 18afafe commit 2ef458e
Showing 1 changed file with 41 additions and 1 deletion.
42 changes: 41 additions & 1 deletion docs/source/serving/compatibility_matrix.rst
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ The table below shows mutually exclusive features along with support for some de

.. list-table::
:header-rows: 1
:widths: 20 8 8 8 8 8 8 8 8 8 8 8
:widths: 20 8 8 8 8 8 8 8 8 8 8 8 8

* - Feature
- Chunked Prefill
Expand All @@ -21,6 +21,20 @@ The table below shows mutually exclusive features along with support for some de
- Prompt Logprobs
- Async Output
- Multi-step
- Multimodal
* - Chunked Prefill
-
-
-
-
-
-
-
-
-
-
-
-
* - APC
- ✅
-
Expand All @@ -33,6 +47,7 @@ The table below shows mutually exclusive features along with support for some de
-
-
-
-
* - LoRa
- ✗ `[C] <https://github.com/vllm-project/vllm/blob/a2469127db6144eedb38d0b505287c0044e4ce06/vllm/config.py#L1558>`__
- ✅
Expand All @@ -45,6 +60,7 @@ The table below shows mutually exclusive features along with support for some de
-
-
-
-
* - Prompt Adapter
- ✅
- ✅
Expand All @@ -57,6 +73,7 @@ The table below shows mutually exclusive features along with support for some de
-
-
-
-
* - Speculative decoding
- ✗ `[C] <https://github.com/vllm-project/vllm/blob/a2469127db6144eedb38d0b505287c0044e4ce06/vllm/config.py#L1200>`__ `[T] <https://github.com/vllm-project/vllm/issues/5016>`__
- ✅
Expand All @@ -69,6 +86,7 @@ The table below shows mutually exclusive features along with support for some de
-
-
-
-
* - CUDA Graphs
- ✅
- ✅
Expand All @@ -81,6 +99,7 @@ The table below shows mutually exclusive features along with support for some de
-
-
-
-
* - Encoder/Decoder
- ✗ `[C] <https://github.com/vllm-project/vllm/blob/a2469127db6144eedb38d0b505287c0044e4ce06/vllm/worker/utils.py#L25>`__
- ✗ `[C] <https://github.com/vllm-project/vllm/blob/a2469127db6144eedb38d0b505287c0044e4ce06/vllm/worker/utils.py#L17>`__ `[T] <https://github.com/vllm-project/vllm/issues/7366>`__
Expand All @@ -93,6 +112,7 @@ The table below shows mutually exclusive features along with support for some de
-
-
-
-
* - Logprobs
- ✅
- ✅
Expand All @@ -105,6 +125,7 @@ The table below shows mutually exclusive features along with support for some de
-
-
-
-
* - Prompt Logprobs
- ✅
- ✅
Expand All @@ -117,6 +138,7 @@ The table below shows mutually exclusive features along with support for some de
-
-
-
-
* - Async Output
- ✅
- ✅
Expand All @@ -129,6 +151,7 @@ The table below shows mutually exclusive features along with support for some de
- ✅
-
-
-
* - Multi-step
- ✗ `[C] <https://github.com/vllm-project/vllm/blob/7de49aa86c7f169eb0962b6db29ad53fff519ffb/vllm/engine/arg_utils.py#L944>`__
- ✅
Expand All @@ -141,6 +164,20 @@ The table below shows mutually exclusive features along with support for some de
- ✗ `[C] <https://github.com/vllm-project/vllm/blob/a2469127db6144eedb38d0b505287c0044e4ce06/vllm/engine/output_processor/multi_step.py#L65>`__ `[T] <https://github.com/vllm-project/vllm/issues/8198>`__
- ✅
-
-
* - Multimodal
- ✗ `[T] <https://github.com/vllm-project/vllm/pull/8346>`__
- ✗ `[T] <https://github.com/vllm-project/vllm/pull/8348>`__
- ✗ `[T] <https://github.com/vllm-project/vllm/pull/7199>`__
-
- ?
- ✅
- ✗ `[C] <https://github.com/vllm-project/vllm/blob/main/vllm/inputs/preprocess.py#L300>`__
- ✅
- ✅
- ?
-
-
* - NVIDIA
- ✅
- ✅
Expand All @@ -153,6 +190,7 @@ The table below shows mutually exclusive features along with support for some de
- ✅
- ✅
- ✅
- ✅
* - CPU
- ✗ `[C] <https://github.com/vllm-project/vllm/blob/a2469127db6144eedb38d0b505287c0044e4ce06/vllm/executor/cpu_executor.py#L337>`__
- ✗ `[C] <https://github.com/vllm-project/vllm/blob/a2469127db6144eedb38d0b505287c0044e4ce06/vllm/executor/cpu_executor.py#L345>`__
Expand All @@ -165,6 +203,7 @@ The table below shows mutually exclusive features along with support for some de
- ✅
- ✗ `[C] <https://github.com/vllm-project/vllm/blob/a2469127db6144eedb38d0b505287c0044e4ce06/vllm/config.py#L370>`__
- ✗ `[T] <https://github.com/vllm-project/vllm/issues/8477>`__
- ?
* - AMD
- ✅
- ✅
Expand All @@ -177,6 +216,7 @@ The table below shows mutually exclusive features along with support for some de
- ✅
- ✅
- ✗ `[T] <https://github.com/vllm-project/vllm/issues/8472>`__
- ?

Note:

Expand Down

0 comments on commit 2ef458e

Please sign in to comment.