Skip to content

Commit

Permalink
update list of models
Browse files Browse the repository at this point in the history
  • Loading branch information
peterjunpark committed Jan 29, 2025
1 parent c2b5d29 commit 57d58cb
Showing 1 changed file with 0 additions and 20 deletions.
20 changes: 0 additions & 20 deletions docs/how-to/rocm-for-ai/inference/vllm-benchmark.rst
Original file line number Diff line number Diff line change
Expand Up @@ -38,8 +38,6 @@ optimizing performance with popular AI models.

* `Llama 2 7B <https://huggingface.co/meta-llama/Llama-2-7b-chat-hf>`_

* `Llama 2 70B <https://huggingface.co/meta-llama/Llama-2-70b-chat-hf>`_

* `Mixtral MoE 8x7B <https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1>`_

* `Mixtral MoE 8x22B <https://huggingface.co/mistralai/Mixtral-8x22B-Instruct-v0.1>`_
Expand All @@ -50,8 +48,6 @@ optimizing performance with popular AI models.

* `Qwen2 72B <https://huggingface.co/Qwen/Qwen2-72B-Instruct>`_

* `JAIS 13B <https://huggingface.co/core42/jais-13b-chat>`_

* `JAIS 30B <https://huggingface.co/core42/jais-30b-chat-v3>`_

* `DBRX Instruct <https://huggingface.co/databricks/dbrx-instruct>`_
Expand Down Expand Up @@ -144,10 +140,6 @@ Available models
.. hlist::
:columns: 2

* ``pyt_huggingface_gpt2``

* ``pyt_huggingface_bert``

* ``pyt_vllm_llama-3.1-8b``

* ``pyt_vllm_llama-3.1-70b``
Expand All @@ -158,8 +150,6 @@ Available models

* ``pyt_vllm_llama-2-7b``

* ``pyt_vllm_llama-2-70b``

* ``pyt_vllm_mixtral-8x7b``

* ``pyt_vllm_mixtral-8x22b``
Expand All @@ -170,8 +160,6 @@ Available models

* ``pyt_vllm_qwen2-72b``

* ``pyt_vllm_jais-13b``

* ``pyt_vllm_jais-30b``

* ``pyt_vllm_dbrx-instruct``
Expand Down Expand Up @@ -295,10 +283,6 @@ Options
- ``meta-llama/Llama-2-7b-chat-hf``
- Llama 2 7B

* -
- ``meta-llama/Llama-2-70b-chat-hf``
- Llama 2 70B

* -
- ``mistralai/Mixtral-8x7B-Instruct-v0.1``
- Mixtral MoE 8x7B
Expand All @@ -319,10 +303,6 @@ Options
- ``Qwen/Qwen2-72B-Instruct``
- Qwen2 72B

* -
- ``core42/jais-13b-chat``
- JAIS 13B

* -
- ``core42/jais-30b-chat-v3``
- JAIS 30B
Expand Down

0 comments on commit 57d58cb

Please sign in to comment.