Skip to content
@ModelCloud

ModelCloud.ai

Our mission is to give allow everyone, including bots, unlimited and free access to llm/ai models.

Pinned Loading

  1. GPTQModel Public

    Production ready LLM model compression/quantization toolkit with accelerated inference support for both cpu/gpu via HF, vLLM, and SGLang.

    Python 312 45

  2. Device-SMI Public

    Self-contained Python lib with zero-dependencies that give you a unified device properties for gpu, cpu, and npu. No more calling separate tools such as nvidia-smi or /proc/cpuinfo and parsing it y…

    Python 10 1

Repositories

Showing 7 of 7 repositories
  • GPTQModel Public

    Production ready LLM model compression/quantization toolkit with accelerated inference support for both cpu/gpu via HF, vLLM, and SGLang.

    Python 312 Apache-2.0 45 14 10 Updated Feb 28, 2025
  • peft Public Forked from huggingface/peft

    🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

    Python 0 Apache-2.0 1,776 0 0 Updated Feb 28, 2025
  • LogBar Public

    A unified Logger and ProgressBar util with zero dependencies.

    Python 4 Apache-2.0 0 0 0 Updated Feb 27, 2025
  • Device-SMI Public

    Self-contained Python lib with zero-dependencies that give you a unified device properties for gpu, cpu, and npu. No more calling separate tools such as nvidia-smi or /proc/cpuinfo and parsing it yourself.

    Python 10 Apache-2.0 1 0 1 Updated Feb 27, 2025
  • Tokenicer Public

    A (nicer) tokenizer you want to use for model inference and training: with all known peventable gotchas normalized or auto-fixed.

    Python 5 Apache-2.0 1 0 1 Updated Feb 26, 2025
  • transformers Public Forked from huggingface/transformers

    🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

    Python 0 Apache-2.0 28,585 0 0 Updated Feb 12, 2025
  • optimum Public Forked from huggingface/optimum

    🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

    Python 0 Apache-2.0 509 0 0 Updated Feb 7, 2025

Top languages

Python