Skip to content

Gemma 4 MTP on Windows? #13

Description

@lollo78

Hi, I'm trying Atomic Chat v1.1.70 on Windows and I have some questions about it.

  1. Why it is so slow? I'm using gemma-4-E4B-it-IQ4_XS I have only 8t/s.
    With the official llama.cpp CUDA 13.1 I did 100t/s with Unsloth gemma-4-E4B-it-UD-Q4_K_XL.
    I leaved all the default settings in Atomic Chat and I installed only the CUDA 13 backend (as proposed).
Image
  1. Here my hardware specs. I have an RTX 5070, but no device found in Graphic cards. It's normal?
Image

3) Gemma 4 MTP are supported on Windows? How to use it?

Thanks

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions