Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error when compile with latest GGML: ggml_quantize_chunk #265

Closed
paulocoutinhox opened this issue May 14, 2024 · 2 comments
Closed

Error when compile with latest GGML: ggml_quantize_chunk #265

paulocoutinhox opened this issue May 14, 2024 · 2 comments

Comments

@paulocoutinhox
Copy link

Hi,

Error when compile with latest GGML.

/Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/stable-diffusion/model.cpp:608: error: no matching function for call to 'ggml_quantize_chunk'
/Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/stable-diffusion/model.cpp:608:13: error: no matching function for call to 'ggml_quantize_chunk'
            ggml_quantize_chunk(dst_type, (float*)src_data_f32, dst, 0, nrows, n_per_row, hist, im);
            ^~~~~~~~~~~~~~~~~~~
/Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/stable-diffusion/../ggml/include/ggml/ggml.h:2234:21: note: candidate function not viable: requires 7 arguments, but 8 were provided
    GGML_API size_t ggml_quantize_chunk(
                    ^

Thanks.

@paulocoutinhox
Copy link
Author

I tried remove the "hist" param to follow quantize chunk method params, but still with errors:

ggml_metal_init: allocating
ggml_metal_init: picking default device: Apple A15 GPU
ggml_metal_init: loading '/private/var/containers/Bundle/Application/BF17FE80-AC05-47AF-8D5E-280CA37F4AA3/AiKit.app/default.metallib'
ggml_metal_init: GPU name:   Apple A15 GPU
ggml_metal_init: GPU family: MTLGPUFamilyApple8  (1008)
ggml_metal_init: GPU family: MTLGPUFamilyCommon3 (3003)
ggml_metal_init: GPU family: MTLGPUFamilyMetal3  (5001)
ggml_metal_init: simdgroup reduction support   = true
ggml_metal_init: simdgroup matrix mul. support = true
ggml_metal_init: hasUnifiedMemory              = true
ggml_metal_init: recommendedMaxWorkingSetSize  =  2863.32 MB
Assertion failed: (false), function ggml_quantize_chunk, file ggml.c, line 21621.

@paulocoutinhox
Copy link
Author

Fixed. Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant