chore: add NGL settings for vision models

[louis-menlo]

Describe Your Changes

It’s an update to add new NGL settings for the llava model.json files. It’s a minor update for predefined models, but there should be a correct update from cortex.cpp to import vision models.

Related Issues

- #1763

Changes made

The changes in the code are as follows:

1. package.json:

   • The version of the package @janhq/inference-cortex-extension has been updated from "1.0.23" to "1.0.24".

2. model.json files:

   • Changes were made to three different model JSON files located in different subdirectories: bakllava-1, llava-13b, and llava-7b.
   • For each of these models, an additional property "ngl": 33 was added to the "model" key.
   • This update is consistent across all model files, suggesting a related change or parameter update applicable to multiple model configurations.

[github-actions]

Barecheck - Code coverage report

Total: 69.29%

Your code coverage diff: 0.00% ▴

✅ All code changes are covered