Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Request: Option to specify base URL for server mode #388

Open
vlasky opened this issue Apr 30, 2024 · 0 comments
Open

Feature Request: Option to specify base URL for server mode #388

vlasky opened this issue Apr 30, 2024 · 0 comments

Comments

@vlasky
Copy link

vlasky commented Apr 30, 2024

I've been testing the use of Nginx as a proxy to serve llamafile under a subdirectory.

i.e. to be able to access the llamafile server via a URL like this:

https://mydomain.com/llamafile/

Llamafile is being launched via systemd under Linux.

I am using a rewrite rule in Nginx to remove the llamafile/ subdirectory in the URL before passing the request to llamafile.

Although I am successfully able to open the index page, it doesn't load correctly because the HTML contains Javascript code that imports the following scripts from the following absolute URLs:

/index.js
/completion.js
/json-schema-to-grammar.mjs

This is a result of the following HTML lines in the index page:

<script type="module">
    import {
      html, h, signal, effect, computed, render, useSignal, useEffect, useRef, Component
    } from '/index.js';

    import { llama } from '/completion.js';
    import { SchemaConverter } from '/json-schema-to-grammar.mjs';

At the moment, llamafile does not have a command line option to specify a base URL or URL subdirectory prefix.

The --path command line option cannot be used for this purpose.

It would be great if a base URL/URL subdirectory prefix command line option could be added to llamafile.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant