Allow config options to be configurable through the deploy options

[kyteinsky]

How to use GitHub

• Please use the 👍 reaction to show that you are interested into the same feature.
• Please don't comment if you have no relevant information to add. It's just extra noise for everyone subscribed to this issue.
• Subscribe to receive notifications on status change and new comments.

---

Feature request

Instead of hand-modified config.json, we can select a few most relevant options and accept env vars for them. These env vars can then override the corresponding config values.
It will make it easier to configure through the GUI. The "Deploy Options" are next to the "Deploy and Enable" button in the appstore.

[RSKKSOFFICIAL]

Hi @kyteinsky , I'd like to work on this!

My plan is to add an apply_env_overrides() function in lib/util.py that reads TRANSLATE2_* environment variables after the config JSON is loaded and overrides the matching keys. It gets called at the end of load_config_file() before returning, so config.json stays the default/fallback and no existing deployments break.

The env vars I'm planning to expose:

Env var	Config key
TRANSLATE2_LOG_LEVEL	log_level
TRANSLATE2_IDLE_POLLING_INTERVAL	idle_polling_interval
TRANSLATE2_IDLE_POLLING_INTERVAL_WITH_TRIGGER	idle_polling_interval_with_trigger
TRANSLATE2_TOKENIZER_FILE	tokenizer_file
TRANSLATE2_LOADER_MODEL_NAME	loader.model_name
TRANSLATE2_LOADER_MODEL_PATH	loader.model_path
TRANSLATE2_LOADER_INTER_THREADS	loader.inter_threads
TRANSLATE2_LOADER_INTRA_THREADS	loader.intra_threads
TRANSLATE2_INFERENCE_MAX_BATCH_SIZE	inference.max_batch_size
TRANSLATE2_INFERENCE_SAMPLING_TEMPERATURE	inference.sampling_temperature
TRANSLATE2_INFERENCE_DISABLE_UNK	inference.disable_unk
TRANSLATE2_INFERENCE_MAX_DECODING_LENGTH	inference.max_decoding_length
TRANSLATE2_INFERENCE_REPETITION_PENALTY	inference.repetition_penalty
TRANSLATE2_INFERENCE_PATIENCE	inference.patience

MODEL_NAME and MODEL_PATH would be mutually exclusive, setting one via env var removes the other, preserving the existing validation in load_config_file.

The change is contained entirely to lib/util.py. Happy to adjust the naming convention or the set of exposed keys based on your feedback before I open the PR.