sft-cleanup-hf-only

You can publish HF-only SFT cells directly to Hugging Face without database registration by resolving the hub_model_id via the Delphi map, validating tokenizer_config.json, and uploading artifacts through the sbatch tunnel or direct access.

Tokenizer loader errors occur when extra_special_tokens in tokenizer_config.json is not a dict. You must validate this field and coerce it to an empty dict prior to upload to prevent loading failures during the eval hand-off.

HF-only SFT cleanup is used to publish completed SFT cells to Hugging Face during Delphi HF-only sweeps, ensuring artifacts reach the evaluation grid while avoiding registry pollution from skipped database records.

After a successful upload, you should verify the laion hub repository contains both model.safetensors and the tokenizer configuration files, and then clean up local exp/checkpoint artifacts to free up space.

No, database registration is not required. You can skip DB registration entirely by using the HF-only SFT cleanup workflow, which routes artifacts directly to Hugging Face and ensures they are ready for eval grids.

Yes, you can upload to Hugging Face using either the Leonardo sbatch tunnel or direct access, depending on your environment setup, ensuring the correct routing for the resolved hub_model_id.