[Feature request] `torch.export` .save/.load could support `safetensors` and/or `weights_only=True`

🚀 The feature, motivation and pitch

Today, torch.export will load tensors via

def deserialize_torch_artifact(serialized: Union[Dict[str, Any], Tuple[Any, ...], bytes]):
    if isinstance(serialized, (dict, tuple)):
        return serialized
    if len(serialized) == 0:
        return {}
    buffer = io.BytesIO(serialized)
    buffer.seek(0)
    # weights_only=False as we want to load custom objects here (e.g. ScriptObject)
    artifact = torch.load(buffer, weights_only=False)
    assert isinstance(artifact, (tuple, dict))
    return artifact

Security teams really don't like this I have learned 🙂. In the interest of leveraging the awesome benefits of export more safely, it would be amazing to add optional support for any or all of safetensors and/or weights_only=True!

Thank you for all the work on torch.export, it has a very promising future!

Alternatives

No response

Additional context

No response

cc @chauhang @penguinwu @avikchaudhuri @gmagogsfm @zhxchen17 @tugsbayasgalan @angelayi @suo @ydwu4