Review the CSI host code in the Roslyn repository, specifically the InteractiveHost and ScriptBuilder classes. Look for where the current UI culture is set and compare with the system culture. Check existing unit tests for CSI to understand expected behavior. The fix likely involves passing CurrentUICulture to the script execution context.
