Investigate how to set the response content type to text/html in AWS Lambda. Look at the AWS documentation and examples in the repository. Possibly refer to the comments for existing solutions. The answer should involve modifying the Lambda function to return an HTML string with appropriate headers.
