SASL Support · Parsely/pykafka#651

(11 留言) (1 反應) (0 負責人)Python (1,114 star) (231 fork)batch import

enhancementhelp wanted

描述

I would like to use pykafka to connect to IBM Bluemix Message Hub with is a Kafka implementation. There is a kafka-python example in this thread. https://stackoverflow.com/questions/35294949/can-i-call-the-bluemix-message-hub-service-from-python/40325181#40325181

I also found this for confluent-kafka:

A new Python client

Confluent, the company founded by the creators of Kafka, has released a Python client (https://github.com/confluentinc/confluent-kafka-python). It is built as a thin bindings layer on top of librdkafka and works for both Python 2 and 3.

To use with Message Hub, simply pass these properties in when creating a Producer/Consumer:

'ssl.ca.location': '/etc/ssl/certs/',
'sasl.mechanisms': 'PLAIN',
'sasl.username': '<USER>',
'sasl.password': '<PASSWORD>',
'security.protocol': 'sasl_ssl'

Note: The value of ‘ssl.ca.location depends’ on your operating system. For example:

Ubuntu: /etc/ssl/certs/
RedHat: /etc/pki/tls/cert.pem
OS X: select system root certificates from Keychain Access and export as .pem on the filesystem.

Is there a way to connect using pykafka? If so, how would I do it?

貢獻者指南

技術棧: pythonkafka
領域: backendapi
議題類型: feature
難度: 4
預計時間: 1-2 days
活動狀態: stale
清晰度: needs investigation
前置要求: Basic knowledge of KafkaUnderstanding of SASL authenticationFamiliarity with pykafka internals
新手友善度: 15
研究方向: Investigate how SASL authentication is implemented in other Kafka clients like confluent kafka python or kafka python. Look at pykafka's connection module (likely in pykafka/connection.py) to understand current security protocol handling. Review the linked StackOverflow thread for property details. Propose an implementation that adds support for 'sasl ssl' security protocol with PLAIN mechanism, potentially using Python's ssl and socket modules or integrating with an existing SASL library.