Support SSL Encryption

[andrewmunro]

Hi, looking through the library it looks like it doesn't support encrypted traffic to kafka:

https://docs.confluent.io/current/kafka/authentication_ssl.html

Would this be difficult to implement?

[db7]

Goka does not implement the communication with Kafka. For that we employ existing libraries. By default, Goka uses sarama, which is pure Go and does support SSL connections.

As an alternative, you may also use confluent-kafka-go, which uses librdkafka underneath and should support virtually everything you'd need. Although our wrapper around confluent's library isn't complete yet, it shouldn't be too hard to finish it.

[andrewmunro]

I see that it's possible with sarama, but the question was more around whether goka will let me configure the TLS options passed to sarama?

It may be possible using goka.WithProducerBuilder() and goka.WithConsumerBuilder(), I'll have a play when I have time. If I get a decent example I'll post back here.

[db7]

Yes, you can configure sarama with the builders. Check this snippet for an example.

[andrewmunro]

Perfect this is exactly what I needed. Thanks @db7

[Larleyt]

Hello,

I've opened an issue related to Sarama's SSL inside goka, could you please elaborate on that? @db7

The link you've provided contains outdated docs – there's no way to configure anything but Sarama for goka now. And it simply doesn't work with SSL enabled, while works locally in plaintext (please, look at the issue for details).

[db7]

@frairon ^