DigIO Tech Assessment: Kafka with Go

Song X.
6 min readAug 4, 2022
Photo by Glenn Carstens-Peters on Unsplash

Background

Across different brands of Mantel Group, we see an increasing demand for Kafka in client projects. Kafka is a JVM-centric ecosystem thus JVM-based languages like Java, Kotlin and Scala are the default options when writing applications that interact with Kafka.

From the latest DigIO tech radar, the programming language, Go, has been, again, put into the “adopt” section. At the moment, Go is one of DigIO’s primary languages and has proven to be a great fit for our client solutions across multiple industries including financial services and retail. In DigIO, we have reached a critical mass of skills availability and customer demand for Go.

While recommending Go as one of our primary languages, we would like to see if Go remains a viable choice in the face of the increasing demand for Kafka and event-sourcing patterns.

Hence, we did this tech assessment about whether Go can be used to substitute JVM-based languages in the Kafka ecosystem. If you can’t wait to see the results, feel free to jump straight to the recommendation section.

Scope of the Assessment

In this assessment, we wanted to answer the following questions so that we can decide whether to recommend using Go with Kafka.

  • Can Go be used to…

--

--

Song X.

Software engineer and tech enthusiast. Consulting at DigIO in Melbourne. A big fan of Go. Enjoy reading, cycling and board-gaming.