User Tools

Site Tools


kafkamain

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
kafkamain [2022/08/12 18:46]
rklein
kafkamain [2023/03/27 14:51] (current)
rklein
Line 1: Line 1:
 +https://learn.microsoft.com/en-us/azure/devops/pipelines/library/secure-files?view=azure-devops
 +
 == Kafka / Confluence Links == == Kafka / Confluence Links ==
  
Line 37: Line 39:
  
 https://www.confluent.io/blog/kafka-connect-deep-dive-converters-serialization-explained/#json-schemas https://www.confluent.io/blog/kafka-connect-deep-dive-converters-serialization-explained/#json-schemas
 +
 +Kafka Connect and schema registry 
 +
 +https://docs.confluent.io/platform/current/schema-registry/connect.html
  
 == Protect Kafka Connect Rest API with authentification == Protect Kafka Connect Rest API with authentification
Line 49: Line 55:
  
 https://www.confluent.io/de-de/blog/kafka-connect-deep-dive-error-handling-dead-letter-queues/ https://www.confluent.io/de-de/blog/kafka-connect-deep-dive-error-handling-dead-letter-queues/
 +
 +Good Error message from Kafka-Connect:
 +
 +WARN [Worker clientId=rklein-kafka-connect-worker-1, groupId=rklein-kafka-connect] Catching up to assignment's config offset. (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
 +
 +
  
 == Configuration Summaries == == Configuration Summaries ==
Line 57: Line 69:
  
 Connector Configurations Connector Configurations
 +
  
 https://docs.confluent.io/platform/current/connect/references/connector-configs.html https://docs.confluent.io/platform/current/connect/references/connector-configs.html
Line 69: Line 82:
  
 https://stackoverflow.com/questions/70180066/basic-authentication-for-kafka-connect-to-access-schema-registry https://stackoverflow.com/questions/70180066/basic-authentication-for-kafka-connect-to-access-schema-registry
 +
  
 == SQL Server cdc == == SQL Server cdc ==
Line 100: Line 114:
 https://docs.ksqldb.io/en/latest/developer-guide/ksqldb-reference/create-stream/ https://docs.ksqldb.io/en/latest/developer-guide/ksqldb-reference/create-stream/
  
 +
 +== single message transform ==
 +
 +https://tech.willhaben.at/kafka-connect-custom-single-message-transform-using-jslt-2fc57ae98395
 +
 +== All configurations ==
 +
 +https://docs.confluent.io/platform/current/installation/configuration/index.html
 +
 +Licence topics
 +
 +https://gist.github.com/rmoff/49526672990f1b4f7935b62609f6f567
 +
 +
 +
 +== Julie Ops sh ==
 +
 +#!/usr/bin/env bash
 +
 +JULIE_OPS_HOME=/usr/local/julie-ops
 +JULIE_OPS_JAR=$JULIE_OPS_HOME/bin/julie-ops.jar
 +JAVA_PATH=java
 +
 +if [ -z "$JULIE_OPS_OPTIONS" ]; then
 +  JULIE_OPS_OPTIONS=""
 +fi
 +
 +$JAVA_PATH $JULIE_OPS_OPTIONS -jar $JULIE_OPS_JAR "$@"
  
kafkamain.1660322785.txt.gz ยท Last modified: 2022/08/12 18:46 by rklein