User Tools

Site Tools


kafkamain

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
kafkamain [2022/08/12 13:51]
rklein
kafkamain [2023/03/27 14:51] (current)
rklein
Line 1: Line 1:
 +https://learn.microsoft.com/en-us/azure/devops/pipelines/library/secure-files?view=azure-devops
 +
 == Kafka / Confluence Links == == Kafka / Confluence Links ==
  
Line 33: Line 35:
  
 all are either build ,test and support by confluent or tested and supported by confluent  all are either build ,test and support by confluent or tested and supported by confluent 
 +
 +deep dive
 +
 +https://www.confluent.io/blog/kafka-connect-deep-dive-converters-serialization-explained/#json-schemas
 +
 +Kafka Connect and schema registry 
 +
 +https://docs.confluent.io/platform/current/schema-registry/connect.html
  
 == Protect Kafka Connect Rest API with authentification == Protect Kafka Connect Rest API with authentification
Line 45: Line 55:
  
 https://www.confluent.io/de-de/blog/kafka-connect-deep-dive-error-handling-dead-letter-queues/ https://www.confluent.io/de-de/blog/kafka-connect-deep-dive-error-handling-dead-letter-queues/
 +
 +Good Error message from Kafka-Connect:
 +
 +WARN [Worker clientId=rklein-kafka-connect-worker-1, groupId=rklein-kafka-connect] Catching up to assignment's config offset. (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
 +
 +
  
 == Configuration Summaries == == Configuration Summaries ==
Line 53: Line 69:
  
 Connector Configurations Connector Configurations
 +
  
 https://docs.confluent.io/platform/current/connect/references/connector-configs.html https://docs.confluent.io/platform/current/connect/references/connector-configs.html
Line 65: Line 82:
  
 https://stackoverflow.com/questions/70180066/basic-authentication-for-kafka-connect-to-access-schema-registry https://stackoverflow.com/questions/70180066/basic-authentication-for-kafka-connect-to-access-schema-registry
 +
  
 == SQL Server cdc == == SQL Server cdc ==
Line 94: Line 112:
 https://github.com/confluentinc/ksql/issues/6435 https://github.com/confluentinc/ksql/issues/6435
  
 +https://docs.ksqldb.io/en/latest/developer-guide/ksqldb-reference/create-stream/
 +
 +
 +== single message transform ==
 +
 +https://tech.willhaben.at/kafka-connect-custom-single-message-transform-using-jslt-2fc57ae98395
 +
 +== All configurations ==
 +
 +https://docs.confluent.io/platform/current/installation/configuration/index.html
 +
 +Licence topics
 +
 +https://gist.github.com/rmoff/49526672990f1b4f7935b62609f6f567
 +
 +
 +
 +== Julie Ops sh ==
 +
 +#!/usr/bin/env bash
 +
 +JULIE_OPS_HOME=/usr/local/julie-ops
 +JULIE_OPS_JAR=$JULIE_OPS_HOME/bin/julie-ops.jar
 +JAVA_PATH=java
  
 +if [ -z "$JULIE_OPS_OPTIONS" ]; then
 +  JULIE_OPS_OPTIONS=""
 +fi
  
 +$JAVA_PATH $JULIE_OPS_OPTIONS -jar $JULIE_OPS_JAR "$@"
  
kafkamain.1660305070.txt.gz · Last modified: 2022/08/12 13:51 by rklein