User Tools

Site Tools


kafkamain

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
kafkamain [2022/08/09 15:31]
rklein
kafkamain [2023/03/27 14:51] (current)
rklein
Line 1: Line 1:
 +https://learn.microsoft.com/en-us/azure/devops/pipelines/library/secure-files?view=azure-devops
 +
 == Kafka / Confluence Links == == Kafka / Confluence Links ==
  
Line 33: Line 35:
  
 all are either build ,test and support by confluent or tested and supported by confluent  all are either build ,test and support by confluent or tested and supported by confluent 
 +
 +deep dive
 +
 +https://www.confluent.io/blog/kafka-connect-deep-dive-converters-serialization-explained/#json-schemas
 +
 +Kafka Connect and schema registry 
 +
 +https://docs.confluent.io/platform/current/schema-registry/connect.html
  
 == Protect Kafka Connect Rest API with authentification == Protect Kafka Connect Rest API with authentification
Line 43: Line 53:
  
 https://docs.confluent.io/platform/current/connect/logging.html https://docs.confluent.io/platform/current/connect/logging.html
 +
 +https://www.confluent.io/de-de/blog/kafka-connect-deep-dive-error-handling-dead-letter-queues/
 +
 +Good Error message from Kafka-Connect:
 +
 +WARN [Worker clientId=rklein-kafka-connect-worker-1, groupId=rklein-kafka-connect] Catching up to assignment's config offset. (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
 +
 +
  
 == Configuration Summaries == == Configuration Summaries ==
Line 51: Line 69:
  
 Connector Configurations Connector Configurations
 +
  
 https://docs.confluent.io/platform/current/connect/references/connector-configs.html https://docs.confluent.io/platform/current/connect/references/connector-configs.html
Line 63: Line 82:
  
 https://stackoverflow.com/questions/70180066/basic-authentication-for-kafka-connect-to-access-schema-registry https://stackoverflow.com/questions/70180066/basic-authentication-for-kafka-connect-to-access-schema-registry
 +
  
 == SQL Server cdc == == SQL Server cdc ==
Line 88: Line 108:
  
  
-== Next Entry ==+== KSQLDB == 
 + 
 +https://github.com/confluentinc/ksql/issues/6435 
 + 
 +https://docs.ksqldb.io/en/latest/developer-guide/ksqldb-reference/create-stream/ 
 + 
 + 
 +== single message transform == 
 + 
 +https://tech.willhaben.at/kafka-connect-custom-single-message-transform-using-jslt-2fc57ae98395 
 + 
 +== All configurations == 
 + 
 +https://docs.confluent.io/platform/current/installation/configuration/index.html 
 + 
 +Licence topics 
 + 
 +https://gist.github.com/rmoff/49526672990f1b4f7935b62609f6f567 
 + 
 + 
 + 
 +== Julie Ops sh == 
 + 
 +#!/usr/bin/env bash
  
 +JULIE_OPS_HOME=/usr/local/julie-ops
 +JULIE_OPS_JAR=$JULIE_OPS_HOME/bin/julie-ops.jar
 +JAVA_PATH=java
  
 +if [ -z "$JULIE_OPS_OPTIONS" ]; then
 +  JULIE_OPS_OPTIONS=""
 +fi
  
 +$JAVA_PATH $JULIE_OPS_OPTIONS -jar $JULIE_OPS_JAR "$@"
  
kafkamain.1660051918.txt.gz · Last modified: 2022/08/09 15:31 by rklein