mywiki x

User Tools

Site Tools

Trace:
kafkamain

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision 		Previous revision
kafkamain [2022/07/20 20:22]
rklein 		kafkamain [2023/03/27 14:51] (current)
rklein
Line 1: Line 1:
 +https://learn.microsoft.com/en-us/azure/devops/pipelines/library/secure-files?view=azure-devops
 +
 == Kafka / Confluence Links == == Kafka / Confluence Links ==
  
Line 33: Line 35:
  
 all are either build ,test and support by confluent or tested and supported by confluent  all are either build ,test and support by confluent or tested and supported by confluent 
 +
 +deep dive
 +
 +https://www.confluent.io/blog/kafka-connect-deep-dive-converters-serialization-explained/#json-schemas
 +
 +Kafka Connect and schema registry 
 +
 +https://docs.confluent.io/platform/current/schema-registry/connect.html
  
 == Protect Kafka Connect Rest API with authentification == Protect Kafka Connect Rest API with authentification
Line 43: Line 53:
  
 https://docs.confluent.io/platform/current/connect/logging.html https://docs.confluent.io/platform/current/connect/logging.html
 +
 +https://www.confluent.io/de-de/blog/kafka-connect-deep-dive-error-handling-dead-letter-queues/
 +
 +Good Error message from Kafka-Connect:
 +
 +WARN [Worker clientId=rklein-kafka-connect-worker-1, groupId=rklein-kafka-connect] Catching up to assignment's config offset. (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
 +
 +
  
 == Configuration Summaries == == Configuration Summaries ==
Line 51: Line 69:
  
 Connector Configurations Connector Configurations
 +
  
 https://docs.confluent.io/platform/current/connect/references/connector-configs.html https://docs.confluent.io/platform/current/connect/references/connector-configs.html
Line 59: Line 78:
 REST API REST API
 https://docs.confluent.io/platform/current/connect/references/restapi.html https://docs.confluent.io/platform/current/connect/references/restapi.html
 +
 +== connect schema registry auth  ==
 +
 +https://stackoverflow.com/questions/70180066/basic-authentication-for-kafka-connect-to-access-schema-registry
  
  
 == SQL Server cdc == == SQL Server cdc ==
 <code> <code>
-create role kafkacdc authorized db_datareader+create role kafkacdc AUTHORIZATION db_datareader
 GO GO
 create login kafkaconnect with password=*** create login kafkaconnect with password=***
 GO GO
-create user kafkaconnect for kafkaconnect+create user kafkaconnect for login kafkaconnect
 GO GO
 alter role kafkacdc add member kafkaconnect alter role kafkacdc add member kafkaconnect
Line 85: Line 108:
  
  
 +== KSQLDB ==
 +
 +https://github.com/confluentinc/ksql/issues/6435
 +
 +https://docs.ksqldb.io/en/latest/developer-guide/ksqldb-reference/create-stream/
 +
 +
 +== single message transform ==
 +
 +https://tech.willhaben.at/kafka-connect-custom-single-message-transform-using-jslt-2fc57ae98395
 +
 +== All configurations ==
 +
 +https://docs.confluent.io/platform/current/installation/configuration/index.html
 +
 +Licence topics
 +
 +https://gist.github.com/rmoff/49526672990f1b4f7935b62609f6f567
 +
 +
 +
 +== Julie Ops sh ==
  
 +#!/usr/bin/env bash
  
 +JULIE_OPS_HOME=/usr/local/julie-ops
 +JULIE_OPS_JAR=$JULIE_OPS_HOME/bin/julie-ops.jar
 +JAVA_PATH=java
  
 +if [ -z "$JULIE_OPS_OPTIONS" ]; then
 +  JULIE_OPS_OPTIONS=""
 +fi
  
 +$JAVA_PATH $JULIE_OPS_OPTIONS -jar $JULIE_OPS_JAR "$@"
  
kafkamain.1658341343.txt.gz ยท Last modified: 2022/08/09 15:20 (external edit)

Page Tools

Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
CC Attribution-Share Alike 4.0 International Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki