-
How to configure access password for kafka-manager and storm ui
recently working on flume+kafka+storm, I would like to ask you that you can access kafka-manager and storm ui without a password. Isn t this very insecure? how to configure an access password for these two pages? ...
-
Consume kafka data and then check the database. How to deal with this scenario?
now there is a scenario in which you subscribe to kafka s topic, to get the message in real time, then check the database through the message content to get some fields necessary to build the document, and then consume the constructed document.
now a...
-
Kafka.common.KafkaException: Wrong request type 18
use a simple java client to send a message after simulating the configuration of a kafka server, but without message storage, you can only see the error log all the time (the message is really not stored)
kafka.common.KafkaException: Wrong request type...
-
Kafka-node TimeoutError: Request timed out after 30000ms
{TimeoutError: Request timed out after 30000ms
at new TimeoutError (E: workspace projects demo egg-example node_modules _kafka-node@2.6.0@kafka-node lib errors Tim
eoutError.js:6:9)
at Timeout.setTimeout [as _onTimeout] (E: workspace proje...
-
The Perplexity of Throughput and processing Speed in message queue
using the list of kafka and redis to do message queues, it is found that the throughput of kafka is higher than that of redis. Does that mean that kafka is faster than redis in queuing and dequeuing messages? That is, the time it takes to process a mess...
-
Can WeChat Mini Programs communicate with the backend through kafka?
the backend considers using kafka to handle message queues, and hopes to communicate directly with the front end instead of socket.io , but the kafka protocol is customized, and it is uncertain whether Mini Program supports .
because it is under i...
-
It will take a while for kafka to consume the data.
Why do you use the kafka client script written by python to produce data as soon as the program runs, but it takes a while to consume the data (there is data in the topic). (both pykafka and confluentKafka are the same)
there is only a very small prob...
-
How does php connect to kafka to send messages?
I installed
"nmred kafka-php ": "0.2.* "
this package, the following is the official code
<?php
require vendor autoload.php ;
date_default_timezone_set( PRC );
$config = Kafka ProducerConfig::getInstance();
$config->setMetadataRefre...
-
Is the configuration of kafka set on the code client or on the Kafka side?
RT. now some kafka clients, whether java, python or go, provide the configuration of setting kafka at the client side and code level. However, kafka has its own configuration files. I would like to ask which one will prevail, and if there is a conflict...
-
How is it that the file size in linux: ls-l is larger than that obtained by du?
View the files under a topc of kafka
[root@localhost TOPIC_QUEUE_ID-0]-sharp ls-l total 2932 -rw-r--r-- 1 root root 10485760 Oct 30 2017 00000000000003771019.index -rw-r--r-- 1 root root 2985451 Oct 30 2017 00000000000003771019.log -rw-r--r-- 1 root ...
-
Do I need to configure consumer.properties and provider.properties after kafka installation?
these two can be configured in the java program. need to be configured in the config directory of the kafka installation? ...
-
Why does the new version of kafka consumer and producer configuration use bootstrap-servers instead of zookeeper server addresses?
Why does the new version of kafka consumer and producer configuration use bootstrap-servers to directly configure broker list instead of using zookeeper server addresses? Don t consumers and producers of the new version of kafka no longer need to get...
-
How to understand that python uses for in to subscribe to messages
how do you understand that python uses for in to subscribe to messages?
I used to work on the front end, and event subscriptions are written in this way, which is easy to understand.
eventBus.on( close , function(e){
console.log(e)
})
recently, I...
-
Kafka multiple consumers have only one consumption
use the goalng "github.com Shopify sarama " library
I now have two consumers, and the two topic,kafka partitions are set to 50, but in the actual operation, only one consumer is consuming, closing the consumers who can currently consume, and the othe...
-
The message middleware will appear to receive the message and consume it to the consumer, but does the producer receive the result of sending failure?
this article https: blog.csdn.net chunlon.:
failed to send a message to the message middleware. Does the sender not know that the message middleware really did not receive the message? Or has the message been received, but failed to return response?...
-
On the problem of kafkaMirror maker Monitoring
kafiaMirror maker monitoring is there any company s way to monitor kafka mirror maker? Can you communicate? thank you! ...
-
How to get data from kafka on time
recently, I contacted kafka, and wanted to get data from kafka every half hour for updating and learning. I found a recommendation from relevant friends, which is to use flume to implement half-hour log rollback. The specific code is as follows
-sharp ...
-
How to divide topic, partition and consumer when using kafka?
there is such an application scenario:
the payment center needs to push notification 4 to specify consumer; in the user group
platform needs to send notification 1 to assign consumer to merchant group, 2 to assign consumer to user group, and 3 to s...
-
How does spring kafka achieve the designated partition of consumer consumption?
The native API of kafka can use consumer.assign (partitions) to subscribe to the API of the specified partition, spring kafka. Is there a corresponding method? I only found @ KafkaListener (topicPartitions = {@ TopicPartition (topic = "topic1 ", par...
-
The connection problem of kafka, how can I know whether the kafka service on the server side is turned on through the code?
I set up a kafka service in the virtual machine of my computer and use the Java client to access it locally. Now if the service on the virtual machine is turned off by me, my local code will not be able to push messages to kafka and will report a timeou...
