How does spark calculate the difference between the two pieces of data (kafka data source)?

the data source is kafka, and a field is a timestamp. We want to calculate the difference between the timestamps of the two pieces of data, and then add a new field to store this value and send it out.
I checked. Do you want to reducebykeyandwindow? With this, can you just set the window size to two batchtime? Is it possible that the two windows are too small and then there is no corresponding previous piece of data?
or if I set it to 10 batch time, is the result a difference of 10 times?
is there any other way?

Kafka mapreduce spark spark-streaming
Apr.20,2022

you can use spark DataFrame (or spark sql) windowing function.

Previous: React form check

Next: When creating a new terminal in IDE, why is the first input not on the same line as the terminal cursor?

css mysql arrays josn react html typescript webpack npm sass R objective-c .net sql-server jquery python-3.x angularjs django angular excel regex iphone ajax linux xml pandas vba spring database wordpress string wpf xcode windows bash postgresql oracle multithreading eclipse list firebase algorithm macos forms image scala visual-studio azure bootstrap spring-boot react-native python-2.7 docker performance function winforms matlab powershell apache dataframe api sqlite numpy rest shell selenium flutter dart maven loops qt swing android-studio csv express file class tensorflow sorting codeigniter perl
MySQL Query : SELECT * FROM `codeshelper`.`v9_news` WHERE status=99 AND catid='6' ORDER BY rand() LIMIT 5
MySQL Error : Disk full (/tmp/#sql-temptable-64f5-1ea2192-1bb0.MAI); waiting for someone to free some space... (errno: 28 "No space left on device")
MySQL Errno : 1021
Message : Disk full (/tmp/#sql-temptable-64f5-1ea2192-1bb0.MAI); waiting for someone to free some space... (errno: 28 "No space left on device")
Need Help?