There are two sets of data. Each set of data has 500 million url, but only 4 gigabytes of memory. How to find the same two url? in these two sets of data?

this is an interview question for Ali, which has been bothering me for a long time. Please.
there are two sets of data. Each set of data has 500 million url, but only 4 gigabytes of memory. How to find the same two url? in these two sets of data?

Alibaba interview
Jul.12,2021

interview-Ali -. Big data title-given two files an and b, each storing 5 billion url, each url occupies 64 bytes, and the memory limit is 4G, which allows you to find out the common url? of files an and b

.

there is a similar topic, which adopts the idea of divide and conquer.

take a guess, sort first and then divide into blocks?

< hr >

there are dozens of such problems every year, but big companies are just different. Tsk

Previous: Why did pdo execute return true, to indicate that there was an error in this line?

Next: The difference of react Route Jump Mode

css mysql arrays josn react html typescript webpack npm sass R objective-c .net sql-server jquery python-3.x angularjs django angular excel regex iphone ajax linux xml pandas vba spring database wordpress string wpf xcode windows bash postgresql oracle multithreading eclipse list firebase algorithm macos forms image scala visual-studio azure bootstrap spring-boot react-native python-2.7 docker performance function winforms matlab powershell apache dataframe api sqlite numpy rest shell selenium flutter dart maven loops qt swing android-studio csv express file class tensorflow sorting codeigniter perl
MySQL Query : SELECT * FROM `codeshelper`.`v9_news` WHERE status=99 AND catid='6' ORDER BY rand() LIMIT 5
MySQL Error : Disk full (/tmp/#sql-temptable-64f5-1e9f190-1a31.MAI); waiting for someone to free some space... (errno: 28 "No space left on device")
MySQL Errno : 1021
Message : Disk full (/tmp/#sql-temptable-64f5-1e9f190-1a31.MAI); waiting for someone to free some space... (errno: 28 "No space left on device")
Need Help?