Package org.redisson.api.mapreduce
Interface RCollectionMapReduce<VIn,KOut,VOut>
- Type Parameters:
VIn- input valueKOut- output keyVOut- output value
- All Superinterfaces:
RMapReduceExecutor<VIn,KOut, VOut>
- All Known Implementing Classes:
RedissonCollectionMapReduce
MapReduce allows to process large amount of data stored in
RSet, RList, RSetCache, RScoredSortedSet, RSortedSet and others
using Mapper, Reducer and/or Collator tasks launched across Redisson Nodes.
Usage example:
public class WordMapper implements RCollectionMapper<String, String, Integer> {
public void map(String value, RCollector<String, Integer> collector) {
String[] words = value.split("[^a-zA-Z]");
for (String word : words) {
collector.emit(word, 1);
}
}
}
public class WordReducer implements RReducer<String, Integer> {
public Integer reduce(String reducedKey, Iterator<Integer> iter) {
int sum = 0;
while (iter.hasNext()) {
Integer i = (Integer) iter.next();
sum += i;
}
return sum;
}
}
public class WordCollator implements RCollator<String, Integer, Integer> {
public Integer collate(Map<String, Integer> resultMap) {
int result = 0;
for (Integer count : resultMap.values()) {
result += count;
}
return result;
}
}
RList<String> list = redisson.getList("myWords");
Map<String, Integer> wordsCount = list.<String, Integer>mapReduce()
.mapper(new WordMapper())
.reducer(new WordReducer())
.execute();
Integer totalCount = list.<String, Integer>mapReduce()
.mapper(new WordMapper())
.reducer(new WordReducer())
.execute(new WordCollator());
- Author:
- Nikita Koksharov
-
Method Summary
Modifier and TypeMethodDescriptionmapper(RCollectionMapper<VIn, KOut, VOut> mapper) Setup Mapper objectSetup Reducer objectDefines timeout for MapReduce processMethods inherited from interface org.redisson.api.mapreduce.RMapReduceExecutor
execute, execute, execute, executeAsync, executeAsync, executeAsync
-
Method Details
-
timeout
Defines timeout for MapReduce process- Parameters:
timeout- for processunit- of timeout- Returns:
- self instance
-
mapper
Setup Mapper object- Parameters:
mapper- used during MapReduce- Returns:
- self instance
-
reducer
Setup Reducer object- Parameters:
reducer- used during MapReduce- Returns:
- self instance
-