The Pick Function¶
This document is in reference to the pick function in pieces.
The pick() function is used to pick attributes out of data into dictionaries following a
user-defined format. It has multiple modes which each differently effect how it translates a given
input, currently having four pre-defined modes as of the time of this document
being made. Its core intent is to flatten complex maps down to one level. The modes primarily effect
how lists are handled internally, but general, when a list is encountered where a key is specified,
pick() should iterate over the list and continue following the output_map to find data
within each item in the list. It further has several available
special instructions which can be used to specify means to decode
strings to lists and dictionaries.
Modes¶
There are currently four modes available: Combinatorial,
tandem, reduce, and accumulate
modes as of the time of this document being made. These modes can actually be switched between
during parsing of a single piece of data based on user specification in the output_map. Each of
these modes change how pick() processes input.
Combinatorial Mode¶
When using the mode PickType.COMBINATORIAL each element of one list is combined with every
element of the other lists, one by one. This mode is designed to cover all possible combinations of
elements from the lists. It applies combination only to lists under different keys. If lists are
contained directly within another list, they will be concatenated into a longer list rather than
combined the same way.
Tip
Please keep in mind that using PickType.COMBINATORIAL does not guarantee results in a
a specific order.
Examples:¶
Example 1:
_input = {
'k3': [
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
]
}
output_map = {'k3': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2'}}
result = pick(output_map, _input, PickType.COMBINATORIAL)
# result == [
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32'}
# ]
Example 2:
_input = {
'k6': [
[
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
],
[
{'k0': 'v40', 'k1': 'v50', 'k2': 'v60'},
{'k0': 'v41', 'k1': 'v51', 'k2': 'v61'},
{'k0': 'v42', 'k1': 'v52', 'k2': 'v62'}
]
]
}
output_map = {'k6': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2'}}
result = pick(output_map, _input, PickType.COMBINATORIAL)
# result == [
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32'},
# {'o0': 'v40', 'o1': 'v50', 'o2': 'v60'},
# {'o0': 'v41', 'o1': 'v51', 'o2': 'v61'},
# {'o0': 'v42', 'o1': 'v52', 'o2': 'v62'}
# ]
Example 3:
_input = {
'k6': [
[
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
],
[
{'k3': 'v40', 'k4': 'v50', 'k5': 'v60'},
{'k3': 'v41', 'k4': 'v51', 'k5': 'v61'},
{'k3': 'v42', 'k4': 'v52', 'k5': 'v62'}
]
]
}
output_map = {'k6': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2', 'k3': 'o3', 'k4': 'o4', 'k5': 'o5'}}
result = pick(output_map, _input, PickType.COMBINATORIAL)
# result == [
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32'},
# {'o3': 'v40', 'o4': 'v50', 'o5': 'v60'},
# {'o3': 'v41', 'o4': 'v51', 'o5': 'v61'},
# {'o3': 'v42', 'o4': 'v52', 'o5': 'v62'}
# ]
Example 4:
_input = {
'k6': [
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
],
'k7': [
{'k3': 'v40', 'k4': 'v50', 'k5': 'v60'},
{'k3': 'v41', 'k4': 'v51', 'k5': 'v61'},
{'k3': 'v42', 'k4': 'v52', 'k5': 'v62'}
]
}
output_map = {
'k6': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2'},
'k7': {'k3': 'o3', 'k4': 'o4', 'k5': 'o5'}
}
result = pick(output_map, _input, PickType.COMBINATORIAL)
# result == [
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60'}
# ]
Example 5:
_input = {
'k0': {
'k1': [
{'k2': {'k3': 'v10'}},
{'k2': {'k4': 'v11'}},
{'k2': {'k5': 'v12'}},
{'k2': {'k6': 'v20'}},
{'k2': {'k7': 'v21'}},
{'k2': {'k8': 'v22'}}
]
}
}
output_map = {
'k0': {
'k1': {
'k2': {'k3': 'o3', 'k4': 'o4', 'k5': 'o5', 'k6': 'o6', 'k7': 'o7', 'k8': 'o8'}
}
}
}
result = pick(output_map, _input, PickType.COMBINATORIAL)
# result == [
# {'o3': 'v10'}, {'o4': 'v11'}, {'o5': 'v12'}, {'o6': 'v20'}, {'o7': 'v21'}, {'o8': 'v22'}
# ]
Example 6:
_input = {
'k6': {
'k8': [
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
]
},
'k7': {
'k9': [
{'k3': 'v40', 'k4': 'v50', 'k5': 'v60'},
{'k3': 'v41', 'k4': 'v51', 'k5': 'v61'},
{'k3': 'v42', 'k4': 'v52', 'k5': 'v62'}
]
}
}
output_map = {
'k6': {'k8': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2'}},
'k7': {'k9': {'k3': 'o3', 'k4': 'o4', 'k5': 'o5'}}
}
result = pick(output_map, _input, PickType.COMBINATORIAL)
# result == [
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60'}
# ]
Example 7:
_input = {
'k12': {
'k13': [
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
],
'k14': [
{'k3': 'v40', 'k4': 'v50', 'k5': 'v60'},
{'k3': 'v41', 'k4': 'v51', 'k5': 'v61'},
{'k3': 'v42', 'k4': 'v52', 'k5': 'v62'}
]
},
'k15': {
'k16': [
{'k6': 'v70', 'k7': 'v80', 'k8': 'v90'},
{'k6': 'v71', 'k7': 'v81', 'k8': 'v91'},
{'k6': 'v72', 'k7': 'v82', 'k8': 'v92'}
],
'k17': [
{'k9': 'v100', 'k10': 'v110', 'k11': 'v120'},
{'k9': 'v101', 'k10': 'v111', 'k11': 'v121'},
{'k9': 'v102', 'k10': 'v112', 'k11': 'v122'}
]
}
}
output_map = {
'k12': {
'k13': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2'},
'k14': {'k3': 'o3', 'k4': 'o4', 'k5': 'o5'}
},
'k15': {
'k16': {'k6': 'o6', 'k7': 'o7', 'k8': 'o8'},
'k17': {'k9': 'o9', 'k10': 'o10', 'k11': 'o11'}
}
}
result = pick(output_map, _input, PickType.COMBINATORIAL)
# result == [
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'}
# ]
Tandem Mode¶
When using the mode PickType.TANDEM data will be picked simultaneously from each key. In other
words, if there is a list of values, under key1 and another list of values under key2, the
values obtained from those lists will be combined at the same index from each list.
Examples:¶
Example 1:
_input = {
'k3': [
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
]
}
output_map = {'k3': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2'}}
result = pick(output_map, _input, PickType.TANDEM)
# result == [
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32'}
# ]
Example 2:
_input = {
'k6': [
[
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
],
[
{'k0': 'v40', 'k1': 'v50', 'k2': 'v60'},
{'k0': 'v41', 'k1': 'v51', 'k2': 'v61'},
{'k0': 'v42', 'k1': 'v52', 'k2': 'v62'}
]
]
}
output_map = {'k6': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2'}}
result = pick(output_map, _input, PickType.TANDEM)
# result == [
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32'},
# {'o0': 'v40', 'o1': 'v50', 'o2': 'v60'},
# {'o0': 'v41', 'o1': 'v51', 'o2': 'v61'},
# {'o0': 'v42', 'o1': 'v52', 'o2': 'v62'}
# ]
Example 3:
_input = {
'k6': [
[
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
],
[
{'k3': 'v40', 'k4': 'v50', 'k5': 'v60'},
{'k3': 'v41', 'k4': 'v51', 'k5': 'v61'},
{'k3': 'v42', 'k4': 'v52', 'k5': 'v62'}
]
]
}
output_map = {'k6': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2', 'k3': 'o3', 'k4': 'o4', 'k5': 'o5'}}
result = pick(output_map, _input, PickType.TANDEM)
# result == [
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32'},
# {'o3': 'v40', 'o4': 'v50', 'o5': 'v60'},
# {'o3': 'v41', 'o4': 'v51', 'o5': 'v61'},
# {'o3': 'v42', 'o4': 'v52', 'o5': 'v62'}
# ]
Example 4:
_input = {
'k6': [
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
],
'k7': [
{'k3': 'v40', 'k4': 'v50', 'k5': 'v60'},
{'k3': 'v41', 'k4': 'v51', 'k5': 'v61'},
{'k3': 'v42', 'k4': 'v52', 'k5': 'v62'}
]
}
output_map = {
'k6': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2'},
'k7': {'k3': 'o3', 'k4': 'o4', 'k5': 'o5'}
}
result = pick(output_map, _input, PickType.TANDEM)
# result == [
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62'}
# ]
Example 5:
_input = {
'k0': {
'k1': [
{'k2': {'k3': 'v10'}},
{'k2': {'k4': 'v11'}},
{'k2': {'k5': 'v12'}},
{'k2': {'k6': 'v20'}},
{'k2': {'k7': 'v21'}},
{'k2': {'k8': 'v22'}}
]
}
}
output_map = {
'k0': {
'k1': {
'k2': {'k3': 'o3', 'k4': 'o4', 'k5': 'o5', 'k6': 'o6', 'k7': 'o7', 'k8': 'o8'}
}
}
}
result = pick(output_map, _input, PickType.TANDEM)
# result == [
# {'o3': 'v10'}, {'o4': 'v11'}, {'o5': 'v12'}, {'o6': 'v20'}, {'o7': 'v21'}, {'o8': 'v22'}
# ]
Example 6:
_input = {
'k6': {
'k8': [
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
]
},
'k7': {
'k9': [
{'k3': 'v40', 'k4': 'v50', 'k5': 'v60'},
{'k3': 'v41', 'k4': 'v51', 'k5': 'v61'},
{'k3': 'v42', 'k4': 'v52', 'k5': 'v62'}
]
}
}
output_map = {
'k6': {'k8': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2'}},
'k7': {'k9': {'k3': 'o3', 'k4': 'o4', 'k5': 'o5'}}
}
result = pick(output_map, _input, PickType.TANDEM)
# result == [
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62'}
# ]
Example 7:
_input = {
'k12': {
'k13': [
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
],
'k14': [
{'k3': 'v40', 'k4': 'v50', 'k5': 'v60'},
{'k3': 'v41', 'k4': 'v51', 'k5': 'v61'},
{'k3': 'v42', 'k4': 'v52', 'k5': 'v62'}
]
},
'k15': {
'k16': [
{'k6': 'v70', 'k7': 'v80', 'k8': 'v90'},
{'k6': 'v71', 'k7': 'v81', 'k8': 'v91'},
{'k6': 'v72', 'k7': 'v82', 'k8': 'v92'}
],
'k17': [
{'k9': 'v100', 'k10': 'v110', 'k11': 'v120'},
{'k9': 'v101', 'k10': 'v111', 'k11': 'v121'},
{'k9': 'v102', 'k10': 'v112', 'k11': 'v122'}
]
}
}
output_map = {
'k12': {
'k13': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2'},
'k14': {'k3': 'o3', 'k4': 'o4', 'k5': 'o5'}
},
'k15': {
'k16': {'k6': 'o6', 'k7': 'o7', 'k8': 'o8'},
'k17': {'k9': 'o9', 'k10': 'o10', 'k11': 'o11'}
}
}
result = pick(output_map, _input, PickType.TANDEM)
# result == [
# {'o0': 'v10', 'o1': 'v20', 'o2': 'v30', 'o3': 'v40', 'o4': 'v50', 'o5': 'v60',
# 'o6': 'v70', 'o7': 'v80', 'o8': 'v90', 'o9': 'v100', 'o10': 'v110', 'o11': 'v120'},
# {'o0': 'v11', 'o1': 'v21', 'o2': 'v31', 'o3': 'v41', 'o4': 'v51', 'o5': 'v61',
# 'o6': 'v71', 'o7': 'v81', 'o8': 'v91', 'o9': 'v101', 'o11': 'v110', 'o11': 'v121'},
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'}
# ]
Reduce Mode¶
When using the mode PickType.REDUCE a single dictionary is constructed (but still returned in a
list) where each key value pair is filled in with the last value discovered for the pair. This mode
is not very useful when lists are included, but for data that is guaranteed not to have any lists,
it can be a useful method.
Examples:¶
Example 1:
_input = {
'k3': [
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
]
}
output_map = {'k3': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2'}}
result = pick(output_map, _input, PickType.REDUCE)
# result == [{'o0': 'v12', 'o1': 'v22', 'o2': 'v32'}]
Example 2:
_input = {
'k6': [
[
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
],
[
{'k0': 'v40', 'k1': 'v50', 'k2': 'v60'},
{'k0': 'v41', 'k1': 'v51', 'k2': 'v61'},
{'k0': 'v42', 'k1': 'v52', 'k2': 'v62'}
]
]
}
output_map = {'k6': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2'}}
result = pick(output_map, _input, PickType.REDUCE)
# result == [{'o0': 'v42', 'o1': 'v52', 'o2': 'v62'}]
Example 3:
_input = {
'k6': [
[
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
],
[
{'k3': 'v40', 'k4': 'v50', 'k5': 'v60'},
{'k3': 'v41', 'k4': 'v51', 'k5': 'v61'},
{'k3': 'v42', 'k4': 'v52', 'k5': 'v62'}
]
]
}
output_map = {'k6': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2', 'k3': 'o3', 'k4': 'o4', 'k5': 'o5'}}
result = pick(output_map, _input, PickType.REDUCE)
# result == [{'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62'}]
Example 4:
_input = {
'k6': [
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
],
'k7': [
{'k3': 'v40', 'k4': 'v50', 'k5': 'v60'},
{'k3': 'v41', 'k4': 'v51', 'k5': 'v61'},
{'k3': 'v42', 'k4': 'v52', 'k5': 'v62'}
]
}
output_map = {
'k6': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2'},
'k7': {'k3': 'o3', 'k4': 'o4', 'k5': 'o5'}
}
result = pick(output_map, _input, PickType.REDUCE)
# result == [{'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62'}]
Example 5:
_input = {
'k0': {
'k1': [
{'k2': {'k3': 'v10'}},
{'k2': {'k4': 'v11'}},
{'k2': {'k5': 'v12'}},
{'k2': {'k6': 'v20'}},
{'k2': {'k7': 'v21'}},
{'k2': {'k8': 'v22'}}
]
}
}
output_map = {
'k0': {
'k1': {
'k2': {'k3': 'o3', 'k4': 'o4', 'k5': 'o5', 'k6': 'o6', 'k7': 'o7', 'k8': 'o8'}
}
}
}
result = pick(output_map, _input, PickType.REDUCE)
# result == [{'o3': 'v10', 'o4': 'v11', 'o5': 'v12', 'o6': 'v20', 'o7': 'v21', 'o8': 'v22'}]
Example 6:
_input = {
'k6': {
'k8': [
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
]
},
'k7': {
'k9': [
{'k3': 'v40', 'k4': 'v50', 'k5': 'v60'},
{'k3': 'v41', 'k4': 'v51', 'k5': 'v61'},
{'k3': 'v42', 'k4': 'v52', 'k5': 'v62'}
]
}
}
output_map = {
'k6': {'k8': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2'}},
'k7': {'k9': {'k3': 'o3', 'k4': 'o4', 'k5': 'o5'}}
}
result = pick(output_map, _input, PickType.REDUCE)
# result == [{'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62'}]
Example 7:
_input = {
'k12': {
'k13': [
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
],
'k14': [
{'k3': 'v40', 'k4': 'v50', 'k5': 'v60'},
{'k3': 'v41', 'k4': 'v51', 'k5': 'v61'},
{'k3': 'v42', 'k4': 'v52', 'k5': 'v62'}
]
},
'k15': {
'k16': [
{'k6': 'v70', 'k7': 'v80', 'k8': 'v90'},
{'k6': 'v71', 'k7': 'v81', 'k8': 'v91'},
{'k6': 'v72', 'k7': 'v82', 'k8': 'v92'}
],
'k17': [
{'k9': 'v100', 'k10': 'v110', 'k11': 'v120'},
{'k9': 'v101', 'k10': 'v111', 'k11': 'v121'},
{'k9': 'v102', 'k10': 'v112', 'k11': 'v122'}
]
}
}
output_map = {
'k12': {
'k13': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2'},
'k14': {'k3': 'o3', 'k4': 'o4', 'k5': 'o5'}
},
'k15': {
'k16': {'k6': 'o6', 'k7': 'o7', 'k8': 'o8'},
'k17': {'k9': 'o9', 'k10': 'o10', 'k11': 'o11'}
}
}
result = pick(output_map, _input, PickType.REDUCE)
# result == [
# {'o0': 'v12', 'o1': 'v22', 'o2': 'v32', 'o3': 'v42', 'o4': 'v52', 'o5': 'v62',
# 'o6': 'v72', 'o7': 'v82', 'o8': 'v92', 'o9': 'v102', 'o10': 'v112', 'o11': 'v122'}
# ]
Accumulate Mode¶
When using the mode PickType.ACCUMULATE a single dictionary is constructed (but still returned
in a list) where each key value pair is filled in with a list of every value discovered for the
pair.
Examples:¶
Example 1:
_input = {
'k3': [
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
]
}
output_map = {'k3': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2'}}
result = pick(output_map, _input, PickType.ACCUMULATE)
# result == [
# {
# 'o0': ['v10', 'v11', 'v12'],
# 'o1': ['v20', 'v21', 'v22'],
# 'o2': ['v30', 'v31', 'v32']
# }
# ]
Example 2:
_input = {
'k6': [
[
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
],
[
{'k0': 'v40', 'k1': 'v50', 'k2': 'v60'},
{'k0': 'v41', 'k1': 'v51', 'k2': 'v61'},
{'k0': 'v42', 'k1': 'v52', 'k2': 'v62'}
]
]
}
output_map = {'k6': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2'}}
result = pick(output_map, _input, PickType.ACCUMULATE)
# result == [
# {
# 'o0': ['v10', 'v11', 'v12', 'v40', 'v41', 'v43'],
# 'o1': ['v20', 'v21', 'v22', 'v50', 'v51', 'v53'],
# 'o2': ['v30', 'v31', 'v32', 'v60', 'v61', 'v63'],
# }
# ]
Example 3:
_input = {
'k6': [
[
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
],
[
{'k3': 'v40', 'k4': 'v50', 'k5': 'v60'},
{'k3': 'v41', 'k4': 'v51', 'k5': 'v61'},
{'k3': 'v42', 'k4': 'v52', 'k5': 'v62'}
]
]
}
output_map = {'k6': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2', 'k3': 'o3', 'k4': 'o4', 'k5': 'o5'}}
result = pick(output_map, _input, PickType.ACCUMULATE)
# result == [
# {
# 'o0': ['v10', 'v11', 'v12'],
# 'o1': ['v20', 'v21', 'v22'],
# '02': ['v30', 'v31', 'v32'],
# 'o3': ['v40', 'v41', 'v43'],
# 'o4': ['v50', 'v51', 'v53'],
# 'o5': ['v60', 'v61', 'v63']
# }
# ]
Example 4:
_input = {
'k6': [
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
],
'k7': [
{'k3': 'v40', 'k4': 'v50', 'k5': 'v60'},
{'k3': 'v41', 'k4': 'v51', 'k5': 'v61'},
{'k3': 'v42', 'k4': 'v52', 'k5': 'v62'}
]
}
output_map = {
'k6': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2'},
'k7': {'k3': 'o3', 'k4': 'o4', 'k5': 'o5'}
}
result = pick(output_map, _input, PickType.ACCUMULATE)
# result == [
# {
# 'o0': ['v10', 'v11', 'v12'],
# 'o1': ['v20', 'v21', 'v22'],
# 'o2': ['v30', 'v31', 'v32'],
# 'o3': ['v40', 'v41', 'v42'],
# 'o4': ['v50', 'v51', 'v52'],
# 'o5': ['v60', 'v61', 'v62']
# }
# ]
Example 5:
_input = {
'k0': {
'k1': [
{'k2': {'k3': 'v10'}},
{'k2': {'k4': 'v11'}},
{'k2': {'k5': 'v12'}},
{'k2': {'k6': 'v20'}},
{'k2': {'k7': 'v21'}},
{'k2': {'k8': 'v22'}}
]
}
}
output_map = {
'k0': {
'k1': {
'k2': {'k3': 'o3', 'k4': 'o4', 'k5': 'o5', 'k6': 'o6', 'k7': 'o7', 'k8': 'o8'}
}
}
}
result = pick(output_map, _input, PickType.ACCUMULATE)
# result == [
# {
# 'o3': ['v10'], 'o4': ['v11'], 'o5': ['v12'],
# 'o6': ['v20'], 'o7': ['v21'], 'o8': ['v22']
# }
# ]
Example 6:
_input = {
'k6': {
'k8': [
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
]
},
'k7': {
'k9': [
{'k3': 'v40', 'k4': 'v50', 'k5': 'v60'},
{'k3': 'v41', 'k4': 'v51', 'k5': 'v61'},
{'k3': 'v42', 'k4': 'v52', 'k5': 'v62'}
]
}
}
output_map = {
'k6': {'k8': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2'}},
'k7': {'k9': {'k3': 'o3', 'k4': 'o4', 'k5': 'o5'}}
}
result = pick(output_map, _input, PickType.ACCUMULATE)
# result == [
# {
# 'o0': ['v10', 'v11', 'v12'],
# 'o1': ['v20', 'v21', 'v22'],
# 'o2': ['v30', 'v31', 'v32'],
# 'o3': ['v40', 'v41', 'v42'],
# 'o4': ['v50', 'v51', 'v52'],
# 'o5': ['v60', 'v61', 'v62']
# }
# ]
Example 7:
_input = {
'k12': {
'k13': [
{'k0': 'v10', 'k1': 'v20', 'k2': 'v30'},
{'k0': 'v11', 'k1': 'v21', 'k2': 'v31'},
{'k0': 'v12', 'k1': 'v22', 'k2': 'v32'}
],
'k14': [
{'k3': 'v40', 'k4': 'v50', 'k5': 'v60'},
{'k3': 'v41', 'k4': 'v51', 'k5': 'v61'},
{'k3': 'v42', 'k4': 'v52', 'k5': 'v62'}
]
},
'k15': {
'k16': [
{'k6': 'v70', 'k7': 'v80', 'k8': 'v90'},
{'k6': 'v71', 'k7': 'v81', 'k8': 'v91'},
{'k6': 'v72', 'k7': 'v82', 'k8': 'v92'}
],
'k17': [
{'k9': 'v100', 'k10': 'v110', 'k11': 'v120'},
{'k9': 'v101', 'k10': 'v111', 'k11': 'v121'},
{'k9': 'v102', 'k10': 'v112', 'k11': 'v122'}
]
}
}
output_map = {
'k12': {
'k13': {'k0': 'o0', 'k1': 'o1', 'k2': 'o2'},
'k14': {'k3': 'o3', 'k4': 'o4', 'k5': 'o5'}
},
'k15': {
'k16': {'k6': 'o6', 'k7': 'o7', 'k8': 'o8'},
'k17': {'k9': 'o9', 'k10': 'o10', 'k11': 'o11'}
}
}
result = pick(output_map, _input, PickType.ACCUMULATE)
# result == [
# {
# 'o0': ['v10', 'v11', 'v12'],
# 'o1': ['v20', 'v21', 'v22'],
# 'o2': ['v30', 'v31', 'v32'],
# 'o3': ['v40', 'v41', 'v42'],
# 'o4': ['v50', 'v51', 'v52'],
# 'o5': ['v60', 'v61', 'v62'],
# 'o6': ['v70', 'v71', 'v72'],
# 'o7': ['v80', 'v81', 'v82'],
# 'o8': ['v90', 'v91', 'v92'],
# 'o9': ['v100', 'v101', 'v102'],
# 'o10': ['v110', 'v111', 'v112'],
# 'o11': ['v120', 'v121', 'v122']
# }
# ]
Pick Instructions¶
There are multiple special special instructions available which can be used to modify how data is
parsed. These instructions can be included in output_map by replacing a value with a list
composed of the string representation of the PickInstruction followed by the value, which may either
be further paths, or may specify the end of a path. Parsing instructions available include
JSON, JSONL,
JSON_SINGLE_QUOTE, XML,
XML_SA, CSV, E_LIST,
LIST, YAML, and TUPLE_DICT.
JSON Instruction¶
When using the PickInstruction.JSON` parsing type, pick() expects a JSON string, and will
attempt to interpret the current value as such before continuing to follow any further paths. This
instruction has a string representation of 'json'.
JSONL Instruction¶
When using the PickInstruction.JSONL parsing type, pick() expects a JSONL string, and will
attempt to interpret the current value as such before continuing to follow any further paths. This
instruction has a string representation of 'jsonl'.
JSON Single Quote Instruction¶
When using the PickInstruction.JSON_SINGLE_QUOTE parsing type, pick() expects a JSON
string using single quotes in place of double quotes, and will attempt to interpret the current
value as such before continuing to follow any further paths. This instruction has a string
representation of 'json\''.
Warning
PickInstruction.JSON_SINGLE_QUOTE is not heavily tested, so take care to make sure it is
working as intended when using it.
XML Instruction¶
When using the PickInstruction.XML parsing type, pick() expects an XML string, and will
attempt to interpret the current value as such before continuing to follow any further paths. It
converts XML data to a JSON representation. Attributes will be interpreted as keys of a dict, as
will tags within elements. If there are multiple of a tag within one element, the values inside
of those tags will be treated as individual items and added to a list under that tag as a key.
Genuine text values of elements will be included in dicts under the key 'text'. This instruction
has a string representation of 'xml'.
XML Sans Attributes Instruction¶
When using the PickInstruction.XMLSA parsing type, pick() expects an XML string, and will
attempt to interpret the current value as such before continuing to follow any further paths. It
converts XML data to a JSON representation. Tags within elements will be interpreted as keys. If
there are multiple of a tag within one element, the values inside of those tags will be treated as
individual items and added to a list under that tag as a key. Genuine text values of elements will
be used as a value under tags, unless for some reason there is no text value or internal tag, in
which case, attribute-value pairs will be used as the key-value pairs. This instruction has a string
representation of 'xml-sa'.
CSV Instruction¶
When using the PickInstruction.CSV parsing type, pick() expects a CSV string, and will
attempt to interpret the current value as such before continuing to follow any further paths. It
converts CSV data to a list of dicts, using the first line as the keys for all following rows. This
instruction has a string representation of 'csv'.
Expected List Instruction¶
When using the PickInstruction.ELIST parsing type, pick() does not expect a specific
object, but will check if the current values is already a list. If the current values is a list, it
will follow further paths on that list, but if it is not, the current value will be added to a list
as an element. The string representation of this instruction is 'e-list'.
List Instruction¶
When using the PickInstruction.LIST parsing type, pick() expects a comma-separated string,
and will interpret the current value as a list separated by commas. This instruction has a string
representation of 'list'.
YAML Instruction¶
When using the PickInstruction.YAML parsing type, pick() expects a YAML string and will
interpret the current value as such. It will then follow further paths on the generated object. This
instruction has a string representation of 'yaml'.
Tuple Dict Instruction¶
When using the Pickinstruction.TUPLE_DICT parsing type, pick() expects either a list or a
dictionary. It will attempt to generate a dictionary from key-val pairs found within the current
value following the rules of convert-tuplish-dict-label. This instruction has a string
representation of 'tuple-dict'.