These maps where all map[x]bool. Change this a map[x]struct{} as this
is smaller and we only use these map to signal "this element exists".

This should preserve a (small) amount of memory.
Signed-off-by: Miek Gieben <miek@miek.nl>