In distributed data storage, a P-Grid is a self-organizing structured peer-to-peer system, which can accommodate arbitrary key distributions (and hence support lexicographic key ordering and range queries), still providing storage load-balancing and efficient search by using randomized routing.
Salient features
edit- Good storage load-balancing despite arbitrary load-distribution over the key-space.[1]
- Range queries can be naturally supported and efficiently processed on P-Grid because P-Grid abstracts a trie-structure, and supports (rather) arbitrary distribution of keys, as observed in realistic scenarios.[1]
- A Self-referential directory is realized to provide peer identity persistence over multiple sessions.[1]
- A gossip primitive based update mechanism for keeping replicated content up-to-date.[1]
- Easy merger of multiple P-Grids, and hence decentralized bootstrapping of the P-Grid network.[1]
- Query-adaptive caching is easy to realize on P-Grid to provide query load-balancing where peers have restricted capacity.[1]
Overview
edit
P-Grid abstracts a trie and resolves queries based on prefix matching. The actual topology has no hierarchy. Queries are resolved by matching prefixes. This also determines the choice of routing table entries. Each peer, for each level of the trie, maintains autonomously routing entries chosen randomly from the complementary sub-trees.[2] In fact, multiple entries are maintained for each level at each peer to provide fault-tolerance (as well as potentially for query-load management). For diverse reasons including fault-tolerance and load-balancing, multiple peers are responsible for each leaf node in the P-Grid tree. These are called replicas. The replica peers maintain an independent replica sub-network and uses gossip based communication to keep the replica group up-to-date.[3] The redundancy in both the replication of key-space partitions as well as the routing network together is called structural replication. The figure above shows how a query is resolved by forwarding it based on prefix matching.[citation needed]
Range queries in P-Grid
editP-Grid partitions the key-space in a granularity adaptive to the load at that part of the key-space. Consequently, its possible to realize a P-Grid overlay network where each peer has similar storage load even for non-uniform load distributions. This network probably provides as efficient search of keys as traditional distributed hash tables (DHTs) do. Note that in contrast to P-Grid, DHTs work efficiently only for uniform load-distributions.[4]
Hence we can use a lexicographic order preserving function to generate the keys, and still realize a load-balanced P-Grid network which supports efficient search of exact keys. Moreover, because of the preservation of lexicographic ordering, range queries can be done efficiently and precisely on P-Grid. The trie-structure of P-Grid allows different range query strategies, processed serially or in parallel, trading off message overheads and query resolution latency.[5] Simple vector-based data storage architectural frameworks are also subject to variable query limitations within the P-Grid environment.[6]
References
edit- ^ a b c d e f Antonopoulos, Nick (2010). Handbook of Research on P2P and Grid Systems for Service-Oriented Computing: Models, Methodologies and Applications: Models, Methodologies and Applications. IGI Global. pp. 323–892.
- ^ Ray, Chhanda (2009). Distributed Database Systems. Pearson Education India. pp. 87–121.
- ^ Jepsen, Thomas (2013). Distributed Storage Networks: Architecture, Protocols and Management. John Wiley & Sons. pp. 37–79.
- ^ Pitoura, Pitoura; Ntarmos, Nikos; Triantafillou, Peter (2006). Replication, load balancing and efficient range query processing in DHTs. International Conference on Extending Database Technology. pp. 131–148. doi:10.1007/11687238_11.
- ^ Datta, A.; Hauswirth, M.; John, R.; Schmidt, R.; Aberer, K. (2005). Range queries in trie-structured overlays. Fifth IEEE International Conference on Peer-to-Peer Computing. pp. 57–66. doi:10.1109/P2P.2005.31. ISBN 0-7695-2376-5.
- ^ Oliker, Leonid; Canning, Andrew; Carter, Jonathan; Shalf, John; Ethier, Stéphane (2008). "Scientific Application Performance on Leading Scalar and Vector Supercomputering Platforms". The International Journal of High Performance Computing Applications. 22: 5–20. doi:10.1177/1094342006085020. S2CID 5347699.