This paper describes current examples of fragmentation in the Internet’s physical architecture, address space and protocols, and in the legal principles governing the Internet. It then advances analytical principles, such as diminishing marginal returns, heterogeneity in valuation, the lack of unique value in pairwise potential connections, and non-linear increases in cost, that can serve as heuristics for identifying the circumstances in which fragmentation is more likely to be either beneficial or detrimental. Finally, the paper identifies alternative institutional forms, such as gateways and arbitration, that can mitigate some of the problems associated with fragmentation.