Abstract
•Addresses a key issue associated with the search for universality in big datasets.•Of potential interest to researchers across the physical, life and social sciences.•Goes beyond usual Gaussian-based approaches.•Discusses specifically issues associated with implementing a power-law test efficiently.•Focuses on parallel computation for accurate evaluation of statistical p-value, setting path for future improvements.
With big data becoming available across the physical, life and social sciences, researchers are turning their attention to the question of whether universal statistical signatures emerge across systems. Power-laws are a particularly potent example, since they indicate scale-free or scale invariant behavior and are observed in physical systems near phase transitions. However, the same scale-free property that enables them to unify behaviors across multiple spatiotemporal scales, also means that usual Gaussian-based approaches cannot be used to test their presence. Here we analyze the crucial question of how to implement a power-law test efficiently, given that a key part involves multiple Monte Carlo simulations to obtain an accurate statistical p-value. We present such a computational scheme in detail.
