Professor of Physics,
Deputy Director, Centre for Quantum Technologies,
Fellow of the University Scholars Programme (USP)
MY LATEST RESEARCH
Ling Feng & C H Lai
Optimal machine intelligence near the edge of chaos
It has long been suggested that living systems, in particular the brain, may operate near some critical point. How about machines? Through dynamical stability analysis on various computer vision models, we find direct evidence that optimal deep neural network performance occur near the transition point separating stable and chaotic attractors. In fact modern neural network archivectures push the model closer to this edge of chaos during the training process. Our dissection into their fully connected layers reveals that they achieve the stability transition through self-adjusting an oscillation-diffusion process embedded in the weights. Further analogy to the logistic leads us to believe that the optimality near the edge of chaos is a consequence of maximal diversity of stable states, which maximized the effective expressivity.
S Ma, L Feng, C P Monterola and C H Lai
Importance of small degree nodes in assortative networks with degree-weight correlations
Physical Review E96, 042308
It has been known that assortative network structure plays an important role in spreading dynamics for unweighted networks. Yet its influence on weighted networks is not clear, in particular when weight is strongly correlated with the degrees of the nodes as we empirically observed in Twitter. Here we use the self-consistent probability method and revised non-perturbative HMF method to investigate this influence on both SIR and SIS spreading dynamics. Both our simulation and theoretical results show that while the critical threshold is not significantly influenced by the assortativity, the prevalence in the supercritical regime shows a cross-over under different degree-weight
correlations. In particular, unlike the case of random mixing networks, in assortative networks, the negatively degree-weight correlation leads to higher prevalence in their spreading beyond the critical transmissivity than that of the
positively correlated. In addition, the previously observed inhibition effect on spreading velocity by assortative structure is not apparent in negatively degree-weight correlated networks, while enhanced for that of the positively correlated. Detailed investigation into the degree distribution of the infected nodes reveals that small degree nodes play essential roles in the supercritical phase of both SIR and SIS spreadings. Our results have direct implications on viral information spreading over online social networks and epidemic spreading over contact networks.
H S Sugiarto, J S Lansing, N N Chung, C H Lai, S A Cheong and L Y Chew,
Social cooperation and disharmony in communities mediated through common pool resource exploitation
Physical Review Letters 118, 208301 (2017)
Phys.Org News: https://phys.org/news/2017-05-phase-transitions-rice-farmers-insight.html
It was theorized that when a society exploits a shared resource, the system can undergo extreme phase
transition from full cooperation in abiding by a social agreement, to full defection from it. This was shown
to happen in an integrated society with complex social relationships. However, real-world agents tend to
segregate into communities whose interactions contain features of the associated community structure. We
found that such social segregation softens the abrupt extreme transition through the emergence of multiple
intermediate phases composed of communities of cooperators and defectors. Phase transitions thus now
occur through these intermediate phases which avert the instantaneous collapse of social cooperation within a society. While this is beneficial to society, it nonetheless costs society in two ways. First, the return to full cooperation from full defection at the phase transition is no longer immediate. Community linkages have rendered greater societal inertia such that the switch back is now typically stepwise rather than a single change. Second, there is a drastic increase in social disharmony within the society due to the greater tension in the relationship between segregated communities of defectors and cooperators. Intriguingly, these results on multiple phases with its associated phenomenon of social disharmony are found to characterize the level of cooperation within a society of Balinese farmers who exploit water for rice production.