The detection of community structures is a crucial research area. The problem of community detection has received considerable attention from a large portion of the scientific community and a very large number of papers has already been published in the literature. Even more important is the fact that, this large number of articles is in fact spread across a large number of different disciplines, from computer science, to statistics, and social sciences. These facts necessitate some type of classification and organization of these works. In this work, our basic classification approach divides the community detection schemes into three basic approaches: (a) the bottom-up approaches, (b) the top-down approaches, and (c) the data structure-based approaches. The first category includes the majority of algorithms, so further classification is possible. Such a classification is included in this work. For the other two categories, we make no further categorizations but we simply focus our discussion on the metrics or the data structures being used. Finally, a few possible directions for future research are also suggested.
Load balancing techniques in cloud computing can be applied at three different levels: Virtual machine load balancing, task load balancing, and resource load balancing. At all levels, load balancing should also be implemented in an efficient manner, to increase system performance. In this paper, we propose a fair, in terms of added workload per VM, task load balancing strategy, that aims to improve the average response time and the makespan of the system in the cloud environment. The problem is formulated as an irreducible finite state Markov process, which is known to have a balance equation for each state. From the balance state probabilities we derive the expected utilizations for the virtual machines (VM), which play a vital role in our task allocation approach. In our model, the Load Balancer (LBer) acts as a central server, which uses our proposed fair task allocation scheme to distribute the incoming tasks in a fair, balanced manner among the virtual machines, taking into account their current state as well as their processing capabilities. Our scheme has been compared to recent algorithms that use the particle swarm optimization and the Honey bee foraging scheme to achieve load balancing. Our experimental results show that our proposed scheme outperforms other state of the art schemes in terms of makespan, average response time, and resource utilization and provides lower degree of imbalance.
In the first days of social networking, the typical view of a community was a set of user profiles of the same interests and likes, and this community kept enlarging by searching, proposing, and adding new members with the same characteristics that were likely to interfere with the existing members. Today, things have changed dramatically. Social networking platforms are not restricted to forming similar user profiles: The vast amounts of data produced every day have given opportunities to predict and suggest relationships, behaviors, and everyday activities like shopping, food, traveling destinations, etc. Every day, vast data amounts are generated by the famous social networks such as Facebook, Twitter, Instagram, and so on. For example, Facebook alone generates 4 petabytes of data per day. The analysis of such data is of high importance to many aspects like recommendation systems, businesses, health organizations, etc. The community detection problem received considerable attention a long time ago. Communities are represented as clusters of an entire network. Most of the community detection techniques are based on graph structures. In this paper, we present the recent advances of deep learning techniques for community detection. We describe the most recent strategies presented in this field, and we provide some general discussion and some future trends.
The detection of community structures is a very crucial research area. The problem of community detection has received considerable attention from a large portion of the scientific community. More importantly, these articles are spread across a large number of different disciplines, from computer science, to statistics, and social sciences. The analysis of modern social networks becomes rather cumbersome, as their size and number keeps growing larger and larger. Moreover, in the modern communities, users participate in large number of groups. From the network perspective, efficient methods should be developed to automatically identify overlapping communities, that is, communities with overlapping nodes. In this work, we use a probabilistic network model to characterize and identify linked communities with common nodes. The innovative idea in this work is that the communities are represented as Markovian networks with continuously changing states. Each state represents the number of users within a cluster, that have specific characteristic classes. Based on the current state, we introduce a fast, linear on the number of newly added users, approach to estimate the probability of each cluster to be homogeneous in terms of sets of user characteristics and to determine how well the new user fit within a community. Because of the linear computations involved, our proposed probabilistic model can detect communities and overlaps with low execution time and high accuracy, as shown in our experimental results. The experimental results have shown that our probabilistic scheme executes faster and provides more robust communities compared to competitive schemes.
We are currently living in the big data era, in which it has become more necessary than ever to develop “smart” schedulers. It is common knowledge that the default Storm scheduler, as well as a large number of static schemes, has presented certain deficiencies. One of the most important of these deficiencies is the weakness in handling cases in which system changes occur. In such a scenario, some type of re-scheduling is necessary to keep the system working in the most efficient way. In this paper, we present a pipeline-based dynamic modular arithmetic-based scheduler (PMOD scheduler), which can be used to re-schedule the streams distributed among a set of nodes and their tasks, when the system parameters (number of tasks, executors or nodes) change. The PMOD scheduler organizes all the required operations in a pipeline scheme, thus reducing the overall processing time.
The Petri net (PN) formalism is a suitable tool for modeling parallel systems due to its basic characteristics, such as synchronization. The extension of PN, the Colored Petri Nets (CPN) allows the incorporation of more details of the real system into the model (for example, contention for shared resources). The CPNs have been widely used in a variety of fields to produce suitable models. One of their biggest strengths is that their overall philosophy is quite similar to the philosophy of the object-oriented paradigm. In this regard, the CPN models can be used to implement simulators in a rather straightforward way. In this paper, the CPN framework is employed to implement a new resource allocation simulator, which is used to verify the performance of our previous work, where we proposed a fair resource allocation scheme with flow control and maximum utilization of the system’s resources.