Picture Wise Just Noticeable Difference (PW-JND), which accounts for the minimum difference of a picture that human visual system can perceive, can be widely used in perception-oriented image and video processing. However, the conventional Just Noticeable Difference (JND) models calculate the JND threshold for each pixel or sub-band separately, which may not reflect the total masking effect of a picture accurately. In this paper, we propose a deep learning based PW-JND prediction model for image compression. Firstly, we formulate the task of predicting PW-JND as a multi-class classification problem, and propose a framework to transform the multi-class classification problem to a binary classification problem solved by just one binary classifier. Secondly, we construct a deep learning based binary classifier named perceptually lossy/lossless predictor which can predict whether an image is perceptually lossy to another or not. Finally, we propose a sliding window based search strategy to predict PW-JND based on the prediction results of the perceptually lossy/lossless predictor. Experimental results show that the mean accuracy of the perceptually lossy/lossless predictor reaches 92%, and the absolute prediction error of the proposed PW-JND model is 0.79 dB on average, which show the superiority of the proposed PW-JND model to the conventional JND models.
13 September 2021 in Computers in Biology and Medicine
COVID-19 is one of the biggest challenges that human beings have faced recently. Many researchers have proposed different prediction methods for establishing a virus transmission model and predicting the trend of COVID-19. Among them, the methods based on artificial intelligence are currently the most interesting and widely used. However, only using artificial intelligence methods for prediction cannot capture the time change pattern of the transmission of infectious diseases. To solve this problem, this paper proposes a COVID-19 prediction model based on time-dependent SIRVD by using deep learning. This model combines deep learning technology with the mathematical model of infectious diseases, and forecasts the parameters in the mathematical model of infectious diseases by fusing deep learning models such as LSTM and other time prediction methods. In the current situation of mass vaccination, we analyzed COVID-19 data from January 15, 2021, to May 27, 2021 in seven countries – India, Argentina, Brazil, South Korea, Russia, the United Kingdom, France, Germany, and Italy. The experimental results show that the prediction model not only has a 50% improvement in single-day predictions compared to pure deep learning methods, but also can be adapted to short- and medium-term predictions, which makes the overall prediction more interpretable and robust.
28 April 2021 in IEEE Transactions on Circuits and Systems for Video Technology
Human visual system has a limitation of sensitivity in detecting small distortion in an image/video and the minimum perceptual threshold is so called Just Noticeable Difference (JND). JND modelling is challenging since it highly depends on visual contents and perceptual factors are not fully understood. In this paper, we propose deep learning based JND and perceptual quality prediction models, which are able to predict the Satisfied User Ratio (SUR) and Video Wise JND (VWJND) of compressed videos with different resolutions and coding parameters. Firstly, the SUR prediction is modeled as a regression problem that fits deep learning tools. Then, Video Wise Spatial SUR method (VW-SSUR) is proposed to predict the SUR value for compressed video, which mainly considers the spatial distortion. Thirdly, we further propose Video Wise Spatial-Temporal SUR (VW-STSUR) method to improve the SUR prediction accuracy by considering the spatial and temporal information. Two fusion schemes that fuse the spatial and temporal information in quality score level and in feature level, respectively, are investigated. Finally, key factors including key frame and patch selections, cross resolution prediction and complexity are analyzed. Experimental results demonstrate the proposed VW-SSUR method outperforms in both SUR and VWJND prediction as compared with the state-of-the-art schemes. Moreover, the proposed VW-STSUR further improves the accuracy as compared with the VW-SSUR and the conventional JND models, where the mean SUR prediction error is 0.049, and mean VWJND prediction error is 1.69 in quantization parameter and 0.84 dB in peak signal-to-noise ratio.
25 September 2020 in IEEE Internet of Things Journal
Although the accuracy of load forecasting has been studied by many works, the actual deployability of a model is rarely considered. In this work, we consider the actual deployability of a model from four aspects: the prediction performance of the model, the robustness of the model, the dependence of the model on external data and the storage size of the model. From these four aspects, we propose a multiple wavelet convolutional neural network (MWCNN) for load forecasting. On two public datasets, we verified the performance and robustness of the MWCNN. The MWCNN only uses load data, and the storage size of the model is only 497 KB, which shows that MWCNN has good deployability. In addition, our MWCNN prediction results are interpretable. The experimental results show that the MWCNN can effectively capture the periodic characteristics of load data.
Pull Request (PR) is a major contributor to external developers of open-source projects in GitHub. PR reviewing is an important part of open-source software developments to ensure the quality of project. Recommending suitable candidates of reviewer to the new PRs will make the PR reviewing more efficient. However, there is not a mechanism of automatic reviewer recommendation for PR in GitHub. In this paper, we propose an automatic core-reviewer recommendation approach, which combines PR topic model with collaborators in the social network. First PR topics will be extracted from PRs by the latent Dirichlet allocation, and then the collaborator–PR network will be constructed with the connection between collaborators and PRs, and the influence of each collaborator will be calculated via the improved PageRank algorithm which combines with HITS. Finally, the relationship between topics and collaborators will also be built by the history of PR reviewing. When a new PR presents, a collaborator will be chosen as a core reviewer according to the influence of collaborators and the relationship between the new PR and collaborators. The experiment results show in the matching score calculation processing, the influence of collaborators shows higher than that with the expert, and the recommendation precision is better than 70%.
The development of open source brings new thinking and production modes to software engineering and computer science, and establishes a software development method and ecological environment in which groups participate. Regardless of investors, developers, participants, and managers, they are most concerned about whether the Open Source Ecosystem can be sustainable to ensure that the ecosystem they choose will serve users for a long time. Moreover, the most important quality of the software ecosystem is sustainability, and it is also a research area in Symmetry. Therefore, it is significant to assess the sustainability of the Open Source Ecosystem. However, the current measurement of the sustainability of the Open Source Ecosystem lacks universal measurement indicators, as well as a method and a model. Therefore, this paper constructs an Evaluation Indicators System, which consists of three levels: The target level, the guideline level and the evaluation level, and takes openness, stability, activity, and extensibility as measurement indicators. On this basis, a weight calculation method, based on information contribution values and a Sustainability Assessment Model, is proposed. The models and methods are used to analyze the factors affecting the sustainability of Stack Overflow (SO) ecosystem. Through the analysis, we find that every indicator in the SO ecosystem is partaking in different development trends. The development trend of a single indicator does not represent the sustainable development trend of the whole ecosystem. It is necessary to consider all of the indicators to judge that ecosystem’s sustainability. The research on the sustainability of the Open Source Ecosystem is helpful for judging software health, measuring development efficiency and adjusting organizational structure. It also provides a reference for researchers who study the sustainability of software engineering.